[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:00:43.566078   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46269
I20260709 13:00:43.568070   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:00:43.569300   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:43.589033   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:43.590615   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:43.589038   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:43.590356   431 server_base.cc:1061] running on GCE node
I20260709 13:00:44.811126   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:44.811390   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:44.811537   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602044811522 us; error 0 us; skew 500 ppm
I20260709 13:00:44.812430   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:44.818656   431 webserver.cc:533] Webserver started at http://127.0.107.254:41691/ using document root <none> and password file <none>
I20260709 13:00:44.819535   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:44.819744   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:44.820242   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:44.826362   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "62ba0b17505647669e75a1a9719c8464"
format_stamp: "Formatted at 2026-07-09 13:00:44 on dist-test-slave-rrf3"
I20260709 13:00:44.835132   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:00:44.841010   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:44.842799   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:00:44.843252   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "62ba0b17505647669e75a1a9719c8464"
format_stamp: "Formatted at 2026-07-09 13:00:44 on dist-test-slave-rrf3"
I20260709 13:00:44.843705   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:44.903156   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:44.904887   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:00:44.905409   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:44.995079   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46269
I20260709 13:00:44.995215   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46269 every 8 connection(s)
I20260709 13:00:45.004225   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:45.027657   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: Bootstrap starting.
I20260709 13:00:45.034226   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.036212   498 log.cc:826] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: Log is configured to *not* fsync() on all Append() calls
I20260709 13:00:45.041828   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: No bootstrap required, opened a new log
I20260709 13:00:45.064720   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER }
I20260709 13:00:45.065287   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.065613   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ba0b17505647669e75a1a9719c8464, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.067049   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER }
I20260709 13:00:45.067559   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:45.067857   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:45.068266   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.072906   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER }
I20260709 13:00:45.073750   498 leader_election.cc:304] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62ba0b17505647669e75a1a9719c8464; no voters: 
I20260709 13:00:45.075829   498 leader_election.cc:290] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:45.076252   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:45.079185   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 1 LEADER]: Becoming Leader. State: Replica: 62ba0b17505647669e75a1a9719c8464, State: Running, Role: LEADER
I20260709 13:00:45.080533   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER }
I20260709 13:00:45.081274   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:45.095160   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62ba0b17505647669e75a1a9719c8464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER } }
I20260709 13:00:45.094962   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62ba0b17505647669e75a1a9719c8464. Latest consensus state: current_term: 1 leader_uuid: "62ba0b17505647669e75a1a9719c8464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ba0b17505647669e75a1a9719c8464" member_type: VOTER } }
I20260709 13:00:45.096601   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:45.096601   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:45.101497   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:45.114732   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:45.117746   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:45.135214   511 catalog_manager.cc:1383] Generated new cluster ID: 8fea743e01b9453fb55a4bf0242d2e8e
I20260709 13:00:45.135532   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:45.154433   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:45.156144   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:45.174220   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: Generated new TSK 0
I20260709 13:00:45.175300   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:45.184919   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:45.194373   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:45.195647   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:45.200719   431 server_base.cc:1061] running on GCE node
W20260709 13:00:45.201041   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:45.202164   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:45.202418   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:45.202641   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602045202601 us; error 0 us; skew 500 ppm
I20260709 13:00:45.203269   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:45.208734   431 webserver.cc:533] Webserver started at http://127.0.107.193:45975/ using document root <none> and password file <none>
I20260709 13:00:45.209311   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:45.209522   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:45.209826   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:45.210964   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "b2d38df63c5a482984d5b4fe900fac41"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.217391   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:00:45.222532   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.223475   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:00:45.223865   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "b2d38df63c5a482984d5b4fe900fac41"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.224363   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:45.258693   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:45.260569   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:45.263763   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:45.269799   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:45.270136   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.270452   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:45.270697   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.374892   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38899
I20260709 13:00:45.374943   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38899 every 8 connection(s)
I20260709 13:00:45.383704   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:45.400964   593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:45.406378   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:45.410720   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:45.412945   431 server_base.cc:1061] running on GCE node
I20260709 13:00:45.413791   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:45.414028   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:45.414239   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602045414221 us; error 0 us; skew 500 ppm
I20260709 13:00:45.414844   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:45.417764   431 webserver.cc:533] Webserver started at http://127.0.107.194:37479/ using document root <none> and password file <none>
I20260709 13:00:45.418291   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:45.418514   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:45.418799   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:45.419938   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "f7bd4554bc984358869878db3f176bf7"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.423952   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46269
I20260709 13:00:45.424434   591 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:45.425871   591 heartbeater.cc:507] Master 127.0.107.254:46269 requested a full tablet report, sending...
I20260709 13:00:45.429348   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:00:45.429941   463 ts_manager.cc:194] Registered new tserver with Master: b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899)
I20260709 13:00:45.433380   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40564
I20260709 13:00:45.435221   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.436313   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:00:45.436664   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "f7bd4554bc984358869878db3f176bf7"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.437031   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:45.465803   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:45.467128   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:45.470264   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:45.473425   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:45.473635   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.473944   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:45.474092   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.590242   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40873
I20260709 13:00:45.590595   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40873 every 8 connection(s)
I20260709 13:00:45.599022   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:45.609302   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:45.611272   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:45.616415   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46269
I20260709 13:00:45.616959   666 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:45.618140   666 heartbeater.cc:507] Master 127.0.107.254:46269 requested a full tablet report, sending...
I20260709 13:00:45.621485   463 ts_manager.cc:194] Registered new tserver with Master: f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:45.624353   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40568
I20260709 13:00:45.630726   431 server_base.cc:1061] running on GCE node
W20260709 13:00:45.632071   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:45.633165   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:45.633440   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:45.633636   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602045633620 us; error 0 us; skew 500 ppm
I20260709 13:00:45.634372   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:45.637322   431 webserver.cc:533] Webserver started at http://127.0.107.195:34953/ using document root <none> and password file <none>
I20260709 13:00:45.637924   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:45.638175   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:45.638489   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:45.639840   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "fc860794e1354db88416d1316b6ed1c5"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.645694   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:00:45.649883   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.650792   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:00:45.651135   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "fc860794e1354db88416d1316b6ed1c5"
format_stamp: "Formatted at 2026-07-09 13:00:45 on dist-test-slave-rrf3"
I20260709 13:00:45.651499   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:45.669034   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:45.670729   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:45.672544   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:45.675921   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:45.676223   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:00:45.676505   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:45.676715   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:45.777699   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34367
I20260709 13:00:45.777755   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34367 every 8 connection(s)
I20260709 13:00:45.797412   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46269
I20260709 13:00:45.797842   740 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:45.798834   740 heartbeater.cc:507] Master 127.0.107.254:46269 requested a full tablet report, sending...
I20260709 13:00:45.801381   463 ts_manager.cc:194] Registered new tserver with Master: fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:45.802201   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018192834s
I20260709 13:00:45.802937   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40580
I20260709 13:00:45.860844   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40590:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:45.864799   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:45.981523   630 tablet_service.cc:1511] Processing CreateTablet for tablet 2585aa91c727457fb5191864c39087d2 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:45.985469   629 tablet_service.cc:1511] Processing CreateTablet for tablet ce1f455e5a104127bb4df17bf0735272 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:45.984354   631 tablet_service.cc:1511] Processing CreateTablet for tablet d280dd77902d46a39a05c0f2babd92a0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:45.987898   628 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe372f8fc346f4abe96abbd476730f (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:45.994072   627 tablet_service.cc:1511] Processing CreateTablet for tablet b52b46c09f2542e78d58a7a762ae09fe (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:45.987170   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585aa91c727457fb5191864c39087d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:45.998159   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1f455e5a104127bb4df17bf0735272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:45.998811   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280dd77902d46a39a05c0f2babd92a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.000084   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52b46c09f2542e78d58a7a762ae09fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.008000   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe372f8fc346f4abe96abbd476730f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.012777   626 tablet_service.cc:1511] Processing CreateTablet for tablet 17e8b8973851492aa9c5f584dda14fc0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:46.018755   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e8b8973851492aa9c5f584dda14fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.052225   625 tablet_service.cc:1511] Processing CreateTablet for tablet 27cfec93d4624f19955afbaf0d98547c (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:46.053962   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27cfec93d4624f19955afbaf0d98547c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.056577   624 tablet_service.cc:1511] Processing CreateTablet for tablet 44f34a1616144bffa8fba4930c20c67d (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:46.074473   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f34a1616144bffa8fba4930c20c67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.075497   758 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.085781   704 tablet_service.cc:1511] Processing CreateTablet for tablet 2585aa91c727457fb5191864c39087d2 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:46.090616   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585aa91c727457fb5191864c39087d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.090590   703 tablet_service.cc:1511] Processing CreateTablet for tablet ce1f455e5a104127bb4df17bf0735272 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:46.091447   702 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe372f8fc346f4abe96abbd476730f (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:46.089519   705 tablet_service.cc:1511] Processing CreateTablet for tablet d280dd77902d46a39a05c0f2babd92a0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:46.104859   700 tablet_service.cc:1511] Processing CreateTablet for tablet 17e8b8973851492aa9c5f584dda14fc0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:46.104835   699 tablet_service.cc:1511] Processing CreateTablet for tablet 27cfec93d4624f19955afbaf0d98547c (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:46.110085   701 tablet_service.cc:1511] Processing CreateTablet for tablet b52b46c09f2542e78d58a7a762ae09fe (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:46.107578   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe372f8fc346f4abe96abbd476730f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.118314   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52b46c09f2542e78d58a7a762ae09fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.118261   698 tablet_service.cc:1511] Processing CreateTablet for tablet 44f34a1616144bffa8fba4930c20c67d (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:46.104074   623 tablet_service.cc:1511] Processing CreateTablet for tablet 4d01562a8c02446c81dfb883a68c0d8e (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:46.129254   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1f455e5a104127bb4df17bf0735272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.131242   697 tablet_service.cc:1511] Processing CreateTablet for tablet 4d01562a8c02446c81dfb883a68c0d8e (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:46.138535   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d01562a8c02446c81dfb883a68c0d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.142367   550 tablet_service.cc:1511] Processing CreateTablet for tablet 27cfec93d4624f19955afbaf0d98547c (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:46.143961   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27cfec93d4624f19955afbaf0d98547c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.147497   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f34a1616144bffa8fba4930c20c67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.147496   554 tablet_service.cc:1511] Processing CreateTablet for tablet ce1f455e5a104127bb4df17bf0735272 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:46.153838   556 tablet_service.cc:1511] Processing CreateTablet for tablet d280dd77902d46a39a05c0f2babd92a0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION VALUES < 238609294
W20260709 13:00:46.155489   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:46.135309   553 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe372f8fc346f4abe96abbd476730f (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:46.148262   552 tablet_service.cc:1511] Processing CreateTablet for tablet b52b46c09f2542e78d58a7a762ae09fe (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:46.150977   551 tablet_service.cc:1511] Processing CreateTablet for tablet 17e8b8973851492aa9c5f584dda14fc0 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:46.150897   555 tablet_service.cc:1511] Processing CreateTablet for tablet 2585aa91c727457fb5191864c39087d2 (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:46.179137   549 tablet_service.cc:1511] Processing CreateTablet for tablet 44f34a1616144bffa8fba4930c20c67d (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:46.181427   548 tablet_service.cc:1511] Processing CreateTablet for tablet 4d01562a8c02446c81dfb883a68c0d8e (DEFAULT_TABLE table=test-workload [id=12001a8f8d4f42cca76b6c4df595476f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:46.182710   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280dd77902d46a39a05c0f2babd92a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.189294   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d01562a8c02446c81dfb883a68c0d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.192423   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27cfec93d4624f19955afbaf0d98547c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.193202   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe372f8fc346f4abe96abbd476730f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.194123   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e8b8973851492aa9c5f584dda14fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.194927   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1f455e5a104127bb4df17bf0735272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.196096   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f34a1616144bffa8fba4930c20c67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.196916   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585aa91c727457fb5191864c39087d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.197870   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d01562a8c02446c81dfb883a68c0d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.200866   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52b46c09f2542e78d58a7a762ae09fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.232288   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280dd77902d46a39a05c0f2babd92a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.252811   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e8b8973851492aa9c5f584dda14fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:46.269675   758 tablet_bootstrap.cc:654] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.418167   758 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.419727   758 ts_tablet_manager.cc:1403] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.345s	user 0.024s	sys 0.022s
I20260709 13:00:46.420897   760 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.421490   761 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
W20260709 13:00:46.425386   447 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:38899, user_credentials={real_user=slave}} blocked reactor thread for 55290.3us
I20260709 13:00:46.434289   761 tablet_bootstrap.cc:654] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.434257   758 raft_consensus.cc:359] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.435746   758 raft_consensus.cc:385] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.436743   758 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.437490   591 heartbeater.cc:499] Master 127.0.107.254:46269 was elected leader, sending a full tablet report...
I20260709 13:00:46.440001   760 tablet_bootstrap.cc:654] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.456574   758 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.459281   760 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.459919   760 ts_tablet_manager.cc:1403] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.015s
I20260709 13:00:46.464702   758 ts_tablet_manager.cc:1434] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.006s
I20260709 13:00:46.464710   760 raft_consensus.cc:359] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.465706   760 raft_consensus.cc:385] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.466017   760 raft_consensus.cc:740] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.466744   760 consensus_queue.cc:260] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.468420   666 heartbeater.cc:499] Master 127.0.107.254:46269 was elected leader, sending a full tablet report...
I20260709 13:00:46.468775   740 heartbeater.cc:499] Master 127.0.107.254:46269 was elected leader, sending a full tablet report...
I20260709 13:00:46.468994   758 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.469347   760 ts_tablet_manager.cc:1434] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:00:46.470681   760 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.477898   758 tablet_bootstrap.cc:654] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.478515   761 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.478971   760 tablet_bootstrap.cc:654] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.479058   761 ts_tablet_manager.cc:1403] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.010s
I20260709 13:00:46.482266   761 raft_consensus.cc:359] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.483049   761 raft_consensus.cc:385] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.483366   761 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.484118   761 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.499078   758 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.500583   761 ts_tablet_manager.cc:1434] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:00:46.504933   761 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.508890   758 ts_tablet_manager.cc:1403] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.040s	user 0.001s	sys 0.017s
I20260709 13:00:46.509889   768 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.510404   768 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.514292   761 tablet_bootstrap.cc:654] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.516535   758 raft_consensus.cc:359] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.521800   758 raft_consensus.cc:385] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.522224   758 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.523526   758 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.526355   758 ts_tablet_manager.cc:1434] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:00:46.527559   758 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.529338   768 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
W20260709 13:00:46.535873   741 tablet.cc:2406] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:46.538554   760 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.539132   760 ts_tablet_manager.cc:1403] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.041s
I20260709 13:00:46.540843   761 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.541316   761 ts_tablet_manager.cc:1403] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.001s
I20260709 13:00:46.542454   760 raft_consensus.cc:359] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.543203   760 raft_consensus.cc:385] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.543915   760 raft_consensus.cc:740] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.544636   761 raft_consensus.cc:359] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.544852   760 consensus_queue.cc:260] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.545395   761 raft_consensus.cc:385] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.547427   760 ts_tablet_manager.cc:1434] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:00:46.545703   761 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.548831   760 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.549021   761 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.552614   761 ts_tablet_manager.cc:1434] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:00:46.553546   761 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.557229   758 tablet_bootstrap.cc:654] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.570649   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:46.571434   760 tablet_bootstrap.cc:654] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:46.572856   530 leader_election.cc:343] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.575196   761 tablet_bootstrap.cc:654] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.580215   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
W20260709 13:00:46.582237   531 leader_election.cc:343] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.582720   531 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41; no voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:46.583240   760 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.583724   760 ts_tablet_manager.cc:1403] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.006s
I20260709 13:00:46.583560   768 raft_consensus.cc:2749] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.587599   758 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.586719   760 raft_consensus.cc:359] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.588017   760 raft_consensus.cc:385] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.588251   758 ts_tablet_manager.cc:1403] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.002s
I20260709 13:00:46.588403   760 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.589336   760 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.591426   758 raft_consensus.cc:359] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.592233   758 raft_consensus.cc:385] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.592584   758 raft_consensus.cc:740] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.593937   758 consensus_queue.cc:260] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.596199   758 ts_tablet_manager.cc:1434] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:46.596302   765 raft_consensus.cc:493] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.597259   758 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.596797   765 raft_consensus.cc:515] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.602838   765 leader_election.cc:290] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:46.614123   760 ts_tablet_manager.cc:1434] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:00:46.615953   765 raft_consensus.cc:493] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.616477   765 raft_consensus.cc:515] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.616864   761 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.617439   761 ts_tablet_manager.cc:1403] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.010s
I20260709 13:00:46.619911   765 leader_election.cc:290] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:46.617849   758 tablet_bootstrap.cc:654] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.621716   761 raft_consensus.cc:359] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.622452   761 raft_consensus.cc:385] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.622751   761 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.615156   760 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.623558   761 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.625775   761 ts_tablet_manager.cc:1434] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:00:46.626714   761 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.632758   760 tablet_bootstrap.cc:654] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.647327   758 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.648103   758 ts_tablet_manager.cc:1403] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.012s
I20260709 13:00:46.650039   764 raft_consensus.cc:493] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.650540   764 raft_consensus.cc:515] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.651742   760 tablet_bootstrap.cc:492] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.651417   758 raft_consensus.cc:359] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.652253   758 raft_consensus.cc:385] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.652280   760 ts_tablet_manager.cc:1403] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.006s
I20260709 13:00:46.652623   758 raft_consensus.cc:740] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.653546   758 consensus_queue.cc:260] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.656694   764 leader_election.cc:290] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:46.658376   760 raft_consensus.cc:359] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.659824   760 raft_consensus.cc:385] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.660136   760 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.660699   761 tablet_bootstrap.cc:654] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.660918   760 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.669407   760 ts_tablet_manager.cc:1434] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:00:46.681550   758 ts_tablet_manager.cc:1434] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 13:00:46.684603   758 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.683974   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:46.684340   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:46.688325   760 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
W20260709 13:00:46.697388   678 leader_election.cc:343] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:46.700871   678 leader_election.cc:343] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.714926   758 tablet_bootstrap.cc:654] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.717000   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:46.717479   760 tablet_bootstrap.cc:654] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.717793   641 raft_consensus.cc:2468] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 0.
I20260709 13:00:46.720075   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:46.721065   640 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 0.
I20260709 13:00:46.723047   679 leader_election.cc:304] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:46.728440   765 raft_consensus.cc:2804] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.728942   765 raft_consensus.cc:493] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.729387   765 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.735626   679 leader_election.cc:304] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:46.743770   765 raft_consensus.cc:515] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.752184   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:46.754838   565 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
I20260709 13:00:46.759663   604 leader_election.cc:304] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:46.764464   781 raft_consensus.cc:2804] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.765569   781 raft_consensus.cc:493] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.766371   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:46.766610   781 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.768352   765 leader_election.cc:290] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:46.771610   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:46.772236   640 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.768429   786 raft_consensus.cc:2804] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:46.769568   678 leader_election.cc:343] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.774241   760 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.775080   760 ts_tablet_manager.cc:1403] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.018s
I20260709 13:00:46.773670   786 raft_consensus.cc:493] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.779561   786 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.779214   760 raft_consensus.cc:359] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.780503   760 raft_consensus.cc:385] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.779871   781 raft_consensus.cc:515] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.781347   760 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.783509   760 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.784366   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:46.784013   761 tablet_bootstrap.cc:492] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.785095   715 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
I20260709 13:00:46.786954   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:46.786908   761 ts_tablet_manager.cc:1403] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.020s
I20260709 13:00:46.787542   781 leader_election.cc:290] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:46.798496   764 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.786810   758 tablet_bootstrap.cc:492] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.799027   640 raft_consensus.cc:2468] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 1.
I20260709 13:00:46.805959   758 ts_tablet_manager.cc:1403] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.008s
I20260709 13:00:46.787576   565 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.807036   679 leader_election.cc:304] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:46.808460   765 raft_consensus.cc:2804] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.795403   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:46.793787   760 ts_tablet_manager.cc:1434] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:46.809012   715 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.811954   760 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.809149   764 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.817121   761 raft_consensus.cc:359] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.818136   764 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:46.819887   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:46.820550   761 raft_consensus.cc:385] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.821657   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:46.821355   714 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
W20260709 13:00:46.824321   604 leader_election.cc:343] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.822988   765 raft_consensus.cc:697] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:46.822561   761 raft_consensus.cc:740] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.825783   606 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:46.825884   765 consensus_queue.cc:237] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.825819   758 raft_consensus.cc:359] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.828728   764 raft_consensus.cc:2804] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.828958   758 raft_consensus.cc:385] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.829275   764 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.829304   758 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.830024   764 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.839917   786 raft_consensus.cc:515] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.827536   761 consensus_queue.cc:260] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.834044   565 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
I20260709 13:00:46.838598   760 tablet_bootstrap.cc:654] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.842115   604 leader_election.cc:304] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:46.842990   781 raft_consensus.cc:2804] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.840538   715 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
I20260709 13:00:46.830408   758 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.852737   761 ts_tablet_manager.cc:1434] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.003s
I20260709 13:00:46.855340   781 raft_consensus.cc:697] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:46.856725   781 consensus_queue.cc:237] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.858335   761 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.857334   463 catalog_manager.cc:5697] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.847905   764 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.862629   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:46.862859   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:46.863345   640 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.863858   786 leader_election.cc:290] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
W20260709 13:00:46.864527   678 leader_election.cc:343] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.870268   761 tablet_bootstrap.cc:654] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.874343   758 ts_tablet_manager.cc:1434] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.068s	user 0.011s	sys 0.008s
I20260709 13:00:46.875510   758 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.875880   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:46.876346   640 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 1.
I20260709 13:00:46.876773   760 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.877261   760 ts_tablet_manager.cc:1403] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.002s
I20260709 13:00:46.877503   679 leader_election.cc:304] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
W20260709 13:00:46.877521   604 leader_election.cc:343] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.879732   786 raft_consensus.cc:2804] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.880832   786 raft_consensus.cc:697] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:46.884613   786 consensus_queue.cc:237] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.887125   760 raft_consensus.cc:359] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.887897   760 raft_consensus.cc:385] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.891347   764 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:46.890648   760 raft_consensus.cc:740] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.897632   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:46.898288   715 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.899207   461 catalog_manager.cc:5697] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.899430   760 consensus_queue.cc:260] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.910959   715 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
I20260709 13:00:46.912326   758 tablet_bootstrap.cc:654] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.917743   761 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.924844   761 ts_tablet_manager.cc:1403] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.004s
I20260709 13:00:46.925372   606 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:46.914744   760 ts_tablet_manager.cc:1434] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:00:46.926607   764 raft_consensus.cc:2804] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.927093   764 raft_consensus.cc:697] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:46.927670   760 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:46.928344   761 raft_consensus.cc:359] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.928408   764 consensus_queue.cc:237] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.929224   761 raft_consensus.cc:385] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.929569   761 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.930503   761 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.933612   761 ts_tablet_manager.cc:1434] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:00:46.934674   761 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.938128   760 tablet_bootstrap.cc:654] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.951061   758 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:46.951622   758 ts_tablet_manager.cc:1403] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.009s
I20260709 13:00:46.958513   761 tablet_bootstrap.cc:654] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.958004   462 catalog_manager.cc:5697] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.962898   758 raft_consensus.cc:359] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.963549   758 raft_consensus.cc:385] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.963811   758 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.964481   758 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.965596   461 catalog_manager.cc:5697] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.967147   758 ts_tablet_manager.cc:1434] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:00:46.970750   758 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:46.977411   758 tablet_bootstrap.cc:654] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.978196   761 tablet_bootstrap.cc:492] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:46.978652   761 ts_tablet_manager.cc:1403] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 13:00:46.982362   761 raft_consensus.cc:359] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.983569   761 raft_consensus.cc:385] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.983986   761 raft_consensus.cc:740] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.985497   761 consensus_queue.cc:260] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:46.986631   760 tablet_bootstrap.cc:492] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:46.987697   761 ts_tablet_manager.cc:1434] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:00:46.988415   760 ts_tablet_manager.cc:1403] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.014s
I20260709 13:00:46.989004   761 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:46.996395   761 tablet_bootstrap.cc:654] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.006351   758 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:47.006913   758 ts_tablet_manager.cc:1403] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.011s
I20260709 13:00:47.006475   760 raft_consensus.cc:359] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.007344   760 raft_consensus.cc:385] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.007663   760 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.008533   761 tablet_bootstrap.cc:492] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:47.009016   761 ts_tablet_manager.cc:1403] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:00:47.008966   760 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.010607   758 raft_consensus.cc:359] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.011309   758 raft_consensus.cc:385] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.011615   758 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.011719   760 ts_tablet_manager.cc:1434] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:00:47.012765   760 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
I20260709 13:00:47.012516   758 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.013839   761 raft_consensus.cc:359] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.014719   761 raft_consensus.cc:385] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.015025   761 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.015880   761 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.018918   761 ts_tablet_manager.cc:1434] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:47.019934   761 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:47.022698   758 ts_tablet_manager.cc:1434] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:00:47.023766   758 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:47.027100   761 tablet_bootstrap.cc:654] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.029664   764 raft_consensus.cc:493] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.030162   764 raft_consensus.cc:515] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.032315   764 leader_election.cc:290] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.033368   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:47.034089   565 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
I20260709 13:00:47.035840   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.036532   715 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
I20260709 13:00:47.038257   765 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.039004   606 leader_election.cc:304] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.039860   764 raft_consensus.cc:2804] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.040257   764 raft_consensus.cc:493] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.039510   765 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.040623   764 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.042475   761 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
I20260709 13:00:47.043081   761 ts_tablet_manager.cc:1403] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:00:47.043416   781 raft_consensus.cc:493] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.043956   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.044616   640 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 0.
I20260709 13:00:47.043937   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:47.045333   565 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 0.
I20260709 13:00:47.045866   679 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.046527   761 raft_consensus.cc:359] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.047200   761 raft_consensus.cc:385] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.047236   786 raft_consensus.cc:2804] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.047605   761 raft_consensus.cc:740] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.047690   765 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:47.043943   781 raft_consensus.cc:515] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.047722   786 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.048087   764 raft_consensus.cc:515] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.048656   786 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.048386   761 consensus_queue.cc:260] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.049791   781 leader_election.cc:290] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.050341   764 leader_election.cc:290] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.052191   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.052755   714 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.053699   760 tablet_bootstrap.cc:654] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.054600   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:47.055202   761 ts_tablet_manager.cc:1434] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:00:47.055259   565 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 0.
I20260709 13:00:47.056234   761 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: Bootstrap starting.
I20260709 13:00:47.056344   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.056849   566 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.056754   604 leader_election.cc:304] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.058653   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.059475   786 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.061896   786 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:47.062619   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.038141   758 tablet_bootstrap.cc:654] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.062903   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.063618   640 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:47.070632   606 leader_election.cc:343] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.069052   764 raft_consensus.cc:2804] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.072067   764 raft_consensus.cc:493] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.072433   764 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.068856   565 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.085041   640 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 1.
I20260709 13:00:47.085139   764 raft_consensus.cc:515] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.086423   714 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
I20260709 13:00:47.087622   679 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.088176   606 leader_election.cc:304] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.088963   781 raft_consensus.cc:2804] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.089185   761 tablet_bootstrap.cc:654] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.089459   781 raft_consensus.cc:697] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.090535   781 consensus_queue.cc:237] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.075991   566 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
I20260709 13:00:47.096788   786 raft_consensus.cc:2804] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.097790   786 raft_consensus.cc:697] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:47.098644   786 consensus_queue.cc:237] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.099421   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.099675   565 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 1.
I20260709 13:00:47.099997   566 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.100832   764 leader_election.cc:290] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.105700   758 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:47.108158   758 ts_tablet_manager.cc:1403] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.007s
I20260709 13:00:47.109361   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.111244   566 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 1.
W20260709 13:00:47.112200   606 leader_election.cc:343] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.118284   758 raft_consensus.cc:359] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.119483   758 raft_consensus.cc:385] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.119855   758 raft_consensus.cc:740] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.120896   765 raft_consensus.cc:493] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.120975   604 leader_election.cc:304] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:47.121510   765 raft_consensus.cc:515] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.122226   764 raft_consensus.cc:2804] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.122690   764 raft_consensus.cc:697] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.123661   765 leader_election.cc:290] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:47.123488   764 consensus_queue.cc:237] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.123787   758 consensus_queue.cc:260] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.127418   758 ts_tablet_manager.cc:1434] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:47.127641   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.127795   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:47.128482   758 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: Bootstrap starting.
I20260709 13:00:47.128729   566 raft_consensus.cc:2468] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 0.
W20260709 13:00:47.129431   679 leader_election.cc:343] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.126166   460 catalog_manager.cc:5697] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.130221   678 leader_election.cc:304] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: f7bd4554bc984358869878db3f176bf7
I20260709 13:00:47.131371   765 raft_consensus.cc:2804] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.131726   765 raft_consensus.cc:493] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.132110   765 raft_consensus.cc:3060] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.134728   761 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: No bootstrap required, opened a new log
W20260709 13:00:47.159538   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:47.174309   761 ts_tablet_manager.cc:1403] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.009s
I20260709 13:00:47.138636   765 raft_consensus.cc:515] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.175343   760 tablet_bootstrap.cc:492] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:47.175794   760 ts_tablet_manager.cc:1403] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.163s	user 0.028s	sys 0.019s
I20260709 13:00:47.177700   761 raft_consensus.cc:359] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.178439   761 raft_consensus.cc:385] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.178709   761 raft_consensus.cc:740] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.178893   760 raft_consensus.cc:359] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.179546   760 raft_consensus.cc:385] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.179371   761 consensus_queue.cc:260] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.179802   760 raft_consensus.cc:740] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.134990   758 tablet_bootstrap.cc:654] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.183040   760 consensus_queue.cc:260] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.184725   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.185262   760 ts_tablet_manager.cc:1434] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 13:00:47.185436   566 raft_consensus.cc:3060] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.185827   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.186189   760 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: Bootstrap starting.
W20260709 13:00:47.187268   679 leader_election.cc:343] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.187849   765 leader_election.cc:290] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:47.190191   761 ts_tablet_manager.cc:1434] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:47.192584   758 tablet_bootstrap.cc:492] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: No bootstrap required, opened a new log
I20260709 13:00:47.193013   758 ts_tablet_manager.cc:1403] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.011s
I20260709 13:00:47.194537   462 catalog_manager.cc:5697] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.196486   566 raft_consensus.cc:2468] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 1.
I20260709 13:00:47.198014   768 raft_consensus.cc:493] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.197785   758 raft_consensus.cc:359] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.198437   768 raft_consensus.cc:515] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.199687   678 leader_election.cc:304] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: f7bd4554bc984358869878db3f176bf7
I20260709 13:00:47.200981   768 leader_election.cc:290] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.198460   758 raft_consensus.cc:385] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.202656   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.202888   758 raft_consensus.cc:740] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.203616   640 raft_consensus.cc:2393] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d38df63c5a482984d5b4fe900fac41 in current term 1: Already voted for candidate fc860794e1354db88416d1316b6ed1c5 in this term.
I20260709 13:00:47.204413   760 tablet_bootstrap.cc:654] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.206841   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.203629   758 consensus_queue.cc:260] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.209569   758 ts_tablet_manager.cc:1434] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:00:47.210117   531 leader_election.cc:304] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41; no voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:47.211505   460 catalog_manager.cc:5697] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.212311   765 raft_consensus.cc:2804] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.212908   760 tablet_bootstrap.cc:492] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: No bootstrap required, opened a new log
I20260709 13:00:47.213096   768 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.213414   760 ts_tablet_manager.cc:1403] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 13:00:47.212972   765 raft_consensus.cc:697] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:47.214514   765 consensus_queue.cc:237] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.216858   760 raft_consensus.cc:359] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.217540   760 raft_consensus.cc:385] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.217803   760 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.218559   760 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.220778   760 ts_tablet_manager.cc:1434] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:47.226789   768 raft_consensus.cc:2749] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.227443   768 raft_consensus.cc:493] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.227885   768 raft_consensus.cc:515] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.229902   768 leader_election.cc:290] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.229614   786 consensus_queue.cc:1048] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.232074   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.241896   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.245187   530 leader_election.cc:304] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41; no voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:47.248404   816 raft_consensus.cc:2749] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.252477   566 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.251286   463 catalog_manager.cc:5697] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.265456   765 consensus_queue.cc:1048] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.291209   765 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.301513   786 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.316936   764 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.316936   768 raft_consensus.cc:493] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.318811   768 raft_consensus.cc:515] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.322012   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.322642   640 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 0.
I20260709 13:00:47.323582   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.324244   714 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 0.
I20260709 13:00:47.321396   768 leader_election.cc:290] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.325347   531 leader_election.cc:304] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.326310   768 raft_consensus.cc:2804] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.326785   768 raft_consensus.cc:493] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.327196   768 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.333911   790 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.336325   816 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.336795   816 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.339465   816 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.340907   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7" is_pre_election: true
I20260709 13:00:47.341610   768 raft_consensus.cc:515] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.342424   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.343466   715 raft_consensus.cc:2393] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d38df63c5a482984d5b4fe900fac41 in current term 1: Already voted for candidate f7bd4554bc984358869878db3f176bf7 in this term.
I20260709 13:00:47.344132   768 leader_election.cc:290] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.345124   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.346984   640 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.345707   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.352200   790 raft_consensus.cc:493] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.352577   713 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.352735   790 raft_consensus.cc:515] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.346582   531 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41; no voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:47.356462   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d38df63c5a482984d5b4fe900fac41" is_pre_election: true
I20260709 13:00:47.357555   565 raft_consensus.cc:2393] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7bd4554bc984358869878db3f176bf7 in current term 1: Already voted for candidate fc860794e1354db88416d1316b6ed1c5 in this term.
I20260709 13:00:47.357699   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d01562a8c02446c81dfb883a68c0d8e" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc860794e1354db88416d1316b6ed1c5" is_pre_election: true
I20260709 13:00:47.359309   606 leader_election.cc:304] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7bd4554bc984358869878db3f176bf7; no voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:47.360189   781 raft_consensus.cc:3060] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.363286   713 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 1.
I20260709 13:00:47.364241   790 leader_election.cc:290] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.365764   640 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 1.
I20260709 13:00:47.367404   530 leader_election.cc:304] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.368443   768 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.369468   781 raft_consensus.cc:2749] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.370524   825 raft_consensus.cc:2804] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.371896   825 raft_consensus.cc:697] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:47.373225   825 consensus_queue.cc:237] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.375280   768 raft_consensus.cc:2749] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.384788   460 catalog_manager.cc:5697] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.391433   781 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.405318   790 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.496961   786 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.510360   765 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.542706   790 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.543412   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52938
I20260709 13:00:47.544116   640 raft_consensus.cc:606] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:47.555374   713 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.564302   790 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.577559   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:00:47.578279   714 raft_consensus.cc:606] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:47.585261   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52938
I20260709 13:00:47.586198   640 raft_consensus.cc:606] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:47.591800   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52938
I20260709 13:00:47.592465   640 raft_consensus.cc:606] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:47.598639   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:00:47.599188   713 raft_consensus.cc:606] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:47.608147   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:00:47.608739   713 raft_consensus.cc:606] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:47.624293   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52430
I20260709 13:00:47.624835   565 raft_consensus.cc:606] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:47.660976   790 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.674029   790 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.687450   764 raft_consensus.cc:993] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.687927   764 raft_consensus.cc:1081] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.690220   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:47.690825   565 raft_consensus.cc:493] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.691259   565 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.696290   565 raft_consensus.cc:515] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.698096   565 leader_election.cc:290] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.698933   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.699564   640 raft_consensus.cc:3055] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.699880   640 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.700240   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.700788   713 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.700753   640 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.702888   640 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.708320   713 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.708475   640 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.709635   530 leader_election.cc:304] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.710314   825 raft_consensus.cc:2804] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.710867   825 raft_consensus.cc:697] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:47.711596   825 consensus_queue.cc:237] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.718760   460 catalog_manager.cc:5697] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 1 to 2, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.730526   788 raft_consensus.cc:993] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.731033   765 raft_consensus.cc:1081] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.732717   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52930
I20260709 13:00:47.733304   640 raft_consensus.cc:493] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.733670   640 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.740921   640 raft_consensus.cc:515] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.743135   640 leader_election.cc:290] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.744068   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.744313   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52b46c09f2542e78d58a7a762ae09fe" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.744809   565 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.744925   713 raft_consensus.cc:3055] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.745378   713 raft_consensus.cc:740] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:47.746171   713 consensus_queue.cc:260] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.747375   713 raft_consensus.cc:3060] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.750180   565 raft_consensus.cc:2468] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:47.751627   604 leader_election.cc:304] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.752395   790 raft_consensus.cc:2804] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.752851   790 raft_consensus.cc:697] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.753587   790 consensus_queue.cc:237] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.754946   713 raft_consensus.cc:2468] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:47.761372   460 catalog_manager.cc:5697] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 1 to 2, leader changed from fc860794e1354db88416d1316b6ed1c5 (127.0.107.195) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.805115   765 consensus_queue.cc:1048] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.818436   788 consensus_queue.cc:1048] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.827237   790 raft_consensus.cc:993] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.827716   781 raft_consensus.cc:1081] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.829520   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:47.830109   566 raft_consensus.cc:493] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.830499   566 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.837757   566 raft_consensus.cc:515] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.840893   566 leader_election.cc:290] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.840981   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.841809   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.842208   640 raft_consensus.cc:3055] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.842419   713 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.842687   640 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.843631   640 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.844837   640 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.849598   713 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.850884   640 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.851140   531 leader_election.cc:304] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.852166   825 raft_consensus.cc:2804] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.852662   825 raft_consensus.cc:697] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:47.853468   825 consensus_queue.cc:237] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.860895   460 catalog_manager.cc:5697] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 1 to 2, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.908178   788 raft_consensus.cc:993] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.908866   786 raft_consensus.cc:1081] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.910631   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52930
I20260709 13:00:47.911129   640 raft_consensus.cc:493] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.911442   640 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.915915   640 raft_consensus.cc:515] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.917641   640 leader_election.cc:290] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.919169   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:47.919548   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.919811   566 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.920217   713 raft_consensus.cc:3055] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.920601   713 raft_consensus.cc:740] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:47.921409   713 consensus_queue.cc:260] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.923017   713 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.929813   765 raft_consensus.cc:993] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.929957   566 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:47.930332   765 raft_consensus.cc:1081] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.931491   604 leader_election.cc:304] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.932293   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52414
I20260709 13:00:47.932469   790 raft_consensus.cc:2804] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.932901   565 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.932992   790 raft_consensus.cc:697] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.933401   565 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.933907   790 consensus_queue.cc:237] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.942337   565 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.943315   792 raft_consensus.cc:993] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.943768   792 raft_consensus.cc:1081] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:47.945058   825 consensus_queue.cc:1048] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.945587   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.946177   714 raft_consensus.cc:3055] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.946492   714 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:47.947270   714 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.948402   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.948977   640 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.947587   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:47.952349   713 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:47.952373   564 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.953384   564 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.952278   460 catalog_manager.cc:5697] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 1 to 2, leader changed from fc860794e1354db88416d1316b6ed1c5 (127.0.107.195) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.948434   714 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.960497   564 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.953406   565 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.964104   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:47.965332   639 raft_consensus.cc:3055] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.965708   639 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:47.966687   639 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:47.968014   639 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.970705   640 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.971024   825 raft_consensus.cc:993] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.971952   825 raft_consensus.cc:1081] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:47.972119   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:47.972756   713 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.963654   714 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:47.975682   530 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:47.978858   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52924
I20260709 13:00:47.965739   564 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:47.986388   825 raft_consensus.cc:2804] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.988930   641 raft_consensus.cc:493] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.990753   641 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.989866   825 raft_consensus.cc:697] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:47.997951   768 consensus_queue.cc:1048] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:00:47.998342   825 consensus_queue.cc:237] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:48.006182   713 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:48.010031   531 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:47.995280   639 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 2.
I20260709 13:00:48.017831   844 raft_consensus.cc:2804] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.018340   462 catalog_manager.cc:5697] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 1 to 2, leader changed from fc860794e1354db88416d1316b6ed1c5 (127.0.107.195) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.024216   844 raft_consensus.cc:697] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:48.025360   844 consensus_queue.cc:237] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:48.022212   641 raft_consensus.cc:515] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:48.043294   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:48.043932   713 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.044953   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f34a1616144bffa8fba4930c20c67d" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:48.045544   565 raft_consensus.cc:3055] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.044757   462 catalog_manager.cc:5697] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 1 to 2, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.045907   565 raft_consensus.cc:740] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:48.046751   565 consensus_queue.cc:260] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:48.047926   565 raft_consensus.cc:3060] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.050089   641 leader_election.cc:290] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:48.051968   713 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:48.053248   606 leader_election.cc:304] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:48.054127   781 raft_consensus.cc:2804] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.055053   781 raft_consensus.cc:697] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:48.056541   565 raft_consensus.cc:2468] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 2.
I20260709 13:00:48.055866   781 consensus_queue.cc:237] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:48.068737   462 catalog_manager.cc:5697] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 1 to 2, leader changed from b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.127746   713 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.129262   844 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.139714   641 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.141286   768 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.146031   565 raft_consensus.cc:1275] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.150348   764 consensus_queue.cc:1048] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.160418   713 raft_consensus.cc:1275] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.161979   764 consensus_queue.cc:1048] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.352308   713 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.354460   768 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.357546   565 raft_consensus.cc:1275] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.359367   764 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.364475   641 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.366628   844 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.392843   713 raft_consensus.cc:1275] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.394315   764 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.416646   714 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.418067   768 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.426970   639 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.428592   844 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.504112   639 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.505486   844 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.511572   565 raft_consensus.cc:1275] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.513965   764 consensus_queue.cc:1048] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.516283   714 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.517781   768 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.523795   715 raft_consensus.cc:1275] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.525663   781 consensus_queue.cc:1048] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:50.661564   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:00:50.662436   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:50.686528   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:50.687129   639 raft_consensus.cc:606] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Received request to transfer leadership to TS fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:50.698534   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
mode: GRACEFUL
new_leader_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:37442
I20260709 13:00:50.699035   565 raft_consensus.cc:606] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Received request to transfer leadership to TS fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:50.700168   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:50.700598   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:50.908490   792 raft_consensus.cc:993] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: : Instructing follower fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:50.909004   792 raft_consensus.cc:1081] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Signalling peer fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:50.910377   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:48562
I20260709 13:00:50.910853   713 raft_consensus.cc:493] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:50.911163   713 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.915448   713 raft_consensus.cc:515] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:50.917053   713 leader_election.cc:290] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 2 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:50.917995   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:50.918128   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:50.918541   565 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.918673   639 raft_consensus.cc:3055] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:50.919041   639 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:50.919724   639 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:50.920670   639 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.923552   565 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 2.
I20260709 13:00:50.924808   678 leader_election.cc:304] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:50.924981   639 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 2.
I20260709 13:00:50.925621   851 raft_consensus.cc:2804] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:50.927268   851 raft_consensus.cc:697] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:50.928205   851 consensus_queue.cc:237] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:50.937018   462 catalog_manager.cc:5697] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 1 to 2, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:51.009696   844 raft_consensus.cc:993] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: : Instructing follower fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:51.010200   856 raft_consensus.cc:1081] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Signalling peer fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:51.011958   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:48554
I20260709 13:00:51.012557   713 raft_consensus.cc:493] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.012854   713 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.017132   713 raft_consensus.cc:515] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.019798   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:51.020206   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:51.019929   713 leader_election.cc:290] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:51.020455   565 raft_consensus.cc:3055] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.020799   639 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.020937   565 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:51.021908   565 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.023074   565 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.026862   639 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 3.
I20260709 13:00:51.027827   565 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 3.
I20260709 13:00:51.027971   679 leader_election.cc:304] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:51.028893   851 raft_consensus.cc:2804] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.029241   851 raft_consensus.cc:697] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:51.029843   851 consensus_queue.cc:237] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.036998   462 catalog_manager.cc:5697] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 2 to 3, leader changed from b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193) to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:51.471841   639 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:51.473098   857 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:51.484685   565 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:51.487510   857 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:51.496784   639 raft_consensus.cc:1275] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.498039   866 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.500386   565 raft_consensus.cc:1275] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.501637   866 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.701387   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.711450   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:00:51.712126   713 raft_consensus.cc:606] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:51.717374   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52430
I20260709 13:00:51.717939   565 raft_consensus.cc:606] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:51.722965   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52430
I20260709 13:00:51.723438   565 raft_consensus.cc:606] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:51.728348   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52430
I20260709 13:00:51.728927   565 raft_consensus.cc:606] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:51.733129   873 raft_consensus.cc:993] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.733532   856 raft_consensus.cc:1081] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.735308   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52924
I20260709 13:00:51.735955   639 raft_consensus.cc:493] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.736297   639 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.737406   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
mode: GRACEFUL
new_leader_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:00:51.737900   713 raft_consensus.cc:606] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 LEADER]: Received request to transfer leadership to TS f7bd4554bc984358869878db3f176bf7
I20260709 13:00:51.742178   639 raft_consensus.cc:515] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.744572   639 leader_election.cc:290] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:51.745908   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:51.746188   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:51.746454   715 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.746726   565 raft_consensus.cc:3055] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.746943   565 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:51.747471   565 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.748383   565 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.750927   715 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:51.751955   606 leader_election.cc:304] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:51.752125   565 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:51.752749   792 raft_consensus.cc:2804] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.753221   792 raft_consensus.cc:697] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:51.754079   792 consensus_queue.cc:237] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.760468   462 catalog_manager.cc:5697] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 2 to 3, leader changed from b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.872715   873 raft_consensus.cc:993] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.873185   856 raft_consensus.cc:1081] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.874682   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52924
I20260709 13:00:51.875209   639 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.875519   639 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.879886   639 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.881462   639 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:51.882531   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:51.882443   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:51.883052   565 raft_consensus.cc:3055] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.883113   715 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.883373   565 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:51.884001   565 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.884851   565 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.887856   715 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:51.888708   565 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:51.888878   606 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:51.889700   792 raft_consensus.cc:2804] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.890152   792 raft_consensus.cc:697] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:51.890763   792 consensus_queue.cc:237] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.897250   462 catalog_manager.cc:5697] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 2 to 3, leader changed from b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.947153   857 raft_consensus.cc:993] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.947657   857 raft_consensus.cc:1081] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.949249   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52930
I20260709 13:00:51.949790   639 raft_consensus.cc:493] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.950106   639 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.954474   639 raft_consensus.cc:515] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.956043   639 leader_election.cc:290] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 4 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:51.957015   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:51.956961   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280dd77902d46a39a05c0f2babd92a0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:51.957676   565 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.957672   715 raft_consensus.cc:3055] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:51.958201   715 raft_consensus.cc:740] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:51.958982   715 consensus_queue.cc:260] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.960158   715 raft_consensus.cc:3060] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.963758   565 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 4.
I20260709 13:00:51.964998   604 leader_election.cc:304] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:51.965756   792 raft_consensus.cc:2804] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:51.966092   715 raft_consensus.cc:2468] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 4.
I20260709 13:00:51.966286   792 raft_consensus.cc:697] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 4 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:51.967132   792 consensus_queue.cc:237] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.972731   462 catalog_manager.cc:5697] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 3 to 4, leader changed from fc860794e1354db88416d1316b6ed1c5 (127.0.107.195) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.990465   873 raft_consensus.cc:993] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.991003   856 raft_consensus.cc:1081] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:51.992393   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52924
I20260709 13:00:51.992864   639 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.993189   639 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.997839   639 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:51.999456   639 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:52.000316   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:52.000470   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:52.000862   565 raft_consensus.cc:3055] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.000914   713 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.001297   565 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:52.002074   565 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:52.003180   565 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.006939   713 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:52.008073   606 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f7bd4554bc984358869878db3f176bf7, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:52.008903   792 raft_consensus.cc:2804] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.009135   565 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:52.009351   792 raft_consensus.cc:697] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:52.010076   792 consensus_queue.cc:237] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:52.016316   462 catalog_manager.cc:5697] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 2 to 3, leader changed from b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.046438   866 raft_consensus.cc:993] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: : Instructing follower f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:52.046872   866 raft_consensus.cc:1081] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 LEADER]: Signalling peer f7bd4554bc984358869878db3f176bf7 to start an election
I20260709 13:00:52.048547   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
 from {username='slave'} at 127.0.0.1:52930
I20260709 13:00:52.049052   639 raft_consensus.cc:493] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.049412   639 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.054165   639 raft_consensus.cc:515] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:52.055766   639 leader_election.cc:290] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:52.056680   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:52.056680   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "f7bd4554bc984358869878db3f176bf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:52.057395   565 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.057426   713 raft_consensus.cc:3055] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.057857   713 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:52.058562   713 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:52.059604   713 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.063266   565 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:52.064339   604 leader_election.cc:304] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, f7bd4554bc984358869878db3f176bf7; no voters: 
I20260709 13:00:52.065006   792 raft_consensus.cc:2804] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.064993   713 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7bd4554bc984358869878db3f176bf7 in term 3.
I20260709 13:00:52.065585   792 raft_consensus.cc:697] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Leader. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:52.066377   792 consensus_queue.cc:237] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:52.071700   462 catalog_manager.cc:5697] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 reported cstate change: term changed from 2 to 3, leader changed from fc860794e1354db88416d1316b6ed1c5 (127.0.107.195) to f7bd4554bc984358869878db3f176bf7 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f7bd4554bc984358869878db3f176bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.153425   713 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.154798   792 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.166062   565 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.168044   883 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:52.275683   713 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.277070   883 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.286432   565 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.288897   882 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.409258   713 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.410619   882 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.421604   565 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.423056   872 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:52.463569   565 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:52.465118   883 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:52.472623   713 raft_consensus.cc:1275] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:52.474140   872 consensus_queue.cc:1048] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:52.482054   565 raft_consensus.cc:1275] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.483561   883 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:52.493402   713 raft_consensus.cc:1275] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Refusing update from remote peer f7bd4554bc984358869878db3f176bf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:52.494804   882 consensus_queue.cc:1048] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:54.755555   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:54.764173   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:54.765064   639 raft_consensus.cc:606] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:54.768188   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:54.768728   639 raft_consensus.cc:606] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Received request to transfer leadership to TS fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:54.771155   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:54.771679   639 raft_consensus.cc:606] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:54.773818   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:54.774286   639 raft_consensus.cc:606] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Received request to transfer leadership to TS b2d38df63c5a482984d5b4fe900fac41
I20260709 13:00:54.776829   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "f7bd4554bc984358869878db3f176bf7"
mode: GRACEFUL
new_leader_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:51100
I20260709 13:00:54.777349   639 raft_consensus.cc:606] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Received request to transfer leadership to TS fc860794e1354db88416d1316b6ed1c5
I20260709 13:00:54.778450   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:54.778939   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:54.927675   792 raft_consensus.cc:993] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: : Instructing follower fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:54.928308   892 raft_consensus.cc:1081] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Signalling peer fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:54.929958   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:48562
I20260709 13:00:54.930563   713 raft_consensus.cc:493] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.930944   713 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.936074   713 raft_consensus.cc:515] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:54.937572   713 leader_election.cc:290] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 4 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:54.938733   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:54.938864   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1f455e5a104127bb4df17bf0735272" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:54.939589   639 raft_consensus.cc:3055] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:54.939635   564 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.940003   639 raft_consensus.cc:740] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:54.940883   639 consensus_queue.cc:260] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:54.942128   639 raft_consensus.cc:3060] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.946828   564 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 4.
I20260709 13:00:54.948318   678 leader_election.cc:304] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:54.948529   639 raft_consensus.cc:2468] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 4.
I20260709 13:00:54.949307   866 raft_consensus.cc:2804] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.950187   866 raft_consensus.cc:697] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 4 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:54.951129   866 consensus_queue.cc:237] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:54.958186   460 catalog_manager.cc:5697] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 3 to 4, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.995838   792 raft_consensus.cc:993] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:54.996331   792 raft_consensus.cc:1081] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:54.997709   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:54.998181   564 raft_consensus.cc:493] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.998497   564 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.003221   564 raft_consensus.cc:515] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.005640   564 leader_election.cc:290] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 4 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:55.005883   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:55.006489   639 raft_consensus.cc:3055] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.006559   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe372f8fc346f4abe96abbd476730f" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:55.006863   639 raft_consensus.cc:740] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:55.007130   715 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.007687   639 consensus_queue.cc:260] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.008993   639 raft_consensus.cc:3060] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.014578   715 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 4.
I20260709 13:00:55.015683   639 raft_consensus.cc:2468] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 4.
I20260709 13:00:55.016183   531 leader_election.cc:304] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:55.018222   899 raft_consensus.cc:2804] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:55.019409   899 raft_consensus.cc:697] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 4 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:55.020264   899 consensus_queue.cc:237] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.026983   460 catalog_manager.cc:5697] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 3 to 4, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.107348   892 raft_consensus.cc:993] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:55.107790   792 raft_consensus.cc:1081] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:55.109318   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:55.109881   564 raft_consensus.cc:493] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.110193   564 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.114846   564 raft_consensus.cc:515] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.116366   564 leader_election.cc:290] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 3 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:55.117146   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:55.117398   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27cfec93d4624f19955afbaf0d98547c" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:55.117673   639 raft_consensus.cc:3055] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:55.117905   715 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.117987   639 raft_consensus.cc:740] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:55.118786   639 consensus_queue.cc:260] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.119632   639 raft_consensus.cc:3060] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.122716   715 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 3.
I20260709 13:00:55.123461   639 raft_consensus.cc:2468] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 3.
I20260709 13:00:55.123677   531 leader_election.cc:304] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:55.124552   899 raft_consensus.cc:2804] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.124969   899 raft_consensus.cc:697] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 3 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:55.125705   899 consensus_queue.cc:237] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.132786   460 catalog_manager.cc:5697] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 2 to 3, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.134485   892 raft_consensus.cc:993] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: : Instructing follower fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:55.134892   792 raft_consensus.cc:1081] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Signalling peer fc860794e1354db88416d1316b6ed1c5 to start an election
I20260709 13:00:55.136425   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2585aa91c727457fb5191864c39087d2"
dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
 from {username='slave'} at 127.0.0.1:48562
I20260709 13:00:55.136931   715 raft_consensus.cc:493] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.137212   715 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.142409   715 raft_consensus.cc:515] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.144209   715 leader_election.cc:290] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 4 election: Requested vote from peers b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899), f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873)
I20260709 13:00:55.144827   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
I20260709 13:00:55.145201   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585aa91c727457fb5191864c39087d2" candidate_uuid: "fc860794e1354db88416d1316b6ed1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:55.145419   564 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.145779   639 raft_consensus.cc:3055] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.146065   639 raft_consensus.cc:740] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:55.146725   639 consensus_queue.cc:260] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.147532   639 raft_consensus.cc:3060] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.150189   564 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 4.
I20260709 13:00:55.151147   678 leader_election.cc:304] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:55.151587   639 raft_consensus.cc:2468] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc860794e1354db88416d1316b6ed1c5 in term 4.
I20260709 13:00:55.151883   866 raft_consensus.cc:2804] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:55.152395   866 raft_consensus.cc:697] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 4 LEADER]: Becoming Leader. State: Replica: fc860794e1354db88416d1316b6ed1c5, State: Running, Role: LEADER
I20260709 13:00:55.153214   866 consensus_queue.cc:237] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.160140   460 catalog_manager.cc:5697] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 reported cstate change: term changed from 3 to 4, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to fc860794e1354db88416d1316b6ed1c5 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "fc860794e1354db88416d1316b6ed1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.267292   892 raft_consensus.cc:993] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: : Instructing follower b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:55.267800   792 raft_consensus.cc:1081] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Signalling peer b2d38df63c5a482984d5b4fe900fac41 to start an election
I20260709 13:00:55.269418   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0"
dest_uuid: "b2d38df63c5a482984d5b4fe900fac41"
 from {username='slave'} at 127.0.0.1:52428
I20260709 13:00:55.270113   564 raft_consensus.cc:493] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:55.270452   564 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.275311   564 raft_consensus.cc:515] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.276973   564 leader_election.cc:290] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 4 election: Requested vote from peers f7bd4554bc984358869878db3f176bf7 (127.0.107.194:40873), fc860794e1354db88416d1316b6ed1c5 (127.0.107.195:34367)
I20260709 13:00:55.277848   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7bd4554bc984358869878db3f176bf7"
I20260709 13:00:55.278050   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e8b8973851492aa9c5f584dda14fc0" candidate_uuid: "b2d38df63c5a482984d5b4fe900fac41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc860794e1354db88416d1316b6ed1c5"
I20260709 13:00:55.278393   639 raft_consensus.cc:3055] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.278541   715 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.278723   639 raft_consensus.cc:740] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f7bd4554bc984358869878db3f176bf7, State: Running, Role: LEADER
I20260709 13:00:55.279526   639 consensus_queue.cc:260] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.280647   639 raft_consensus.cc:3060] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.285507   715 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 4.
I20260709 13:00:55.286741   531 leader_election.cc:304] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d38df63c5a482984d5b4fe900fac41, fc860794e1354db88416d1316b6ed1c5; no voters: 
I20260709 13:00:55.287218   639 raft_consensus.cc:2468] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d38df63c5a482984d5b4fe900fac41 in term 4.
I20260709 13:00:55.287616   899 raft_consensus.cc:2804] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:55.288139   899 raft_consensus.cc:697] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 LEADER]: Becoming Leader. State: Replica: b2d38df63c5a482984d5b4fe900fac41, State: Running, Role: LEADER
I20260709 13:00:55.288960   899 consensus_queue.cc:237] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } }
I20260709 13:00:55.296703   460 catalog_manager.cc:5697] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 reported cstate change: term changed from 3 to 4, leader changed from f7bd4554bc984358869878db3f176bf7 (127.0.107.194) to b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b2d38df63c5a482984d5b4fe900fac41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.398386   639 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.399943   866 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.409557   641 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.411491   564 raft_consensus.cc:1275] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.412801   866 consensus_queue.cc:1048] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.412540   899 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:55.427802   715 raft_consensus.cc:1275] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.429157   899 consensus_queue.cc:1048] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.551237   564 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.552479   866 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d38df63c5a482984d5b4fe900fac41" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.562556   639 raft_consensus.cc:1275] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Refusing update from remote peer fc860794e1354db88416d1316b6ed1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:55.564908   914 consensus_queue.cc:1048] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:55.657040   715 raft_consensus.cc:1275] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:55.658392   899 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc860794e1354db88416d1316b6ed1c5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.662921   639 raft_consensus.cc:1275] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Refusing update from remote peer b2d38df63c5a482984d5b4fe900fac41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:55.664297   899 consensus_queue.cc:1048] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7bd4554bc984358869878db3f176bf7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.779821   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:55.785398   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:00:55.806651   678 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:55.812493   678 consensus_peers.cc:597] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 -> Peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Couldn't send request to peer b2d38df63c5a482984d5b4fe900fac41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.814623   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:55.815492   431 tablet_replica.cc:333] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.816293   431 raft_consensus.cc:2243] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.816810   431 raft_consensus.cc:2272] T 44f34a1616144bffa8fba4930c20c67d P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.818958   431 tablet_replica.cc:333] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.819473   431 raft_consensus.cc:2243] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.819849   431 raft_consensus.cc:2272] T 4d01562a8c02446c81dfb883a68c0d8e P b2d38df63c5a482984d5b4fe900fac41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.821458   431 tablet_replica.cc:333] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.821944   431 raft_consensus.cc:2243] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:55.822644   431 raft_consensus.cc:2272] T 7efe372f8fc346f4abe96abbd476730f P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.824615   431 tablet_replica.cc:333] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.825112   431 raft_consensus.cc:2243] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.825487   431 raft_consensus.cc:2272] T ce1f455e5a104127bb4df17bf0735272 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.827673   431 tablet_replica.cc:333] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.828286   431 raft_consensus.cc:2243] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:55.828945   431 raft_consensus.cc:2272] T 27cfec93d4624f19955afbaf0d98547c P b2d38df63c5a482984d5b4fe900fac41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.831032   431 tablet_replica.cc:333] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.831581   431 raft_consensus.cc:2243] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.832002   431 raft_consensus.cc:2272] T 2585aa91c727457fb5191864c39087d2 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.834102   431 tablet_replica.cc:333] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.834587   431 raft_consensus.cc:2243] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.834998   431 raft_consensus.cc:2272] T b52b46c09f2542e78d58a7a762ae09fe P b2d38df63c5a482984d5b4fe900fac41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.837319   431 tablet_replica.cc:333] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.838126   431 raft_consensus.cc:2243] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:55.838963   431 pending_rounds.cc:70] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Trying to abort 1 pending ops.
I20260709 13:00:55.839310   431 pending_rounds.cc:77] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305634018473545728 op_type: NO_OP noop_request { }
I20260709 13:00:55.839802   431 raft_consensus.cc:2889] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:55.840273   431 raft_consensus.cc:2272] T 17e8b8973851492aa9c5f584dda14fc0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.843264   431 tablet_replica.cc:333] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41: stopping tablet replica
I20260709 13:00:55.844161   431 raft_consensus.cc:2243] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.844954   431 raft_consensus.cc:2272] T d280dd77902d46a39a05c0f2babd92a0 P b2d38df63c5a482984d5b4fe900fac41 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:55.847460   604 consensus_peers.cc:597] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 -> Peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Couldn't send request to peer b2d38df63c5a482984d5b4fe900fac41. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.942149   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:55.958676   678 consensus_peers.cc:597] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 -> Peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Couldn't send request to peer b2d38df63c5a482984d5b4fe900fac41. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.967433   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:00:55.995034   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:55.995749   431 tablet_replica.cc:333] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:55.996436   431 raft_consensus.cc:2243] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:55.996912   431 raft_consensus.cc:2272] T 4d01562a8c02446c81dfb883a68c0d8e P f7bd4554bc984358869878db3f176bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:55.998682   431 tablet_replica.cc:333] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:55.999193   431 raft_consensus.cc:2243] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:55.999958   431 raft_consensus.cc:2272] T 44f34a1616144bffa8fba4930c20c67d P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.002352   431 tablet_replica.cc:333] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.002880   431 raft_consensus.cc:2243] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.003288   431 raft_consensus.cc:2272] T 17e8b8973851492aa9c5f584dda14fc0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.004931   431 tablet_replica.cc:333] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.005381   431 raft_consensus.cc:2243] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.005775   431 raft_consensus.cc:2272] T 2585aa91c727457fb5191864c39087d2 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.008502   431 tablet_replica.cc:333] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.009044   431 raft_consensus.cc:2243] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.009498   431 raft_consensus.cc:2272] T 27cfec93d4624f19955afbaf0d98547c P f7bd4554bc984358869878db3f176bf7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.011519   431 tablet_replica.cc:333] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.012255   431 raft_consensus.cc:2243] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.013150   431 raft_consensus.cc:2272] T b52b46c09f2542e78d58a7a762ae09fe P f7bd4554bc984358869878db3f176bf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.015079   431 tablet_replica.cc:333] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.015642   431 raft_consensus.cc:2243] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.016175   431 raft_consensus.cc:2272] T ce1f455e5a104127bb4df17bf0735272 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.019966   431 tablet_replica.cc:333] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.020906   431 raft_consensus.cc:2243] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.021505   431 raft_consensus.cc:2272] T 7efe372f8fc346f4abe96abbd476730f P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:56.023350   678 consensus_peers.cc:597] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 -> Peer b2d38df63c5a482984d5b4fe900fac41 (127.0.107.193:38899): Couldn't send request to peer b2d38df63c5a482984d5b4fe900fac41. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.024886   431 tablet_replica.cc:333] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7: stopping tablet replica
I20260709 13:00:56.025645   431 raft_consensus.cc:2243] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.026417   431 raft_consensus.cc:2272] T d280dd77902d46a39a05c0f2babd92a0 P f7bd4554bc984358869878db3f176bf7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.056330   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:56.073916   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:00:56.102802   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:56.103487   431 tablet_replica.cc:333] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.104286   431 raft_consensus.cc:2243] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.104818   431 raft_consensus.cc:2272] T 44f34a1616144bffa8fba4930c20c67d P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.106503   431 tablet_replica.cc:333] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.107020   431 raft_consensus.cc:2243] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.107908   431 raft_consensus.cc:2272] T 4d01562a8c02446c81dfb883a68c0d8e P fc860794e1354db88416d1316b6ed1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.109741   431 tablet_replica.cc:333] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.110248   431 raft_consensus.cc:2243] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.110677   431 raft_consensus.cc:2272] T d280dd77902d46a39a05c0f2babd92a0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.112253   431 tablet_replica.cc:333] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.112733   431 raft_consensus.cc:2243] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.113444   431 raft_consensus.cc:2272] T ce1f455e5a104127bb4df17bf0735272 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.115473   431 tablet_replica.cc:333] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.115980   431 raft_consensus.cc:2243] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.116492   431 raft_consensus.cc:2272] T 7efe372f8fc346f4abe96abbd476730f P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.119561   431 tablet_replica.cc:333] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.120275   431 raft_consensus.cc:2243] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.120769   431 raft_consensus.cc:2272] T 17e8b8973851492aa9c5f584dda14fc0 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.122450   431 tablet_replica.cc:333] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.122916   431 raft_consensus.cc:2243] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.123656   431 raft_consensus.cc:2272] T 2585aa91c727457fb5191864c39087d2 P fc860794e1354db88416d1316b6ed1c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.125921   431 tablet_replica.cc:333] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.126379   431 raft_consensus.cc:2243] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.126791   431 raft_consensus.cc:2272] T 27cfec93d4624f19955afbaf0d98547c P fc860794e1354db88416d1316b6ed1c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.128743   431 tablet_replica.cc:333] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5: stopping tablet replica
I20260709 13:00:56.129187   431 raft_consensus.cc:2243] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:56.129606   431 raft_consensus.cc:2272] T b52b46c09f2542e78d58a7a762ae09fe P fc860794e1354db88416d1316b6ed1c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.156227   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:56.174266   431 master.cc:562] Master@127.0.107.254:46269 shutting down...
I20260709 13:00:56.328351   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:56.328943   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:56.329299   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 62ba0b17505647669e75a1a9719c8464: stopping tablet replica
I20260709 13:00:56.348726   431 master.cc:584] Master@127.0.107.254:46269 shutdown complete.
b2d38df63c5a482984d5b4fe900fac41  4
f7bd4554bc984358869878db3f176bf7  4
fc860794e1354db88416d1316b6ed1c5  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12826 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:00:56.389422   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46319
I20260709 13:00:56.390612   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:56.396406   923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.396735   924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.398108   926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.399253   431 server_base.cc:1061] running on GCE node
I20260709 13:00:56.400331   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:56.400549   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:56.400666   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602056400654 us; error 0 us; skew 500 ppm
I20260709 13:00:56.401346   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:56.404723   431 webserver.cc:533] Webserver started at http://127.0.107.254:44189/ using document root <none> and password file <none>
I20260709 13:00:56.405392   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:56.405666   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:56.405982   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:56.407128   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "74adfcd738064c709c2b6255d79fb9c2"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.411716   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:00:56.415436   931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.416378   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:56.416625   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "74adfcd738064c709c2b6255d79fb9c2"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.416869   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:56.436378   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:56.437532   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:56.476668   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46319
I20260709 13:00:56.476751   982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46319 every 8 connection(s)
I20260709 13:00:56.480944   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:56.490476   983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2: Bootstrap starting.
I20260709 13:00:56.495738   983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:56.500353   983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2: No bootstrap required, opened a new log
I20260709 13:00:56.502496   983 raft_consensus.cc:359] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER }
I20260709 13:00:56.503078   983 raft_consensus.cc:385] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:56.503371   983 raft_consensus.cc:740] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74adfcd738064c709c2b6255d79fb9c2, State: Initialized, Role: FOLLOWER
I20260709 13:00:56.504009   983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER }
I20260709 13:00:56.504509   983 raft_consensus.cc:399] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:56.504756   983 raft_consensus.cc:493] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:56.505028   983 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.509050   983 raft_consensus.cc:515] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER }
I20260709 13:00:56.509622   983 leader_election.cc:304] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74adfcd738064c709c2b6255d79fb9c2; no voters: 
I20260709 13:00:56.510845   983 leader_election.cc:290] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:56.511278   986 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.512702   986 raft_consensus.cc:697] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 1 LEADER]: Becoming Leader. State: Replica: 74adfcd738064c709c2b6255d79fb9c2, State: Running, Role: LEADER
I20260709 13:00:56.513388   986 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER }
I20260709 13:00:56.513749   983 sys_catalog.cc:565] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:56.517933   987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74adfcd738064c709c2b6255d79fb9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER } }
I20260709 13:00:56.518486   988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74adfcd738064c709c2b6255d79fb9c2. Latest consensus state: current_term: 1 leader_uuid: "74adfcd738064c709c2b6255d79fb9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74adfcd738064c709c2b6255d79fb9c2" member_type: VOTER } }
I20260709 13:00:56.518784   987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:56.519236   988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:56.523581   992 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:56.531446   992 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:56.532474   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:56.540417   992 catalog_manager.cc:1383] Generated new cluster ID: 580ec2f16bfc47bfa3fbdbf9beaa7ca2
I20260709 13:00:56.540701   992 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:56.555331   992 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:56.556833   992 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:56.582386   992 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2: Generated new TSK 0
I20260709 13:00:56.583041   992 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:56.599411   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:56.605381  1004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.606477  1005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.608398  1007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.608599   431 server_base.cc:1061] running on GCE node
I20260709 13:00:56.609591   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:56.609838   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:56.610035   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602056610009 us; error 0 us; skew 500 ppm
I20260709 13:00:56.610610   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:56.613161   431 webserver.cc:533] Webserver started at http://127.0.107.193:36345/ using document root <none> and password file <none>
I20260709 13:00:56.613695   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:56.613919   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:56.614215   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:56.615530   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "84283e85da474e78bf130ce8083b9713"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.620711   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:00:56.624200  1012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.625070   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:56.625430   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "84283e85da474e78bf130ce8083b9713"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.625819   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:56.649091   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:56.650379   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:56.651850   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:56.654146   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:56.654367   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.654636   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:56.654827   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.695365   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44643
I20260709 13:00:56.695466  1074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44643 every 8 connection(s)
I20260709 13:00:56.700111   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:56.707319  1079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.709159  1080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.712853   431 server_base.cc:1061] running on GCE node
W20260709 13:00:56.713376  1082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.714278   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:56.714462   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:56.714632   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602056714615 us; error 0 us; skew 500 ppm
I20260709 13:00:56.715193   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:56.718190   431 webserver.cc:533] Webserver started at http://127.0.107.194:45145/ using document root <none> and password file <none>
I20260709 13:00:56.718832  1075 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46319
I20260709 13:00:56.718854   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:56.719332  1075 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:56.719344   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:56.719884   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:56.720242  1075 heartbeater.cc:507] Master 127.0.107.254:46319 requested a full tablet report, sending...
I20260709 13:00:56.721153   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "20463fab1f94475082b491357801b691"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.722608   948 ts_manager.cc:194] Registered new tserver with Master: 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643)
I20260709 13:00:56.725010   948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46918
I20260709 13:00:56.727263   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:00:56.730922  1087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.731707   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:56.732020   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "20463fab1f94475082b491357801b691"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.732347   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:56.743335   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:56.744561   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:56.745975   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:56.748153   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:56.748390   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.748626   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:56.748797   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.788537   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45623
I20260709 13:00:56.788688  1149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45623 every 8 connection(s)
I20260709 13:00:56.793457   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:56.800855  1153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.803210  1154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.806102  1156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.806221   431 server_base.cc:1061] running on GCE node
I20260709 13:00:56.807124  1150 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46319
I20260709 13:00:56.807438   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:56.807497  1150 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:56.807705   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:56.807940   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602056807920 us; error 0 us; skew 500 ppm
I20260709 13:00:56.808549   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:56.808511  1150 heartbeater.cc:507] Master 127.0.107.254:46319 requested a full tablet report, sending...
I20260709 13:00:56.810927   948 ts_manager.cc:194] Registered new tserver with Master: 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:56.811635   431 webserver.cc:533] Webserver started at http://127.0.107.195:37871/ using document root <none> and password file <none>
I20260709 13:00:56.812196   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:56.812409   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:56.812685   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:56.812628   948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46926
I20260709 13:00:56.814158   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.818603   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:56.821892  1161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.822775   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:00:56.823017   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-rrf3"
I20260709 13:00:56.823283   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:56.842994   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:56.844200   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:56.845630   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:56.847756   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:56.847929   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.848309   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:56.848452   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.887904   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38641
I20260709 13:00:56.887993  1223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38641 every 8 connection(s)
I20260709 13:00:56.901901  1224 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46319
I20260709 13:00:56.902381  1224 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:56.903110  1224 heartbeater.cc:507] Master 127.0.107.254:46319 requested a full tablet report, sending...
I20260709 13:00:56.905174   948 ts_manager.cc:194] Registered new tserver with Master: cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:56.905717   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014549138s
I20260709 13:00:56.906519   948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46930
I20260709 13:00:56.932926   948 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46946:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:56.935969   948 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:57.028451  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6990c8abb14bc290cae2cc62375c85 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:57.029314  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6990c8abb14bc290cae2cc62375c85 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:57.030035  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6990c8abb14bc290cae2cc62375c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.030656  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6990c8abb14bc290cae2cc62375c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.034252  1182 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1c247033fa439e8d17bf1b2b18b273 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:57.035982  1182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1c247033fa439e8d17bf1b2b18b273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.036471  1184 tablet_service.cc:1511] Processing CreateTablet for tablet fd5092d10bf84b2c9b68bbc34648ca5f (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:57.037392  1188 tablet_service.cc:1511] Processing CreateTablet for tablet b03ac70afc884e41a9091615db665904 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:57.037947  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5092d10bf84b2c9b68bbc34648ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.038902  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ac70afc884e41a9091615db665904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.035531  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc28fbc42408a9b56db1a14c43b30 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:57.034318  1185 tablet_service.cc:1511] Processing CreateTablet for tablet f32cb56429ca46318e6f0930d4c15bae (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:57.034260  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3c494ada4a40ba978cc2f2d71f1032 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:57.040432  1183 tablet_service.cc:1511] Processing CreateTablet for tablet 788b07416a36431088832b3af8361f9d (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:57.043689  1114 tablet_service.cc:1511] Processing CreateTablet for tablet b03ac70afc884e41a9091615db665904 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:57.045455  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ac70afc884e41a9091615db665904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.052459  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3c494ada4a40ba978cc2f2d71f1032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.053207  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32cb56429ca46318e6f0930d4c15bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.056820  1111 tablet_service.cc:1511] Processing CreateTablet for tablet f32cb56429ca46318e6f0930d4c15bae (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:57.058264  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32cb56429ca46318e6f0930d4c15bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.057988  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc28fbc42408a9b56db1a14c43b30 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:57.059360  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc28fbc42408a9b56db1a14c43b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.060369  1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b07416a36431088832b3af8361f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.061231  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3c494ada4a40ba978cc2f2d71f1032 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:57.061594  1039 tablet_service.cc:1511] Processing CreateTablet for tablet b03ac70afc884e41a9091615db665904 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:57.062565  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3c494ada4a40ba978cc2f2d71f1032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.062873  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ac70afc884e41a9091615db665904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.064533  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc28fbc42408a9b56db1a14c43b30 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:57.065150  1109 tablet_service.cc:1511] Processing CreateTablet for tablet 788b07416a36431088832b3af8361f9d (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:57.066255  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc28fbc42408a9b56db1a14c43b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.066483  1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b07416a36431088832b3af8361f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.068588  1108 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1c247033fa439e8d17bf1b2b18b273 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:57.068709  1036 tablet_service.cc:1511] Processing CreateTablet for tablet f32cb56429ca46318e6f0930d4c15bae (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:57.069880  1108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1c247033fa439e8d17bf1b2b18b273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.070358  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32cb56429ca46318e6f0930d4c15bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.072975  1107 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8dd0ae8ed140a398cbd821ffda0023 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:57.074805  1107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8dd0ae8ed140a398cbd821ffda0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.074438  1034 tablet_service.cc:1511] Processing CreateTablet for tablet 788b07416a36431088832b3af8361f9d (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:57.072979  1035 tablet_service.cc:1511] Processing CreateTablet for tablet fd5092d10bf84b2c9b68bbc34648ca5f (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:57.077515  1033 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1c247033fa439e8d17bf1b2b18b273 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:57.079646  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc28fbc42408a9b56db1a14c43b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.080374  1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8dd0ae8ed140a398cbd821ffda0023 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:57.084969  1031 tablet_service.cc:1511] Processing CreateTablet for tablet f6e433ef900c4f1d9ccab3f2890bb312 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:57.088572  1037 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3c494ada4a40ba978cc2f2d71f1032 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:57.088887  1181 tablet_service.cc:1511] Processing CreateTablet for tablet 5e8dd0ae8ed140a398cbd821ffda0023 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:57.088956  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6990c8abb14bc290cae2cc62375c85 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:57.087122  1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b07416a36431088832b3af8361f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.091070  1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e433ef900c4f1d9ccab3f2890bb312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.091706  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6990c8abb14bc290cae2cc62375c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.092316  1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8dd0ae8ed140a398cbd821ffda0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.060374  1110 tablet_service.cc:1511] Processing CreateTablet for tablet fd5092d10bf84b2c9b68bbc34648ca5f (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:57.093739  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5092d10bf84b2c9b68bbc34648ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.096423  1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1c247033fa439e8d17bf1b2b18b273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.100383  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3c494ada4a40ba978cc2f2d71f1032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.108517  1181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e8dd0ae8ed140a398cbd821ffda0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.122627  1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5092d10bf84b2c9b68bbc34648ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.181303  1106 tablet_service.cc:1511] Processing CreateTablet for tablet f6e433ef900c4f1d9ccab3f2890bb312 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:57.189162  1189 tablet_service.cc:1511] Processing CreateTablet for tablet f6e433ef900c4f1d9ccab3f2890bb312 (DEFAULT_TABLE table=test-workload [id=e7fd7777fcf5426faea95066bd2d958b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:57.190559  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e433ef900c4f1d9ccab3f2890bb312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.197917  1239 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.205822  1106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e433ef900c4f1d9ccab3f2890bb312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:57.239142  1239 tablet_bootstrap.cc:654] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.241035  1240 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.257969  1241 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.265538  1241 tablet_bootstrap.cc:654] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.272060  1241 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.272541  1241 ts_tablet_manager.cc:1403] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:00:57.275621  1239 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.275370  1241 raft_consensus.cc:359] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.276089  1239 ts_tablet_manager.cc:1403] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.006s
I20260709 13:00:57.276196  1241 raft_consensus.cc:385] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.276325  1240 tablet_bootstrap.cc:654] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.276541  1241 raft_consensus.cc:740] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.277387  1241 consensus_queue.cc:260] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.279189  1239 raft_consensus.cc:359] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.280342  1239 raft_consensus.cc:385] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.280740  1239 raft_consensus.cc:740] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.282300  1239 consensus_queue.cc:260] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.286841  1241 ts_tablet_manager.cc:1434] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:00:57.288430  1075 heartbeater.cc:499] Master 127.0.107.254:46319 was elected leader, sending a full tablet report...
I20260709 13:00:57.289572  1224 heartbeater.cc:499] Master 127.0.107.254:46319 was elected leader, sending a full tablet report...
I20260709 13:00:57.292737  1241 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.294224  1239 ts_tablet_manager.cc:1434] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.007s
I20260709 13:00:57.295148  1239 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.299041  1240 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.299582  1240 ts_tablet_manager.cc:1403] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.008s
I20260709 13:00:57.300063  1241 tablet_bootstrap.cc:654] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.301458  1239 tablet_bootstrap.cc:654] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.302570  1240 raft_consensus.cc:359] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.303419  1240 raft_consensus.cc:385] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.303733  1240 raft_consensus.cc:740] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.304769  1240 consensus_queue.cc:260] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.313400  1150 heartbeater.cc:499] Master 127.0.107.254:46319 was elected leader, sending a full tablet report...
I20260709 13:00:57.314451  1240 ts_tablet_manager.cc:1434] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:00:57.315614  1240 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.323732  1240 tablet_bootstrap.cc:654] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.335445  1240 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.335988  1240 ts_tablet_manager.cc:1403] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.010s
I20260709 13:00:57.338918  1240 raft_consensus.cc:359] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.339630  1240 raft_consensus.cc:385] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.339920  1240 raft_consensus.cc:740] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.340839  1240 consensus_queue.cc:260] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.343122  1240 ts_tablet_manager.cc:1434] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:57.343982  1249 raft_consensus.cc:493] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.344489  1249 raft_consensus.cc:515] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.347124  1249 leader_election.cc:290] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.348119  1240 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.354887  1240 tablet_bootstrap.cc:654] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.371356  1241 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.371937  1241 ts_tablet_manager.cc:1403] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.079s	user 0.038s	sys 0.038s
I20260709 13:00:57.371790  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
W20260709 13:00:57.373522  1088 leader_election.cc:343] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.373584  1239 tablet_bootstrap.cc:492] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.374361  1239 ts_tablet_manager.cc:1403] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.035s
I20260709 13:00:57.374859  1241 raft_consensus.cc:359] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.375559  1241 raft_consensus.cc:385] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.375792  1240 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.375856  1241 raft_consensus.cc:740] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.376520  1240 ts_tablet_manager.cc:1403] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.003s
I20260709 13:00:57.376909  1241 consensus_queue.cc:260] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.379038  1241 ts_tablet_manager.cc:1434] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:57.379578  1240 raft_consensus.cc:359] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.379730  1239 raft_consensus.cc:359] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.380383  1240 raft_consensus.cc:385] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.379930  1241 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.380523  1239 raft_consensus.cc:385] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.381201  1239 raft_consensus.cc:740] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.380899  1240 raft_consensus.cc:740] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.382889  1240 consensus_queue.cc:260] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.385655  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.383867  1239 consensus_queue.cc:260] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.386359  1199 raft_consensus.cc:2468] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 0.
I20260709 13:00:57.387475  1241 tablet_bootstrap.cc:654] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.388126  1239 ts_tablet_manager.cc:1434] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:00:57.388022  1088 leader_election.cc:304] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 84283e85da474e78bf130ce8083b9713
I20260709 13:00:57.386111  1240 ts_tablet_manager.cc:1434] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:57.390333  1240 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.391073  1249 raft_consensus.cc:493] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.391678  1249 raft_consensus.cc:515] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.393527  1239 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.394348  1249 leader_election.cc:290] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641), 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643)
I20260709 13:00:57.395087  1249 raft_consensus.cc:2804] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.395529  1249 raft_consensus.cc:493] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.403200  1240 tablet_bootstrap.cc:654] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.404613  1239 tablet_bootstrap.cc:654] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.407639  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.408389  1199 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 0.
I20260709 13:00:57.410092  1088 leader_election.cc:304] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:57.395862  1249 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.410609  1241 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.410956  1254 raft_consensus.cc:2804] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.411212  1241 ts_tablet_manager.cc:1403] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.005s
I20260709 13:00:57.411347  1254 raft_consensus.cc:493] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.411757  1254 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.413414  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.414099  1050 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 0.
I20260709 13:00:57.415644  1241 raft_consensus.cc:359] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.416982  1241 raft_consensus.cc:385] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.418856  1239 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.418792  1254 raft_consensus.cc:515] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.419353  1241 raft_consensus.cc:740] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.419607  1239 ts_tablet_manager.cc:1403] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 13:00:57.420375  1241 consensus_queue.cc:260] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.421769  1254 leader_election.cc:290] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Requested vote from peers cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641), 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643)
I20260709 13:00:57.422761  1241 ts_tablet_manager.cc:1434] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:57.423378  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.423316  1239 raft_consensus.cc:359] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.424216  1239 raft_consensus.cc:385] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.424580  1199 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.423806  1241 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.426457  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:57.427178  1050 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.427538  1240 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.428073  1240 ts_tablet_manager.cc:1403] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:00:57.430975  1240 raft_consensus.cc:359] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.431751  1240 raft_consensus.cc:385] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.432288  1241 tablet_bootstrap.cc:654] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.432204  1199 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 1.
I20260709 13:00:57.432159  1240 raft_consensus.cc:740] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.433497  1240 consensus_queue.cc:260] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.435900  1240 ts_tablet_manager.cc:1434] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:57.436985  1240 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.436751  1088 leader_election.cc:304] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:57.424618  1239 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.438227  1239 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.439147  1254 raft_consensus.cc:2804] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.440819  1239 ts_tablet_manager.cc:1434] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:00:57.441851  1239 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.445508  1240 tablet_bootstrap.cc:654] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.451453  1241 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.451958  1241 ts_tablet_manager.cc:1403] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.014s
I20260709 13:00:57.448572  1254 raft_consensus.cc:697] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:57.453055  1254 consensus_queue.cc:237] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:57.453737  1050 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 1.
I20260709 13:00:57.450881  1239 tablet_bootstrap.cc:654] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.455132  1241 raft_consensus.cc:359] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.419255  1249 raft_consensus.cc:515] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.457731  1241 raft_consensus.cc:385] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.460106  1241 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.460450  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:57.460917  1241 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
W20260709 13:00:57.461948  1088 leader_election.cc:343] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.463672  1241 ts_tablet_manager.cc:1434] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:57.464277  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.464802  1241 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.464908  1199 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.472077  1199 raft_consensus.cc:2468] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 1.
I20260709 13:00:57.473762  1088 leader_election.cc:304] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 84283e85da474e78bf130ce8083b9713
I20260709 13:00:57.475064  1259 raft_consensus.cc:2804] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.478246  1249 leader_election.cc:290] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.471961  1241 tablet_bootstrap.cc:654] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.484411  1239 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.484799  1240 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.485286  1240 ts_tablet_manager.cc:1403] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.015s
I20260709 13:00:57.485375  1239 ts_tablet_manager.cc:1403] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.010s
I20260709 13:00:57.487862  1259 raft_consensus.cc:697] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:57.488669  1240 raft_consensus.cc:359] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.488951  1259 consensus_queue.cc:237] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.489629  1240 raft_consensus.cc:385] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.490015  1240 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.491065  1240 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.493471  1240 ts_tablet_manager.cc:1434] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:57.494431  1240 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.497078  1239 raft_consensus.cc:359] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.497794  1239 raft_consensus.cc:385] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.498000  1241 tablet_bootstrap.cc:492] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.498090  1239 raft_consensus.cc:740] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.498735  1241 ts_tablet_manager.cc:1403] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.004s
I20260709 13:00:57.498965  1239 consensus_queue.cc:260] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.500115   945 catalog_manager.cc:5697] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.501802  1241 raft_consensus.cc:359] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.502559  1241 raft_consensus.cc:385] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.502835  1239 ts_tablet_manager.cc:1434] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:00:57.502902  1241 raft_consensus.cc:740] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.504251  1239 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.503878  1241 consensus_queue.cc:260] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.506511  1241 ts_tablet_manager.cc:1434] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:57.507494  1241 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.512935  1239 tablet_bootstrap.cc:654] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.513921  1241 tablet_bootstrap.cc:654] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.516520  1244 raft_consensus.cc:493] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.517796  1244 raft_consensus.cc:515] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
W20260709 13:00:57.528620   996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:57.528839  1240 tablet_bootstrap.cc:654] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.541311  1244 leader_election.cc:290] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.543177  1240 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.543680  1240 ts_tablet_manager.cc:1403] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.009s
I20260709 13:00:57.547362  1240 raft_consensus.cc:359] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.548432  1240 raft_consensus.cc:385] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.548830  1240 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.550158  1240 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.553416  1240 ts_tablet_manager.cc:1434] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.008s
I20260709 13:00:57.554807  1240 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.558027  1239 tablet_bootstrap.cc:492] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.558826  1239 ts_tablet_manager.cc:1403] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.024s
I20260709 13:00:57.561810  1240 tablet_bootstrap.cc:654] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.565402  1239 raft_consensus.cc:359] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.566053  1239 raft_consensus.cc:385] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.566318  1239 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.568694  1241 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.569401  1241 ts_tablet_manager.cc:1403] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.047s
I20260709 13:00:57.569386  1239 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.573057  1241 raft_consensus.cc:359] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.573917  1241 raft_consensus.cc:385] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.574290  1241 raft_consensus.cc:740] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.575088  1241 consensus_queue.cc:260] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.578653  1244 raft_consensus.cc:493] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.579176  1244 raft_consensus.cc:515] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.581336  1244 leader_election.cc:290] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.583329  1241 ts_tablet_manager.cc:1434] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:00:57.583436  1239 ts_tablet_manager.cc:1434] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:00:57.584589  1241 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.586323  1246 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.586576  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.586838  1246 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.588485  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.591775  1241 tablet_bootstrap.cc:654] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.592473  1244 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.593086  1244 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.595291  1244 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.596565   946 catalog_manager.cc:5697] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.599128  1246 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:57.601909  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.602543  1124 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.604925  1240 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
W20260709 13:00:57.605624  1013 leader_election.cc:343] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20463fab1f94475082b491357801b691 (127.0.107.194:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.606324  1013 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.606912  1240 ts_tablet_manager.cc:1403] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.015s
I20260709 13:00:57.609479  1241 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.609970  1241 ts_tablet_manager.cc:1403] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 13:00:57.610852  1244 raft_consensus.cc:2804] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.611228  1244 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.611579  1244 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.613022  1241 raft_consensus.cc:359] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.613785  1277 raft_consensus.cc:493] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.611583  1240 raft_consensus.cc:359] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.614319  1277 raft_consensus.cc:515] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.614701  1240 raft_consensus.cc:385] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.615149  1240 raft_consensus.cc:740] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.615964  1240 consensus_queue.cc:260] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.616636  1239 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.616751  1277 leader_election.cc:290] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.613806  1241 raft_consensus.cc:385] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.617364  1241 raft_consensus.cc:740] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.618351  1241 consensus_queue.cc:260] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.619990  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.620554  1241 ts_tablet_manager.cc:1434] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:00:57.620661  1124 raft_consensus.cc:2468] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.621578  1241 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.620994  1244 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.626776  1244 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.627424  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:57.628165  1125 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.630086  1241 tablet_bootstrap.cc:654] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.633391  1013 leader_election.cc:304] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.634536  1277 raft_consensus.cc:2804] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.634893  1277 raft_consensus.cc:493] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.635231  1277 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.637159  1125 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:57.623607  1240 ts_tablet_manager.cc:1434] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:00:57.639511  1013 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.641551  1240 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.646555  1239 tablet_bootstrap.cc:654] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.647317  1277 raft_consensus.cc:515] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.649523  1277 leader_election.cc:290] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.651192  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:57.651798  1125 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.652061  1240 tablet_bootstrap.cc:654] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.653371  1244 raft_consensus.cc:2804] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.654417  1244 raft_consensus.cc:697] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:57.655295  1244 consensus_queue.cc:237] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.656536  1241 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.656986  1241 ts_tablet_manager.cc:1403] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.008s
I20260709 13:00:57.659781  1241 raft_consensus.cc:359] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.659813  1125 raft_consensus.cc:2468] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:57.660684  1241 raft_consensus.cc:385] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.661008  1241 raft_consensus.cc:740] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.661415  1013 leader_election.cc:304] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.661839  1259 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.661692  1241 consensus_queue.cc:260] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.662238  1277 raft_consensus.cc:2804] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.662352  1259 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.664686  1259 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.666502  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
W20260709 13:00:57.668159  1088 leader_election.cc:343] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.674171  1239 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.674866  1239 ts_tablet_manager.cc:1403] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.010s
I20260709 13:00:57.678967  1239 raft_consensus.cc:359] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.679961  1239 raft_consensus.cc:385] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.680510  1239 raft_consensus.cc:740] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.681026  1240 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.680179   946 catalog_manager.cc:5697] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.682868  1277 raft_consensus.cc:697] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:57.683750  1277 consensus_queue.cc:237] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.684399  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.685173  1199 raft_consensus.cc:2393] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84283e85da474e78bf130ce8083b9713 in current term 1: Already voted for candidate 20463fab1f94475082b491357801b691 in this term.
I20260709 13:00:57.685886  1240 ts_tablet_manager.cc:1403] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.002s
I20260709 13:00:57.686584  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.687737  1239 consensus_queue.cc:260] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.688052  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.688545  1240 raft_consensus.cc:359] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.688810  1198 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.689204  1240 raft_consensus.cc:385] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.689462  1240 raft_consensus.cc:740] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.689685  1199 raft_consensus.cc:2468] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.690102  1240 consensus_queue.cc:260] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.691852  1239 ts_tablet_manager.cc:1434] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:00:57.693221  1239 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.701224  1240 ts_tablet_manager.cc:1434] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:00:57.709247  1239 tablet_bootstrap.cc:654] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.716545  1277 raft_consensus.cc:493] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.716660   948 catalog_manager.cc:5697] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.717355  1277 raft_consensus.cc:515] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.720098  1240 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.720156  1277 leader_election.cc:290] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.721014  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.722651  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.723459  1125 raft_consensus.cc:2468] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.725276  1013 leader_election.cc:304] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.726452  1240 tablet_bootstrap.cc:654] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.726604  1277 raft_consensus.cc:2804] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.727103  1277 raft_consensus.cc:493] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.727790  1277 raft_consensus.cc:3060] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.729903  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.730880  1199 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.737638  1277 raft_consensus.cc:515] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.741516  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:57.742314  1125 raft_consensus.cc:3060] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.747296  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.749791  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.751960  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.752887  1013 leader_election.cc:304] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84283e85da474e78bf130ce8083b9713; no voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:57.751915  1125 raft_consensus.cc:2468] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:57.754895  1284 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.755554  1013 leader_election.cc:304] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.756704  1244 raft_consensus.cc:2804] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:57.757460  1244 raft_consensus.cc:697] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:57.758791  1244 consensus_queue.cc:237] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.762630  1239 tablet_bootstrap.cc:492] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.763314  1239 ts_tablet_manager.cc:1403] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.003s
I20260709 13:00:57.763618  1259 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.764340  1259 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.769444  1277 leader_election.cc:290] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.767202  1239 raft_consensus.cc:359] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.770558  1239 raft_consensus.cc:385] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.770996  1239 raft_consensus.cc:740] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.772292  1239 consensus_queue.cc:260] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.770690  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.773176  1259 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.776156  1239 ts_tablet_manager.cc:1434] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.005s
W20260709 13:00:57.776906  1088 leader_election.cc:343] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.777621  1239 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:57.783390  1254 raft_consensus.cc:493] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.784188  1254 raft_consensus.cc:515] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.787017  1239 tablet_bootstrap.cc:654] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.787451  1254 leader_election.cc:290] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.796365  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.797087  1050 raft_consensus.cc:2468] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 0.
I20260709 13:00:57.798514  1088 leader_election.cc:304] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:57.799572  1259 raft_consensus.cc:2804] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.800019  1259 raft_consensus.cc:493] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.800474  1259 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.813898  1013 leader_election.cc:304] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691
I20260709 13:00:57.815732  1277 raft_consensus.cc:2804] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.816279  1277 raft_consensus.cc:493] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.816744  1277 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:57.825049  1013 leader_election.cc:343] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.826638  1246 raft_consensus.cc:493] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.827350  1246 raft_consensus.cc:515] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.830482  1246 leader_election.cc:290] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
W20260709 13:00:57.833199  1013 leader_election.cc:343] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:57.842054  1013 leader_election.cc:343] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.843786  1246 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.844538  1246 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.847411  1246 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:57.849694  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
W20260709 13:00:57.852259  1088 leader_election.cc:343] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.852950  1088 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20463fab1f94475082b491357801b691; no voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:57.854699  1254 raft_consensus.cc:2749] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.857497  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.866466  1241 ts_tablet_manager.cc:1434] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.209s	user 0.066s	sys 0.136s
I20260709 13:00:57.867362  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.868263  1241 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.869871  1246 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.870594  1246 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.874089  1246 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:57.830273  1277 raft_consensus.cc:515] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.877578  1241 tablet_bootstrap.cc:654] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.878259  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:57.879212  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.880071  1124 raft_consensus.cc:2393] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
I20260709 13:00:57.879838  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.880633  1125 raft_consensus.cc:2393] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
W20260709 13:00:57.880342  1013 leader_election.cc:343] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20463fab1f94475082b491357801b691 (127.0.107.194:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.881700  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.882040  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.882364  1125 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 0.
I20260709 13:00:57.882934  1198 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 0.
I20260709 13:00:57.894229  1241 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:57.895193  1241 ts_tablet_manager.cc:1403] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:00:57.898718  1241 raft_consensus.cc:359] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.898077   948 catalog_manager.cc:5697] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.899804  1241 raft_consensus.cc:385] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.900345  1241 raft_consensus.cc:740] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.894179  1244 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.901552  1244 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.904500  1244 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.905303  1241 consensus_queue.cc:260] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.905649  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
W20260709 13:00:57.907929  1013 leader_election.cc:343] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20463fab1f94475082b491357801b691 (127.0.107.194:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.909781  1241 ts_tablet_manager.cc:1434] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:57.911087  1241 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: Bootstrap starting.
I20260709 13:00:57.918802  1241 tablet_bootstrap.cc:654] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.934778  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.937393  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc28fbc42408a9b56db1a14c43b30" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.938230  1198 raft_consensus.cc:3060] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.863723  1199 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:57.954231  1277 leader_election.cc:290] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.954566  1240 tablet_bootstrap.cc:492] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:57.955108  1240 ts_tablet_manager.cc:1403] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.235s	user 0.093s	sys 0.127s
I20260709 13:00:57.956441  1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:57.957346  1197 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:57.957342  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:57.958012  1240 raft_consensus.cc:359] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.958789  1240 raft_consensus.cc:385] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:57.959218  1240 raft_consensus.cc:740] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:57.960120  1240 consensus_queue.cc:260] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.958750  1199 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:57.956697  1162 leader_election.cc:343] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:57.964206  1284 raft_consensus.cc:2749] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:57.977510  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:57.978396  1125 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 0.
I20260709 13:00:57.977779  1259 raft_consensus.cc:515] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.976068  1239 tablet_bootstrap.cc:492] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:57.976881  1088 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 84283e85da474e78bf130ce8083b9713
I20260709 13:00:57.975683  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:57.980585  1050 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 0.
I20260709 13:00:57.980798  1259 leader_election.cc:290] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.965462  1240 ts_tablet_manager.cc:1434] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:57.981966  1254 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:57.982209  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:57.982506  1254 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.982834  1050 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.982991  1254 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:57.985348  1240 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: Bootstrap starting.
I20260709 13:00:57.990752  1050 raft_consensus.cc:2468] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 1.
I20260709 13:00:57.972301  1199 raft_consensus.cc:2468] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:57.993642  1240 tablet_bootstrap.cc:654] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:57.994246  1259 consensus_queue.cc:1048] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:57.994944  1254 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:57.998360  1254 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:57.996241  1239 ts_tablet_manager.cc:1403] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.219s	user 0.074s	sys 0.110s
I20260709 13:00:58.001120  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.002287  1239 raft_consensus.cc:359] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.003312  1239 raft_consensus.cc:385] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:58.003403  1088 leader_election.cc:343] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.003795  1239 raft_consensus.cc:740] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.005256  1239 consensus_queue.cc:260] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
W20260709 13:00:58.009332  1088 leader_election.cc:343] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.012087  1239 ts_tablet_manager.cc:1434] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:58.015054  1239 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:58.018735  1254 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.019541  1013 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691
I20260709 13:00:58.022310  1277 raft_consensus.cc:2804] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.022792  1277 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.022974  1244 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.023197  1277 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.023535  1244 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.025722  1244 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.025830  1240 tablet_bootstrap.cc:492] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: No bootstrap required, opened a new log
I20260709 13:00:58.026324  1240 ts_tablet_manager.cc:1403] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.021s
I20260709 13:00:58.026727  1239 tablet_bootstrap.cc:654] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.027520  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:58.029253  1125 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:58.029457  1162 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.028560  1198 raft_consensus.cc:2468] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:58.030599  1013 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.031363  1284 raft_consensus.cc:2804] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.031543  1240 raft_consensus.cc:359] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.035454  1162 leader_election.cc:304] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.034211  1246 raft_consensus.cc:2749] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.031952  1284 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.035912  1240 raft_consensus.cc:385] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.048501  1240 raft_consensus.cc:740] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.049234  1246 raft_consensus.cc:2749] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.049533  1240 consensus_queue.cc:260] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.050455  1162 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.051558  1240 ts_tablet_manager.cc:1434] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:00:58.054965  1277 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.042476  1296 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.043382  1088 leader_election.cc:304] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.048501  1284 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.045404  1239 tablet_bootstrap.cc:492] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:58.056841  1239 ts_tablet_manager.cc:1403] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.002s
I20260709 13:00:58.059495  1296 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.060721  1246 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.061095  1246 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.061425  1246 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.065258  1239 raft_consensus.cc:359] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.066040  1239 raft_consensus.cc:385] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.066367  1239 raft_consensus.cc:740] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.067219  1239 consensus_queue.cc:260] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.060230  1259 raft_consensus.cc:2804] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.072386  1259 raft_consensus.cc:697] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.073318  1259 consensus_queue.cc:237] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.073721  1246 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.073313  1296 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.075898  1246 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.077064  1162 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:58.085078  1241 tablet_bootstrap.cc:492] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: No bootstrap required, opened a new log
I20260709 13:00:58.087033  1246 raft_consensus.cc:2804] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.085733  1241 ts_tablet_manager.cc:1403] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: Time spent bootstrapping tablet: real 0.175s	user 0.075s	sys 0.083s
I20260709 13:00:58.087976  1246 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.088975  1246 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.091099  1241 raft_consensus.cc:359] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.092281   945 catalog_manager.cc:5697] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.093788  1241 raft_consensus.cc:385] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.094255  1241 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.095043  1241 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.093212  1239 ts_tablet_manager.cc:1434] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 13:00:58.096660  1239 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: Bootstrap starting.
I20260709 13:00:58.097530  1241 ts_tablet_manager.cc:1434] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:58.102710  1239 tablet_bootstrap.cc:654] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:58.115358  1239 tablet_bootstrap.cc:492] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: No bootstrap required, opened a new log
I20260709 13:00:58.115429  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.116120  1239 ts_tablet_manager.cc:1403] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:00:58.117174  1013 leader_election.cc:304] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691
I20260709 13:00:58.118448  1244 raft_consensus.cc:2804] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.118913  1244 raft_consensus.cc:697] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.119407  1239 raft_consensus.cc:359] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.120152  1239 raft_consensus.cc:385] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:58.119693  1244 consensus_queue.cc:237] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.121670  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.122447  1198 raft_consensus.cc:2393] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20463fab1f94475082b491357801b691 in current term 1: Already voted for candidate cbb6fc6cafaf44c098e5544d73e83a39 in this term.
I20260709 13:00:58.124464  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:58.125295  1125 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 0.
I20260709 13:00:58.126142  1239 raft_consensus.cc:740] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Initialized, Role: FOLLOWER
I20260709 13:00:58.125010  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:58.127949  1239 consensus_queue.cc:260] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.130010  1239 ts_tablet_manager.cc:1434] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:00:58.132933  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.133522  1125 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.136631  1284 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
W20260709 13:00:58.145531  1088 leader_election.cc:343] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:58.145541  1263 consensus_queue.cc:1048] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.146023  1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:58.147395  1048 raft_consensus.cc:2393] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
I20260709 13:00:58.147305  1284 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.148535  1199 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.148589  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.149341  1123 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.149246  1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.149899  1088 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20463fab1f94475082b491357801b691; no voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:58.150498  1195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.151741  1162 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:58.153832  1263 raft_consensus.cc:2749] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.137841  1277 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.137646   947 catalog_manager.cc:5697] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.139398  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.157749  1124 raft_consensus.cc:2393] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 20463fab1f94475082b491357801b691 in this term.
I20260709 13:00:58.158360  1284 consensus_queue.cc:1048] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.140798  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.161469  1049 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.163928  1244 consensus_queue.cc:1048] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.145047  1259 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.161269  1284 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.168663  1244 consensus_queue.cc:1048] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.169953  1297 raft_consensus.cc:493] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.170701  1297 raft_consensus.cc:515] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.174232  1123 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:58.176141  1013 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:58.177440  1244 raft_consensus.cc:2804] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.146673  1198 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 0.
I20260709 13:00:58.141520  1125 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 1.
I20260709 13:00:58.178063  1244 raft_consensus.cc:697] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.179864  1296 raft_consensus.cc:2804] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:58.179423  1244 consensus_queue.cc:237] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.181710  1297 leader_election.cc:290] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.182471  1296 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.184697  1296 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.191636  1013 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.193080  1277 raft_consensus.cc:2804] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.193588  1277 raft_consensus.cc:697] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.193748  1297 raft_consensus.cc:493] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.194363  1297 raft_consensus.cc:515] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.194511  1277 consensus_queue.cc:237] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.198331  1246 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.199765  1196 raft_consensus.cc:2393] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84283e85da474e78bf130ce8083b9713 in current term 1: Already voted for candidate cbb6fc6cafaf44c098e5544d73e83a39 in this term.
I20260709 13:00:58.201431  1297 leader_election.cc:290] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.206228  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:58.207046  1246 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.207150  1048 raft_consensus.cc:2393] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 20463fab1f94475082b491357801b691 in this term.
I20260709 13:00:58.217362  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:58.222072  1162 leader_election.cc:304] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.234468  1246 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.222754  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691" is_pre_election: true
I20260709 13:00:58.233340  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:58.244659  1246 raft_consensus.cc:2749] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.244508  1277 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.233376  1049 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 1.
I20260709 13:00:58.257615  1296 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.259714  1296 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.260244  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.261353   948 catalog_manager.cc:5697] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.263904  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.264743  1124 raft_consensus.cc:2393] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
I20260709 13:00:58.263705  1311 consensus_queue.cc:1048] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.265177  1162 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691
I20260709 13:00:58.267256  1162 leader_election.cc:304] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.268136  1297 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:58.269698  1162 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.270648  1246 raft_consensus.cc:2749] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.272524  1297 raft_consensus.cc:697] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:00:58.273452  1297 consensus_queue.cc:237] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.277205  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.285553  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.286856  1124 raft_consensus.cc:2393] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbb6fc6cafaf44c098e5544d73e83a39 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
I20260709 13:00:58.287979  1296 raft_consensus.cc:2749] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:58.296165  1162 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbb6fc6cafaf44c098e5544d73e83a39; no voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.297104  1296 raft_consensus.cc:2749] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.306735   947 catalog_manager.cc:5697] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.316756   948 catalog_manager.cc:5697] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.426961  1124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85"
dest_uuid: "20463fab1f94475082b491357801b691"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:53778
I20260709 13:00:58.427659  1124 raft_consensus.cc:606] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.442998  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:00:58.443502  1199 raft_consensus.cc:606] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.451596  1124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032"
dest_uuid: "20463fab1f94475082b491357801b691"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:53778
I20260709 13:00:58.452206  1124 raft_consensus.cc:606] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:00:58.459312  1263 raft_consensus.cc:493] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.459846  1263 raft_consensus.cc:515] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.461963  1263 leader_election.cc:290] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.463406  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84283e85da474e78bf130ce8083b9713" is_pre_election: true
I20260709 13:00:58.469727  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" is_pre_election: true
I20260709 13:00:58.470547  1199 raft_consensus.cc:2393] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20463fab1f94475082b491357801b691 in current term 1: Already voted for candidate 84283e85da474e78bf130ce8083b9713 in this term.
I20260709 13:00:58.471737  1088 leader_election.cc:304] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20463fab1f94475082b491357801b691; no voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:58.471953  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:54036
I20260709 13:00:58.472543  1049 raft_consensus.cc:606] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Received request to transfer leadership to TS 20463fab1f94475082b491357801b691
I20260709 13:00:58.472668  1263 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:58.479080  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788b07416a36431088832b3af8361f9d"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:54036
I20260709 13:00:58.479713  1049 raft_consensus.cc:606] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Received request to transfer leadership to TS 20463fab1f94475082b491357801b691
I20260709 13:00:58.480626  1263 raft_consensus.cc:2749] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:58.488104  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:54036
I20260709 13:00:58.488759  1049 raft_consensus.cc:606] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Received request to transfer leadership to TS 20463fab1f94475082b491357801b691
I20260709 13:00:58.494521  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:54036
I20260709 13:00:58.495136  1049 raft_consensus.cc:606] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Received request to transfer leadership to TS cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:58.528704  1263 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.535683  1259 raft_consensus.cc:993] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.536219  1259 raft_consensus.cc:1081] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.538671  1048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:00:58.539172  1048 raft_consensus.cc:493] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.539481  1048 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.544507  1263 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.548846  1048 raft_consensus.cc:515] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.549866  1254 raft_consensus.cc:993] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.550294  1254 raft_consensus.cc:1081] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.551316  1049 raft_consensus.cc:1240] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Rejecting Update request from peer 20463fab1f94475082b491357801b691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:58.551867  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.552325  1048 leader_election.cc:290] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.552579  1124 raft_consensus.cc:3055] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.552690  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.552964  1124 raft_consensus.cc:740] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.553829  1124 consensus_queue.cc:260] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.554798  1124 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.555465  1048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:00:58.556162  1048 raft_consensus.cc:493] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.559947  1048 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.563107  1124 raft_consensus.cc:2468] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:00:58.564278  1013 leader_election.cc:304] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:00:58.565141  1283 raft_consensus.cc:2804] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.565640  1283 raft_consensus.cc:697] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.566483  1283 consensus_queue.cc:237] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.567415  1048 raft_consensus.cc:515] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:58.569566  1048 leader_election.cc:290] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Requested vote from peers cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.571116  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.571113  1124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.571890  1199 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.571990  1124 raft_consensus.cc:3055] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.572395  1124 raft_consensus.cc:740] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.573141  1124 consensus_queue.cc:260] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:58.574368  1124 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.576686   947 catalog_manager.cc:5697] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 1 to 2, leader changed from 20463fab1f94475082b491357801b691 (127.0.107.194) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.578008  1199 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:00:58.579126  1013 leader_election.cc:304] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:58.579864  1283 raft_consensus.cc:2804] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.580420  1283 raft_consensus.cc:697] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.581552  1283 consensus_queue.cc:237] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:00:58.581799  1124 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:00:58.587230  1283 consensus_queue.cc:1048] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.592509  1283 consensus_queue.cc:1048] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.593663   947 catalog_manager.cc:5697] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 1 to 2, leader changed from 20463fab1f94475082b491357801b691 (127.0.107.194) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.606148  1311 raft_consensus.cc:993] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: : Instructing follower 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.608153  1284 raft_consensus.cc:1081] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Signalling peer 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.611342  1123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "788b07416a36431088832b3af8361f9d"
dest_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:53762
I20260709 13:00:58.612358  1123 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.612645  1283 consensus_queue.cc:1048] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:58.613152  1123 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.621961  1123 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.623145  1125 raft_consensus.cc:1240] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Rejecting Update request from peer 84283e85da474e78bf130ce8083b9713 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:58.624975  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.625624  1283 consensus_queue.cc:1059] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.625644  1048 raft_consensus.cc:3055] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.626284  1048 raft_consensus.cc:740] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.627170  1048 consensus_queue.cc:260] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.628170  1048 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.633155  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.633764  1199 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.635531  1123 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
W20260709 13:00:58.628152  1328 consensus_queue.cc:1175] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:58.641860  1199 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.642010  1048 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.643311  1088 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:58.643880  1328 raft_consensus.cc:993] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: : Instructing follower 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.644248  1263 raft_consensus.cc:2804] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.644457  1327 raft_consensus.cc:1081] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Signalling peer 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.644798  1263 raft_consensus.cc:697] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.645704  1263 consensus_queue.cc:237] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
W20260709 13:00:58.646312  1283 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:00:58.650796  1125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023"
dest_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:53762
I20260709 13:00:58.651401  1125 raft_consensus.cc:493] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.651407  1283 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.651955  1125 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.658809  1125 raft_consensus.cc:515] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.661202  1125 leader_election.cc:290] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.663946  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.664618  1048 raft_consensus.cc:3055] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.664831  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e8dd0ae8ed140a398cbd821ffda0023" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.665810  1199 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.668452  1048 raft_consensus.cc:740] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.669466  1048 consensus_queue.cc:260] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.670687  1048 raft_consensus.cc:3060] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.674965  1328 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.675824   947 catalog_manager.cc:5697] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 1 to 2, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.677983  1048 raft_consensus.cc:2468] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.679134  1088 leader_election.cc:304] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.674962  1199 raft_consensus.cc:2468] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.679999  1263 raft_consensus.cc:2804] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.680516  1263 raft_consensus.cc:697] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.681315  1263 consensus_queue.cc:237] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.690442   947 catalog_manager.cc:5697] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 1 to 2, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.797113  1283 raft_consensus.cc:993] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: : Instructing follower cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:00:58.797583  1328 raft_consensus.cc:1081] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Signalling peer cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:00:58.799273  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:00:58.799816  1199 raft_consensus.cc:493] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.800173  1199 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.805236  1199 raft_consensus.cc:515] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.807374  1199 leader_election.cc:290] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:00:58.808832  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.808893  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e433ef900c4f1d9ccab3f2890bb312" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.809772  1125 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.809918  1048 raft_consensus.cc:3055] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.810315  1048 raft_consensus.cc:740] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.811117  1048 consensus_queue.cc:260] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.812830  1048 raft_consensus.cc:3060] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.815475  1125 raft_consensus.cc:2468] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 2.
I20260709 13:00:58.816864  1162 leader_election.cc:304] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:00:58.817677  1297 raft_consensus.cc:2804] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.818742  1297 raft_consensus.cc:697] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:00:58.819603  1297 consensus_queue.cc:237] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.820240  1048 raft_consensus.cc:2468] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 2.
I20260709 13:00:58.826749   947 catalog_manager.cc:5697] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 1 to 2, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.838303  1328 raft_consensus.cc:993] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: : Instructing follower 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.838774  1327 raft_consensus.cc:1081] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Signalling peer 20463fab1f94475082b491357801b691 to start an election
I20260709 13:00:58.840324  1125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:53762
I20260709 13:00:58.840867  1125 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.841238  1125 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.846386  1125 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.848322  1297 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.849032  1125 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.849872  1332 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.850343  1048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:00:58.851007  1048 raft_consensus.cc:3055] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.851861  1048 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.851300  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.853446  1199 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.852813  1048 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.855664  1048 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.865439  1199 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.868643  1048 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 2.
I20260709 13:00:58.869899  1088 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.870827  1259 raft_consensus.cc:2804] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.871320  1259 raft_consensus.cc:697] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:00:58.869925  1297 raft_consensus.cc:993] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.872324  1259 consensus_queue.cc:237] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.873206  1332 raft_consensus.cc:1081] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:00:58.878201  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54020
I20260709 13:00:58.878988  1049 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:58.879587  1049 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.886338   948 catalog_manager.cc:5697] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 1 to 2, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.889731  1049 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.890863  1048 raft_consensus.cc:1240] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Rejecting Update request from peer cbb6fc6cafaf44c098e5544d73e83a39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:58.892733  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:00:58.893332  1125 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.895320  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:00:58.895937  1199 raft_consensus.cc:3055] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:58.896291  1199 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:00:58.896669  1297 consensus_queue.cc:1059] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:58.897022  1049 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:00:58.901067  1125 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:00:58.901288  1199 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.902552  1013 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:00:58.903484  1327 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:58.903264  1199 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.903983  1327 raft_consensus.cc:697] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:00:58.904944  1327 consensus_queue.cc:237] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:00:58.910795  1199 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:00:58.913343   945 catalog_manager.cc:5697] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 1 to 2, leader changed from cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.953665  1125 raft_consensus.cc:1275] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:58.954985  1327 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:58.963722  1199 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:58.973485  1199 raft_consensus.cc:1275] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:58.975282  1327 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.033581  1125 raft_consensus.cc:1275] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.035547  1327 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.043942  1199 raft_consensus.cc:1275] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.045470  1283 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.061169  1199 raft_consensus.cc:1275] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.062677  1259 consensus_queue.cc:1048] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:59.074116  1049 raft_consensus.cc:1275] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.075912  1259 consensus_queue.cc:1048] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.106168  1199 raft_consensus.cc:1275] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.107436  1259 consensus_queue.cc:1048] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.117552  1049 raft_consensus.cc:1275] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.119046  1259 consensus_queue.cc:1048] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.268321  1049 raft_consensus.cc:1275] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.269824  1332 consensus_queue.cc:1048] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.278986  1123 raft_consensus.cc:1275] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.280711  1297 consensus_queue.cc:1048] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.326148  1199 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.327493  1259 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.337024  1049 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.339035  1337 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.348380  1123 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.349829  1327 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.358203  1199 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:59.359632  1327 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:01.531558   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:01:01.532336   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.549479  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:01.550082  1049 raft_consensus.cc:606] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Received request to transfer leadership to TS cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:01:01.552456  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:01.552886  1049 raft_consensus.cc:606] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Received request to transfer leadership to TS cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:01:01.553951   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:01.554456   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:01.808519  1311 raft_consensus.cc:993] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: : Instructing follower cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:01.808926  1311 raft_consensus.cc:1081] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Signalling peer cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:01.810699  1194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:01:01.811197  1194 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.811493  1194 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.817771  1194 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:01.819985  1194 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:01:01.821067  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:01.821786  1049 raft_consensus.cc:3055] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.822000  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:01.822227  1049 raft_consensus.cc:740] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:01.822599  1123 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.823143  1049 consensus_queue.cc:260] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:01.824508  1049 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.919209  1049 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 2.
I20260709 13:01:01.919209  1123 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 2.
I20260709 13:01:01.921151  1162 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:01.922242  1297 raft_consensus.cc:2804] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:01.923717  1297 raft_consensus.cc:697] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:01.926046  1311 raft_consensus.cc:993] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: : Instructing follower cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:01.925236  1297 consensus_queue.cc:237] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:01.926564  1344 raft_consensus.cc:1081] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Signalling peer cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:01.928305  1194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:01:01.928870  1194 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.929275  1194 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.020426  1194 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.022732  1194 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:01:02.024003  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:02.024690  1049 raft_consensus.cc:3055] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.025055  1049 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.025209  1123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.025847  1123 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.025887  1049 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.027454  1049 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.029820   948 catalog_manager.cc:5697] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 1 to 2, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.120083  1049 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:02.120083  1123 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:02.121677  1162 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:02.122748  1297 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.123262  1297 raft_consensus.cc:697] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:02.124006  1297 consensus_queue.cc:237] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.131551   948 catalog_manager.cc:5697] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 2 to 3, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.403841  1049 raft_consensus.cc:1275] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:02.405385  1297 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:02.418849  1123 raft_consensus.cc:1275] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:02.420526  1354 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:02.507445  1123 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.508881  1354 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:02.517736  1049 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.519688  1359 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:02.555289   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:02.568087  1194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:01:02.568583  1194 raft_consensus.cc:606] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:01:02.579026  1194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:01:02.579532  1194 raft_consensus.cc:606] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:01:02.584055  1123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "20463fab1f94475082b491357801b691"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:53778
I20260709 13:01:02.584519  1123 raft_consensus.cc:606] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:01:02.589798  1125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788b07416a36431088832b3af8361f9d"
dest_uuid: "20463fab1f94475082b491357801b691"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:53778
I20260709 13:01:02.590312  1125 raft_consensus.cc:606] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:01:02.595130  1125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273"
dest_uuid: "20463fab1f94475082b491357801b691"
mode: GRACEFUL
new_leader_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:53778
I20260709 13:01:02.595631  1125 raft_consensus.cc:606] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Received request to transfer leadership to TS 84283e85da474e78bf130ce8083b9713
I20260709 13:01:02.618404  1337 raft_consensus.cc:993] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.618894  1361 raft_consensus.cc:1081] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.620369  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "788b07416a36431088832b3af8361f9d"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:01:02.621042  1049 raft_consensus.cc:493] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.621376  1049 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.626680  1049 raft_consensus.cc:515] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.628410  1049 leader_election.cc:290] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:02.629333  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.629570  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b07416a36431088832b3af8361f9d" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:02.629942  1125 raft_consensus.cc:3055] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.630076  1194 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.630307  1125 raft_consensus.cc:740] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:01:02.631129  1125 consensus_queue.cc:260] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.632360  1125 raft_consensus.cc:3060] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.637627  1194 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.639019  1013 leader_election.cc:304] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:02.639820  1125 raft_consensus.cc:2468] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.639873  1344 raft_consensus.cc:2804] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.641004  1344 raft_consensus.cc:697] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.641793  1344 consensus_queue.cc:237] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.647068  1337 raft_consensus.cc:993] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.647563  1361 raft_consensus.cc:1081] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.649133  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:01:02.649622  1049 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.650055  1049 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.649590   948 catalog_manager.cc:5697] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 2 to 3, leader changed from 20463fab1f94475082b491357801b691 (127.0.107.194) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.654966  1049 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.656623  1049 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:02.657509  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.658020  1125 raft_consensus.cc:3055] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.658283  1125 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:01:02.658527  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:02.659029  1194 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.659085  1125 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.660535  1125 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.666103  1194 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.667776  1125 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.667716  1013 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:02.668705  1344 raft_consensus.cc:2804] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.669173  1344 raft_consensus.cc:697] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.669902  1344 consensus_queue.cc:237] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.676172   948 catalog_manager.cc:5697] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 2 to 3, leader changed from 20463fab1f94475082b491357801b691 (127.0.107.194) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.851743  1297 raft_consensus.cc:993] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.852447  1359 raft_consensus.cc:1081] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.853999  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54020
I20260709 13:01:02.854496  1049 raft_consensus.cc:493] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.854830  1049 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.859331  1049 raft_consensus.cc:515] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.860769  1049 leader_election.cc:290] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:02.861641  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.862020  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32cb56429ca46318e6f0930d4c15bae" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:02.862259  1125 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.862557  1194 raft_consensus.cc:3055] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.862886  1194 raft_consensus.cc:740] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:02.863656  1194 consensus_queue.cc:260] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.864892  1194 raft_consensus.cc:3060] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.869323  1125 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.871065  1013 leader_election.cc:304] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:01:02.871798  1344 raft_consensus.cc:2804] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.872188  1194 raft_consensus.cc:2468] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 3.
I20260709 13:01:02.872340  1344 raft_consensus.cc:697] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.873145  1344 consensus_queue.cc:237] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.878746   948 catalog_manager.cc:5697] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 2 to 3, leader changed from cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.914279  1359 raft_consensus.cc:993] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.914815  1354 raft_consensus.cc:1081] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.916497  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54020
I20260709 13:01:02.917136  1049 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.917481  1049 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.921926  1049 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.923303  1049 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 4 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:02.924285  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.924803  1125 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.924865  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:02.925431  1194 raft_consensus.cc:3055] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:02.925776  1194 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:02.926542  1194 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.927996  1194 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.932238  1125 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 4.
I20260709 13:01:02.933372  1013 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, 84283e85da474e78bf130ce8083b9713; no voters: 
I20260709 13:01:02.934182  1344 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:02.934739  1344 raft_consensus.cc:697] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.935051  1194 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 4.
I20260709 13:01:02.935647  1344 consensus_queue.cc:237] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.942054   948 catalog_manager.cc:5697] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 3 to 4, leader changed from cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.955255  1337 raft_consensus.cc:993] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: : Instructing follower 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.955734  1361 raft_consensus.cc:1081] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Signalling peer 84283e85da474e78bf130ce8083b9713 to start an election
I20260709 13:01:02.957216  1049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:01:02.957720  1049 raft_consensus.cc:493] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:02.958009  1049 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.962491  1049 raft_consensus.cc:515] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.963856  1049 leader_election.cc:290] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:02.964761  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:02.965003  1194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1c247033fa439e8d17bf1b2b18b273" candidate_uuid: "84283e85da474e78bf130ce8083b9713" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:02.965273  1125 raft_consensus.cc:3055] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.965564  1194 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.965576  1125 raft_consensus.cc:740] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:01:02.966408  1125 consensus_queue.cc:260] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.967223  1125 raft_consensus.cc:3060] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.970992  1194 raft_consensus.cc:2468] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:01:02.972208  1125 raft_consensus.cc:2468] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84283e85da474e78bf130ce8083b9713 in term 2.
I20260709 13:01:02.972790  1013 leader_election.cc:304] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84283e85da474e78bf130ce8083b9713, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:02.973577  1344 raft_consensus.cc:2804] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:02.973989  1344 raft_consensus.cc:697] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Leader. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:02.974622  1344 consensus_queue.cc:237] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:02.988381   948 catalog_manager.cc:5697] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 reported cstate change: term changed from 1 to 2, leader changed from 20463fab1f94475082b491357801b691 (127.0.107.194) to 84283e85da474e78bf130ce8083b9713 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "84283e85da474e78bf130ce8083b9713" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.060711  1194 raft_consensus.cc:1275] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.061997  1344 consensus_queue.cc:1048] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.074331  1125 raft_consensus.cc:1275] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.075609  1344 consensus_queue.cc:1048] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.127435  1194 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.129235  1344 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.138130  1125 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.139701  1362 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.323832  1125 raft_consensus.cc:1275] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.325310  1362 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.336486  1194 raft_consensus.cc:1275] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:03.337812  1344 consensus_queue.cc:1048] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.452638  1125 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:03.453908  1344 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.463289  1194 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:03.464905  1377 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.570709  1194 raft_consensus.cc:1275] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.572111  1377 consensus_queue.cc:1048] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:03.584905  1125 raft_consensus.cc:1275] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Refusing update from remote peer 84283e85da474e78bf130ce8083b9713: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.586233  1344 consensus_queue.cc:1048] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.603775   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:05.612982  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:05.613982  1049 raft_consensus.cc:606] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Received request to transfer leadership to TS cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:01:05.616786  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:05.617175  1049 raft_consensus.cc:606] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Received request to transfer leadership to TS cbb6fc6cafaf44c098e5544d73e83a39
I20260709 13:01:05.619498  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:05.619894  1049 raft_consensus.cc:606] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 LEADER]: Received request to transfer leadership to TS 20463fab1f94475082b491357801b691
I20260709 13:01:05.622136  1049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "84283e85da474e78bf130ce8083b9713"
mode: GRACEFUL
new_leader_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:46842
I20260709 13:01:05.622524  1049 raft_consensus.cc:606] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Received request to transfer leadership to TS 20463fab1f94475082b491357801b691
I20260709 13:01:05.623433   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:05.623926   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:05.649441  1382 raft_consensus.cc:993] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: : Instructing follower cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:05.650118  1344 raft_consensus.cc:1081] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Signalling peer cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:05.651794  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:01:05.652398  1199 raft_consensus.cc:493] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:05.652709  1199 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.658300  1199 raft_consensus.cc:515] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.659996  1199 leader_election.cc:290] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), 20463fab1f94475082b491357801b691 (127.0.107.194:45623)
I20260709 13:01:05.661038  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:05.661348  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3c494ada4a40ba978cc2f2d71f1032" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:05.661940  1049 raft_consensus.cc:3055] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:05.662364  1125 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.662536  1049 raft_consensus.cc:740] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:05.663581  1049 consensus_queue.cc:260] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.664834  1049 raft_consensus.cc:3060] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.667953  1125 raft_consensus.cc:2468] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:05.669193  1162 leader_election.cc:304] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:05.670002  1381 raft_consensus.cc:2804] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:05.669927  1049 raft_consensus.cc:2468] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:05.671139  1381 raft_consensus.cc:697] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:05.672082  1381 consensus_queue.cc:237] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.679515   947 catalog_manager.cc:5697] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 2 to 3, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.831005  1382 raft_consensus.cc:993] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: : Instructing follower 20463fab1f94475082b491357801b691 to start an election
I20260709 13:01:05.831537  1344 raft_consensus.cc:1081] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Signalling peer 20463fab1f94475082b491357801b691 to start an election
I20260709 13:01:05.833216  1125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f"
dest_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:53762
I20260709 13:01:05.833743  1125 raft_consensus.cc:493] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:05.834107  1125 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.838395  1125 raft_consensus.cc:515] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.840003  1125 leader_election.cc:290] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 4 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:05.841145  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:05.841342  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5092d10bf84b2c9b68bbc34648ca5f" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:05.841747  1049 raft_consensus.cc:3055] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:05.841835  1199 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.842042  1049 raft_consensus.cc:740] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:05.842787  1049 consensus_queue.cc:260] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.843669  1049 raft_consensus.cc:3060] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.846503  1199 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 4.
I20260709 13:01:05.847862  1088 leader_election.cc:304] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:05.848634  1049 raft_consensus.cc:2468] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 4.
I20260709 13:01:05.849285  1361 raft_consensus.cc:2804] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.850703  1361 raft_consensus.cc:697] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 4 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:01:05.851483  1361 consensus_queue.cc:237] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:05.859462   947 catalog_manager.cc:5697] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 3 to 4, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.948529  1382 raft_consensus.cc:993] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: : Instructing follower cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:05.949025  1344 raft_consensus.cc:1081] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Signalling peer cbb6fc6cafaf44c098e5544d73e83a39 to start an election
I20260709 13:01:05.950619  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85"
dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
 from {username='slave'} at 127.0.0.1:52102
I20260709 13:01:05.951110  1199 raft_consensus.cc:493] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:05.951375  1199 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.956174  1199 raft_consensus.cc:515] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:01:05.957903  1199 leader_election.cc:290] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Requested vote from peers 20463fab1f94475082b491357801b691 (127.0.107.194:45623), 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643)
I20260709 13:01:05.958652  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20463fab1f94475082b491357801b691"
I20260709 13:01:05.958925  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6990c8abb14bc290cae2cc62375c85" candidate_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:05.959261  1125 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.959450  1049 raft_consensus.cc:3055] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:05.959797  1049 raft_consensus.cc:740] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:05.960470  1049 consensus_queue.cc:260] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:01:05.961366  1049 raft_consensus.cc:3060] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.963827  1125 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:05.964819  1162 leader_election.cc:304] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:05.965593  1381 raft_consensus.cc:2804] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:05.965993  1381 raft_consensus.cc:697] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Becoming Leader. State: Replica: cbb6fc6cafaf44c098e5544d73e83a39, State: Running, Role: LEADER
I20260709 13:01:05.966255  1049 raft_consensus.cc:2468] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbb6fc6cafaf44c098e5544d73e83a39 in term 3.
I20260709 13:01:05.966854  1381 consensus_queue.cc:237] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } }
I20260709 13:01:05.974912   947 catalog_manager.cc:5697] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 reported cstate change: term changed from 2 to 3, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.129555  1049 raft_consensus.cc:1275] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:06.130960  1381 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:06.141193  1125 raft_consensus.cc:1275] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:06.142539  1381 consensus_queue.cc:1048] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:06.202812  1382 raft_consensus.cc:993] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: : Instructing follower 20463fab1f94475082b491357801b691 to start an election
I20260709 13:01:06.203274  1382 raft_consensus.cc:1081] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 LEADER]: Signalling peer 20463fab1f94475082b491357801b691 to start an election
I20260709 13:01:06.204957  1125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03ac70afc884e41a9091615db665904"
dest_uuid: "20463fab1f94475082b491357801b691"
 from {username='slave'} at 127.0.0.1:53762
I20260709 13:01:06.205439  1125 raft_consensus.cc:493] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:06.205739  1125 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.209841  1125 raft_consensus.cc:515] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:06.211174  1125 leader_election.cc:290] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 5 election: Requested vote from peers 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643), cbb6fc6cafaf44c098e5544d73e83a39 (127.0.107.195:38641)
I20260709 13:01:06.212199  1049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "84283e85da474e78bf130ce8083b9713"
I20260709 13:01:06.212376  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ac70afc884e41a9091615db665904" candidate_uuid: "20463fab1f94475082b491357801b691" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cbb6fc6cafaf44c098e5544d73e83a39"
I20260709 13:01:06.212695  1049 raft_consensus.cc:3055] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:06.212836  1199 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.213022  1049 raft_consensus.cc:740] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 84283e85da474e78bf130ce8083b9713, State: Running, Role: LEADER
I20260709 13:01:06.213773  1049 consensus_queue.cc:260] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:06.214769  1049 raft_consensus.cc:3060] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.217526  1199 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 5.
I20260709 13:01:06.218541  1088 leader_election.cc:304] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20463fab1f94475082b491357801b691, cbb6fc6cafaf44c098e5544d73e83a39; no voters: 
I20260709 13:01:06.219355  1361 raft_consensus.cc:2804] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:06.219770  1361 raft_consensus.cc:697] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 5 LEADER]: Becoming Leader. State: Replica: 20463fab1f94475082b491357801b691, State: Running, Role: LEADER
I20260709 13:01:06.220129  1049 raft_consensus.cc:2468] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20463fab1f94475082b491357801b691 in term 5.
I20260709 13:01:06.220588  1361 consensus_queue.cc:237] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } }
I20260709 13:01:06.227802   945 catalog_manager.cc:5697] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 reported cstate change: term changed from 4 to 5, leader changed from 84283e85da474e78bf130ce8083b9713 (127.0.107.193) to 20463fab1f94475082b491357801b691 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "20463fab1f94475082b491357801b691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:06.428509  1199 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:06.430027  1361 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:06.430548  1049 raft_consensus.cc:1275] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:06.431800  1361 consensus_queue.cc:1048] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:06.483628  1125 raft_consensus.cc:1275] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:06.484963  1381 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20463fab1f94475082b491357801b691" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:06.495956  1049 raft_consensus.cc:1275] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Refusing update from remote peer cbb6fc6cafaf44c098e5544d73e83a39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:06.497376  1381 consensus_queue.cc:1048] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84283e85da474e78bf130ce8083b9713" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:06.624895   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:06.631361   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:06.657591  1088 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:01:06.663914   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:06.665094   431 tablet_replica.cc:333] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
W20260709 13:01:06.666138  1088 consensus_peers.cc:597] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 -> Peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Couldn't send request to peer 84283e85da474e78bf130ce8083b9713. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.666276   431 raft_consensus.cc:2243] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.666816  1199 raft_consensus.cc:1275] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 5 FOLLOWER]: Refusing update from remote peer 20463fab1f94475082b491357801b691: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:06.667315   431 raft_consensus.cc:2272] T f32cb56429ca46318e6f0930d4c15bae P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.668449  1400 consensus_queue.cc:1048] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbb6fc6cafaf44c098e5544d73e83a39" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:06.669849   431 tablet_replica.cc:333] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.670635   431 raft_consensus.cc:2243] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.671108   431 raft_consensus.cc:2272] T 2d3c494ada4a40ba978cc2f2d71f1032 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.675668   431 tablet_replica.cc:333] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.676398   431 raft_consensus.cc:2243] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.677505   431 raft_consensus.cc:2272] T 788b07416a36431088832b3af8361f9d P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.680991   431 tablet_replica.cc:333] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.681797   431 raft_consensus.cc:2243] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.682447   431 raft_consensus.cc:2272] T f6e433ef900c4f1d9ccab3f2890bb312 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.685128   431 tablet_replica.cc:333] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.685923   431 raft_consensus.cc:2243] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.686455   431 raft_consensus.cc:2272] T fd5092d10bf84b2c9b68bbc34648ca5f P 84283e85da474e78bf130ce8083b9713 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.691468   431 tablet_replica.cc:333] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.692279   431 raft_consensus.cc:2243] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.692756   431 raft_consensus.cc:2272] T b03ac70afc884e41a9091615db665904 P 84283e85da474e78bf130ce8083b9713 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:06.692991  1162 consensus_peers.cc:597] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 -> Peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Couldn't send request to peer 84283e85da474e78bf130ce8083b9713. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.694630   431 tablet_replica.cc:333] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.695147   431 raft_consensus.cc:2243] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.695971   431 raft_consensus.cc:2272] T 927bc28fbc42408a9b56db1a14c43b30 P 84283e85da474e78bf130ce8083b9713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.697783   431 tablet_replica.cc:333] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.698307   431 raft_consensus.cc:2243] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.698745   431 raft_consensus.cc:2272] T 5e8dd0ae8ed140a398cbd821ffda0023 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.700592   431 tablet_replica.cc:333] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.701272   431 raft_consensus.cc:2243] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.701713   431 raft_consensus.cc:2272] T 4e6990c8abb14bc290cae2cc62375c85 P 84283e85da474e78bf130ce8083b9713 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.703790   431 tablet_replica.cc:333] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713: stopping tablet replica
I20260709 13:01:06.704377   431 raft_consensus.cc:2243] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.705276   431 raft_consensus.cc:2272] T 0d1c247033fa439e8d17bf1b2b18b273 P 84283e85da474e78bf130ce8083b9713 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.738847   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:06.761722   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:01:06.788504   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:06.789608   431 tablet_replica.cc:333] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.790511   431 raft_consensus.cc:2243] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.791345   431 raft_consensus.cc:2272] T 788b07416a36431088832b3af8361f9d P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.793541   431 tablet_replica.cc:333] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.794296   431 raft_consensus.cc:2243] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.794809   431 raft_consensus.cc:2272] T 2d3c494ada4a40ba978cc2f2d71f1032 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.796993   431 tablet_replica.cc:333] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.797552   431 raft_consensus.cc:2243] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.798003   431 raft_consensus.cc:2272] T f32cb56429ca46318e6f0930d4c15bae P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.799726   431 tablet_replica.cc:333] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.800312   431 raft_consensus.cc:2243] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.800750   431 raft_consensus.cc:2272] T 4e6990c8abb14bc290cae2cc62375c85 P 20463fab1f94475082b491357801b691 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.802891   431 tablet_replica.cc:333] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.803408   431 raft_consensus.cc:2243] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.804235   431 raft_consensus.cc:2272] T 5e8dd0ae8ed140a398cbd821ffda0023 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.805910   431 tablet_replica.cc:333] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.806417   431 raft_consensus.cc:2243] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.807245   431 raft_consensus.cc:2272] T b03ac70afc884e41a9091615db665904 P 20463fab1f94475082b491357801b691 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.809192   431 tablet_replica.cc:333] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.809746   431 raft_consensus.cc:2243] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.810292   431 raft_consensus.cc:2272] T 927bc28fbc42408a9b56db1a14c43b30 P 20463fab1f94475082b491357801b691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.812158   431 tablet_replica.cc:333] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.812647   431 raft_consensus.cc:2243] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.813354   431 raft_consensus.cc:2272] T fd5092d10bf84b2c9b68bbc34648ca5f P 20463fab1f94475082b491357801b691 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.815413   431 tablet_replica.cc:333] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.815991   431 raft_consensus.cc:2243] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.816502   431 raft_consensus.cc:2272] T f6e433ef900c4f1d9ccab3f2890bb312 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.818281   431 tablet_replica.cc:333] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691: stopping tablet replica
I20260709 13:01:06.818754   431 raft_consensus.cc:2243] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.819157   431 raft_consensus.cc:2272] T 0d1c247033fa439e8d17bf1b2b18b273 P 20463fab1f94475082b491357801b691 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.848242   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:06.867074   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:06.894006  1162 consensus_peers.cc:597] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 -> Peer 84283e85da474e78bf130ce8083b9713 (127.0.107.193:44643): Couldn't send request to peer 84283e85da474e78bf130ce8083b9713. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.894711   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:06.895366   431 tablet_replica.cc:333] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.895908   431 raft_consensus.cc:2243] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.896613   431 raft_consensus.cc:2272] T 2d3c494ada4a40ba978cc2f2d71f1032 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.898711   431 tablet_replica.cc:333] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.899220   431 raft_consensus.cc:2243] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.899618   431 raft_consensus.cc:2272] T f32cb56429ca46318e6f0930d4c15bae P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.901240   431 tablet_replica.cc:333] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.901677   431 raft_consensus.cc:2243] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.902382   431 raft_consensus.cc:2272] T f6e433ef900c4f1d9ccab3f2890bb312 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.903955   431 tablet_replica.cc:333] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.904505   431 raft_consensus.cc:2243] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.904906   431 raft_consensus.cc:2272] T fd5092d10bf84b2c9b68bbc34648ca5f P cbb6fc6cafaf44c098e5544d73e83a39 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.906824   431 tablet_replica.cc:333] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.907423   431 raft_consensus.cc:2243] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.907821   431 raft_consensus.cc:2272] T 788b07416a36431088832b3af8361f9d P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.909521   431 tablet_replica.cc:333] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.910125   431 raft_consensus.cc:2243] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.910779   431 raft_consensus.cc:2272] T 4e6990c8abb14bc290cae2cc62375c85 P cbb6fc6cafaf44c098e5544d73e83a39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.912777   431 tablet_replica.cc:333] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.913223   431 raft_consensus.cc:2243] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.913727   431 raft_consensus.cc:2272] T 927bc28fbc42408a9b56db1a14c43b30 P cbb6fc6cafaf44c098e5544d73e83a39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.915307   431 tablet_replica.cc:333] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.915725   431 raft_consensus.cc:2243] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.916167   431 raft_consensus.cc:2272] T 5e8dd0ae8ed140a398cbd821ffda0023 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.917659   431 tablet_replica.cc:333] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.918051   431 raft_consensus.cc:2243] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.918502   431 raft_consensus.cc:2272] T b03ac70afc884e41a9091615db665904 P cbb6fc6cafaf44c098e5544d73e83a39 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.920612   431 tablet_replica.cc:333] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39: stopping tablet replica
I20260709 13:01:06.921085   431 raft_consensus.cc:2243] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.921420   431 raft_consensus.cc:2272] T 0d1c247033fa439e8d17bf1b2b18b273 P cbb6fc6cafaf44c098e5544d73e83a39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.941368   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:06.960543   431 master.cc:562] Master@127.0.107.254:46319 shutting down...
I20260709 13:01:06.982316   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:06.982856   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.983242   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 74adfcd738064c709c2b6255d79fb9c2: stopping tablet replica
I20260709 13:01:07.004279   431 master.cc:584] Master@127.0.107.254:46319 shutdown complete.
20463fab1f94475082b491357801b691  4
84283e85da474e78bf130ce8083b9713  5
cbb6fc6cafaf44c098e5544d73e83a39  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10669 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:01:07.059116   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37403
I20260709 13:01:07.060566   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:07.067231  1409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:07.067361  1408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:07.067703  1411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.069228   431 server_base.cc:1061] running on GCE node
I20260709 13:01:07.070681   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:07.070874   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:07.070981   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602067070969 us; error 0 us; skew 500 ppm
I20260709 13:01:07.071471   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:07.074815   431 webserver.cc:533] Webserver started at http://127.0.107.254:32819/ using document root <none> and password file <none>
I20260709 13:01:07.075312   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:07.075470   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:07.075692   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:07.077134   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "0d9f4d25497a4ade8ff13a53360853c8"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.082231   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:07.085973  1416 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.086944   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:07.087342   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "0d9f4d25497a4ade8ff13a53360853c8"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.087646   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:07.102214   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:07.103513   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:07.144610   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37403
I20260709 13:01:07.144711  1467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37403 every 8 connection(s)
I20260709 13:01:07.149318  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.161065  1468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Bootstrap starting.
I20260709 13:01:07.165815  1468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.170857  1468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: No bootstrap required, opened a new log
I20260709 13:01:07.173492  1468 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER }
I20260709 13:01:07.173905  1468 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.174199  1468 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9f4d25497a4ade8ff13a53360853c8, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.174878  1468 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER }
I20260709 13:01:07.175570  1468 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:07.175961  1468 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:07.176322  1468 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:07.181080  1468 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER }
I20260709 13:01:07.181824  1468 leader_election.cc:304] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d9f4d25497a4ade8ff13a53360853c8; no voters: 
I20260709 13:01:07.183182  1468 leader_election.cc:290] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:07.183585  1471 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:07.185127  1471 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 1 LEADER]: Becoming Leader. State: Replica: 0d9f4d25497a4ade8ff13a53360853c8, State: Running, Role: LEADER
I20260709 13:01:07.185863  1471 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER }
I20260709 13:01:07.186153  1468 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:07.190821  1473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d9f4d25497a4ade8ff13a53360853c8. Latest consensus state: current_term: 1 leader_uuid: "0d9f4d25497a4ade8ff13a53360853c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER } }
I20260709 13:01:07.191287  1472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d9f4d25497a4ade8ff13a53360853c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9f4d25497a4ade8ff13a53360853c8" member_type: VOTER } }
I20260709 13:01:07.192075  1473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:07.192317  1472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:07.199663  1478 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:07.207803  1478 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:07.208828   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:07.218183  1478 catalog_manager.cc:1383] Generated new cluster ID: f824db13b43d45b3bb9acc6afa2eda70
I20260709 13:01:07.218529  1478 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:07.243922  1478 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:07.245437  1478 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:07.258600  1478 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Generated new TSK 0
I20260709 13:01:07.259265  1478 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:07.275513   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:07.281787  1489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:07.283080  1490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.285189   431 server_base.cc:1061] running on GCE node
W20260709 13:01:07.285123  1492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.286295   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:07.286480   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:07.286731   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602067286716 us; error 0 us; skew 500 ppm
I20260709 13:01:07.287330   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:07.290017   431 webserver.cc:533] Webserver started at http://127.0.107.193:37065/ using document root <none> and password file <none>
I20260709 13:01:07.290489   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:07.290653   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:07.290966   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:07.292085   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "36f53e9bfce749bbba4a4b34829f563d"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.296819   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:01:07.300357  1497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.301258   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:01:07.301594   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "36f53e9bfce749bbba4a4b34829f563d"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.301883   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:07.315460   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:07.316825   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:07.318380   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:07.320933   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:07.321146   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.321458   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:07.321637   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.364869   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34325
I20260709 13:01:07.364974  1559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34325 every 8 connection(s)
I20260709 13:01:07.369549   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:07.377676  1564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:07.378813  1565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.380386   431 server_base.cc:1061] running on GCE node
W20260709 13:01:07.382041  1567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.383015   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:07.383163  1560 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37403
W20260709 13:01:07.383280   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:07.383582   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602067383568 us; error 0 us; skew 500 ppm
I20260709 13:01:07.383658  1560 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:07.384295   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:07.384600  1560 heartbeater.cc:507] Master 127.0.107.254:37403 requested a full tablet report, sending...
I20260709 13:01:07.386947   431 webserver.cc:533] Webserver started at http://127.0.107.194:40137/ using document root <none> and password file <none>
I20260709 13:01:07.387241  1433 ts_manager.cc:194] Registered new tserver with Master: 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:01:07.387461   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:07.387771   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:07.388096   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:07.389196  1433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38910
I20260709 13:01:07.389438   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "f9fb126997be4ec79f8f60fcd6764b00"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.394626   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:07.398090  1572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.398986   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:07.399314   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "f9fb126997be4ec79f8f60fcd6764b00"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.399590   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:07.423123   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:07.424398   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:07.425869   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:07.428236   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:07.428429   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.428715   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:07.428872   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.470460   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33801
I20260709 13:01:07.470571  1634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33801 every 8 connection(s)
I20260709 13:01:07.475421   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:07.482847  1638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:07.485332  1639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.487633   431 server_base.cc:1061] running on GCE node
W20260709 13:01:07.487891  1641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:07.489187  1635 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37403
I20260709 13:01:07.489547  1635 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:07.489482   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:07.489923   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:07.490226   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602067490200 us; error 0 us; skew 500 ppm
I20260709 13:01:07.490386  1635 heartbeater.cc:507] Master 127.0.107.254:37403 requested a full tablet report, sending...
I20260709 13:01:07.490933   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:07.492904  1433 ts_manager.cc:194] Registered new tserver with Master: f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:07.494132   431 webserver.cc:533] Webserver started at http://127.0.107.195:38027/ using document root <none> and password file <none>
I20260709 13:01:07.494774   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:07.494746  1433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38912
I20260709 13:01:07.495164   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:07.495487   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:07.496801   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "8c6031790cc44edfba5c3964e6f27c6e"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.501039   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:01:07.504554  1646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.505311   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:01:07.505610   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "8c6031790cc44edfba5c3964e6f27c6e"
format_stamp: "Formatted at 2026-07-09 13:01:07 on dist-test-slave-rrf3"
I20260709 13:01:07.505936   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:07.524822   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:07.525997   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:07.527536   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:07.529839   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:07.530025   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.530334   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:07.530476   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:07.571329   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43535
I20260709 13:01:07.571434  1708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43535 every 8 connection(s)
I20260709 13:01:07.585388  1709 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37403
I20260709 13:01:07.585754  1709 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:07.586500  1709 heartbeater.cc:507] Master 127.0.107.254:37403 requested a full tablet report, sending...
I20260709 13:01:07.588478  1433 ts_manager.cc:194] Registered new tserver with Master: 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:07.589385   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015069143s
I20260709 13:01:07.590008  1433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38920
I20260709 13:01:07.616446  1433 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:07.622759  1433 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:07.834874  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5eb582ff4540bb9b59540cc56f458a (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:07.836640  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5eb582ff4540bb9b59540cc56f458a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.836387  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 840e0e8b928b40ecab5e23c8ee0b22b3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:07.838127  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840e0e8b928b40ecab5e23c8ee0b22b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.841460  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f88e50794193abace66439f1975b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:07.842001  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 840e0e8b928b40ecab5e23c8ee0b22b3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:07.843003  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f88e50794193abace66439f1975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.842645  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f88e50794193abace66439f1975b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:07.843406  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840e0e8b928b40ecab5e23c8ee0b22b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.844157  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f88e50794193abace66439f1975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.848325  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5eb582ff4540bb9b59540cc56f458a (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:07.849804  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5eb582ff4540bb9b59540cc56f458a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.867767  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 78a6859b4243476e8c4c421be70a6e19 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:07.868716  1724 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:07.869700  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a6859b4243476e8c4c421be70a6e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.872828  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5eb582ff4540bb9b59540cc56f458a (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:07.874177  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5eb582ff4540bb9b59540cc56f458a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.877406  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 840e0e8b928b40ecab5e23c8ee0b22b3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:07.878523  1724 tablet_bootstrap.cc:654] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.878839  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840e0e8b928b40ecab5e23c8ee0b22b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.879108  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 9463f88e50794193abace66439f1975b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:07.880468  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f88e50794193abace66439f1975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.886799  1725 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:07.891259  1724 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:07.891763  1724 ts_tablet_manager.cc:1403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:01:07.894933  1724 raft_consensus.cc:359] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.899219  1724 raft_consensus.cc:385] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.899586  1724 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.898721  1725 tablet_bootstrap.cc:654] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.900444  1727 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:07.903451  1724 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.904532  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 78a6859b4243476e8c4c421be70a6e19 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:07.906149  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a6859b4243476e8c4c421be70a6e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.909839  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 78a6859b4243476e8c4c421be70a6e19 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:07.911228  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a6859b4243476e8c4c421be70a6e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.919989  1523 tablet_service.cc:1511] Processing CreateTablet for tablet fb93316b761941d4be4cb8d1af0db97e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:07.921777  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb93316b761941d4be4cb8d1af0db97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.926553  1727 tablet_bootstrap.cc:654] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.929702  1724 ts_tablet_manager.cc:1434] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.005s
I20260709 13:01:07.930696  1560 heartbeater.cc:499] Master 127.0.107.254:37403 was elected leader, sending a full tablet report...
I20260709 13:01:07.934835  1725 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:07.935590  1725 ts_tablet_manager.cc:1403] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.012s
I20260709 13:01:07.936681  1724 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:07.938983  1725 raft_consensus.cc:359] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.939879  1725 raft_consensus.cc:385] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.943856  1671 tablet_service.cc:1511] Processing CreateTablet for tablet fb93316b761941d4be4cb8d1af0db97e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:07.945355  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb93316b761941d4be4cb8d1af0db97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.944998  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 11658e0328124c609f964e633d7649bf (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:07.946399  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11658e0328124c609f964e633d7649bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.946771  1724 tablet_bootstrap.cc:654] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:07.941045  1598 tablet_service.cc:1511] Processing CreateTablet for tablet fb93316b761941d4be4cb8d1af0db97e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:07.948913  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb93316b761941d4be4cb8d1af0db97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.958570  1727 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:07.959475  1727 ts_tablet_manager.cc:1403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.005s
I20260709 13:01:07.961124  1724 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:07.962073  1724 ts_tablet_manager.cc:1403] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:01:07.962523  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 11658e0328124c609f964e633d7649bf (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:07.963702  1727 raft_consensus.cc:359] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.964965  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11658e0328124c609f964e633d7649bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.965966  1724 raft_consensus.cc:359] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.968765  1724 raft_consensus.cc:385] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.969081  1724 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.969879  1724 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.944164  1725 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.972304  1725 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.968300  1727 raft_consensus.cc:385] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:07.966313  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 11658e0328124c609f964e633d7649bf (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:07.973590  1727 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:07.976312  1727 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.978703  1525 tablet_service.cc:1511] Processing CreateTablet for tablet c4443c0ffc3140788a1384ff8bc1b047 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:07.974323  1724 ts_tablet_manager.cc:1434] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:01:07.980909  1724 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:07.979857  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11658e0328124c609f964e633d7649bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.980823  1599 tablet_service.cc:1511] Processing CreateTablet for tablet c4443c0ffc3140788a1384ff8bc1b047 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:07.987576  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4443c0ffc3140788a1384ff8bc1b047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.989266  1673 tablet_service.cc:1511] Processing CreateTablet for tablet c4443c0ffc3140788a1384ff8bc1b047 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:07.991205  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4443c0ffc3140788a1384ff8bc1b047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:07.996491  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 69addfec4f4248bbabd86bd0f93ae32d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:07.997411  1729 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.998140  1729 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:07.999169  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4443c0ffc3140788a1384ff8bc1b047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.003855  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69addfec4f4248bbabd86bd0f93ae32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.017498  1729 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.025475  1709 heartbeater.cc:499] Master 127.0.107.254:37403 was elected leader, sending a full tablet report...
I20260709 13:01:08.029505  1727 ts_tablet_manager.cc:1434] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.003s
I20260709 13:01:08.030530  1727 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:08.036458  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 69addfec4f4248bbabd86bd0f93ae32d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:08.037142  1727 tablet_bootstrap.cc:654] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.038076  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69addfec4f4248bbabd86bd0f93ae32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.040468  1732 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.041013  1732 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.049403  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea2020c26814418b630a447fc961d07 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:08.050843  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea2020c26814418b630a447fc961d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.051891  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea2020c26814418b630a447fc961d07 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:08.053308  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea2020c26814418b630a447fc961d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.057539  1725 ts_tablet_manager.cc:1434] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 13:01:08.057772  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 69addfec4f4248bbabd86bd0f93ae32d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:08.058339  1635 heartbeater.cc:499] Master 127.0.107.254:37403 was elected leader, sending a full tablet report...
I20260709 13:01:08.059276  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69addfec4f4248bbabd86bd0f93ae32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.061885  1725 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:08.069972  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea2020c26814418b630a447fc961d07 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:08.071381  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea2020c26814418b630a447fc961d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.073206  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:08.074198  1535 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:08.074936  1724 tablet_bootstrap.cc:654] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.076355  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:08.088606  1736 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.089179  1736 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.098151  1736 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.126411  1523 tablet_service.cc:1511] Processing CreateTablet for tablet e14d61cd3a034962afeaefb62f6d9986 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:08.132128  1524 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9105bf6ce4e118b6b4a3135515534 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:08.132936  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14d61cd3a034962afeaefb62f6d9986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.135555  1674 tablet_service.cc:1511] Processing CreateTablet for tablet e14d61cd3a034962afeaefb62f6d9986 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:08.136994  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14d61cd3a034962afeaefb62f6d9986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.137728  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9105bf6ce4e118b6b4a3135515534. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:08.146381  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70270.9us
I20260709 13:01:08.152817  1725 tablet_bootstrap.cc:654] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.158752  1729 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.159510  1729 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.163089  1729 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.170115  1732 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:08.171017  1732 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:08.171444  1732 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.171808  1732 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.191174  1727 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:08.193678  1727 ts_tablet_manager.cc:1403] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.046s
I20260709 13:01:08.202339  1724 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:08.202894  1727 raft_consensus.cc:359] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.202896  1724 ts_tablet_manager.cc:1403] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.222s	user 0.017s	sys 0.008s
W20260709 13:01:08.206254  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:08.203667  1727 raft_consensus.cc:385] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.208182  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:08.209568  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:08.222757  1597 tablet_service.cc:1511] Processing CreateTablet for tablet e14d61cd3a034962afeaefb62f6d9986 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:08.224521  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:08.226537  1647 leader_election.cc:343] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.229871  1724 raft_consensus.cc:359] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.231037  1724 raft_consensus.cc:385] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.231413  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:08.231607  1724 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.232170  1608 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:08.226065  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:08.233050  1724 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.210754  1727 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.234398  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:08.234932  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14d61cd3a034962afeaefb62f6d9986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.237819  1727 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.238865  1683 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:08.239069  1724 ts_tablet_manager.cc:1434] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 13:01:08.240293  1724 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:08.240784  1521 tablet_service.cc:1511] Processing CreateTablet for tablet c56ae97ed5df4be18120cf680fd57f57 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:08.242122  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ae97ed5df4be18120cf680fd57f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.244397  1725 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:08.244912  1725 ts_tablet_manager.cc:1403] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.044s
I20260709 13:01:08.246945  1670 tablet_service.cc:1511] Processing CreateTablet for tablet c56ae97ed5df4be18120cf680fd57f57 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:08.247241  1599 tablet_service.cc:1511] Processing CreateTablet for tablet c56ae97ed5df4be18120cf680fd57f57 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:08.248539  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ae97ed5df4be18120cf680fd57f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.248126  1725 raft_consensus.cc:359] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:08.249020  1498 leader_election.cc:343] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.249089  1725 raft_consensus.cc:385] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.250912  1729 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:08.251286  1729 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.251609  1729 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.240784  1598 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9105bf6ce4e118b6b4a3135515534 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:08.256289  1673 tablet_service.cc:1511] Processing CreateTablet for tablet fbbc977cdccf4f338a0e97226117c985 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:08.256322  1600 tablet_service.cc:1511] Processing CreateTablet for tablet fbbc977cdccf4f338a0e97226117c985 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:08.257521  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9105bf6ce4e118b6b4a3135515534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.257730  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbc977cdccf4f338a0e97226117c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.258757  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbc977cdccf4f338a0e97226117c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.262256  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ae97ed5df4be18120cf680fd57f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.261965  1524 tablet_service.cc:1511] Processing CreateTablet for tablet fbbc977cdccf4f338a0e97226117c985 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:08.263240  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbc977cdccf4f338a0e97226117c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.267140  1523 tablet_service.cc:1511] Processing CreateTablet for tablet f2343c932afb4d9aaa361b1e57330e8e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:08.269213  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2343c932afb4d9aaa361b1e57330e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.269068  1596 tablet_service.cc:1511] Processing CreateTablet for tablet f2343c932afb4d9aaa361b1e57330e8e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:08.270455  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2343c932afb4d9aaa361b1e57330e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.250669  1725 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.276737  1725 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.285143  1725 ts_tablet_manager.cc:1434] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:01:08.286252  1725 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:08.281940  1724 tablet_bootstrap.cc:654] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.294418  1674 tablet_service.cc:1511] Processing CreateTablet for tablet cbe9105bf6ce4e118b6b4a3135515534 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:08.294821  1671 tablet_service.cc:1511] Processing CreateTablet for tablet f2343c932afb4d9aaa361b1e57330e8e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:08.295531  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c985edaa245138167af8ae5b22067 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:08.296000  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9105bf6ce4e118b6b4a3135515534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.298931  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c985edaa245138167af8ae5b22067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.309357  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2343c932afb4d9aaa361b1e57330e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.310612  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c985edaa245138167af8ae5b22067 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:08.315717  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:08.318076  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:08.318830  1683 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:08.320425  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:08.321365  1736 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:08.321691  1736 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.321913  1736 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.322592  1725 tablet_bootstrap.cc:654] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.325008  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c985edaa245138167af8ae5b22067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.329654  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 73161049b574469ea08e360e2def1aac (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:08.331045  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73161049b574469ea08e360e2def1aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.329843  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 73161049b574469ea08e360e2def1aac (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:08.346825  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73161049b574469ea08e360e2def1aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.347702  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31cf514617428594649c1ecf3b2547 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:08.348574  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 73161049b574469ea08e360e2def1aac (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:08.349560  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31cf514617428594649c1ecf3b2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.350078  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73161049b574469ea08e360e2def1aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.350497  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31cf514617428594649c1ecf3b2547 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:08.351768  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31cf514617428594649c1ecf3b2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.344331  1729 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.354180  1729 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.355446  1535 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:08.355214  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:08.355214  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:08.356925  1683 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.364329  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31cf514617428594649c1ecf3b2547 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:08.365733  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31cf514617428594649c1ecf3b2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.371022  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 532c559048cc4785a9da4b7d8725f768 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:08.370957  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 532c559048cc4785a9da4b7d8725f768 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:08.372490  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532c559048cc4785a9da4b7d8725f768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.372646  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532c559048cc4785a9da4b7d8725f768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.383667  1724 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:08.384246  1724 ts_tablet_manager.cc:1403] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.005s
I20260709 13:01:08.386718  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 532c559048cc4785a9da4b7d8725f768 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:08.388698  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532c559048cc4785a9da4b7d8725f768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.388517  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2065ad5cf4ab19e1aabd16c64fe95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:08.389899  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2065ad5cf4ab19e1aabd16c64fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.391003  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2065ad5cf4ab19e1aabd16c64fe95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:08.397651  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2065ad5cf4ab19e1aabd16c64fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.394045  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 57c2065ad5cf4ab19e1aabd16c64fe95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:08.398788  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c2065ad5cf4ab19e1aabd16c64fe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.395450  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 3db0d135af1343458208be9b79d66635 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:08.396271  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 3db0d135af1343458208be9b79d66635 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:08.387663  1724 raft_consensus.cc:359] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.403195  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db0d135af1343458208be9b79d66635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.404536  1727 ts_tablet_manager.cc:1434] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.205s	user 0.005s	sys 0.004s
I20260709 13:01:08.405663  1727 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:08.407058  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 3db0d135af1343458208be9b79d66635 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:08.402241  1724 raft_consensus.cc:385] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.412498  1724 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.413000  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 5396b1c71261414f9ca554acc690f489 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:08.414994  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 5396b1c71261414f9ca554acc690f489 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:08.415648  1725 tablet_bootstrap.cc:492] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:08.416756  1725 ts_tablet_manager.cc:1403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.000s
I20260709 13:01:08.417186  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5396b1c71261414f9ca554acc690f489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.420077  1725 raft_consensus.cc:359] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.420872  1725 raft_consensus.cc:385] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.421211  1725 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.413441  1724 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.398819  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c985edaa245138167af8ae5b22067 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:08.427421  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db0d135af1343458208be9b79d66635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.429994  1727 tablet_bootstrap.cc:654] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.435900  1725 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.439484  1736 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.458118  1609 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:08.458693  1736 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.440522  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c985edaa245138167af8ae5b22067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.442540  1732 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.460258  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5396b1c71261414f9ca554acc690f489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.460424  1725 ts_tablet_manager.cc:1434] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:01:08.462030  1725 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:08.462307  1732 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:08.463195  1684 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:08.448755  1724 ts_tablet_manager.cc:1434] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:01:08.466948  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:08.467585  1535 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.469383  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:08.470587  1724 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:08.470679  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:08.471324  1609 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.482143  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db0d135af1343458208be9b79d66635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.482713  1596 tablet_service.cc:1511] Processing CreateTablet for tablet fac0c25895864a4e8a2926c7c5198ee7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:08.484023  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac0c25895864a4e8a2926c7c5198ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.502837  1725 tablet_bootstrap.cc:654] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.507718  1521 tablet_service.cc:1511] Processing CreateTablet for tablet fac0c25895864a4e8a2926c7c5198ee7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:08.510462  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac0c25895864a4e8a2926c7c5198ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.469213  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:08.485589  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:08.512720  1534 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:08.515825  1724 tablet_bootstrap.cc:654] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.516467  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:08.517545  1736 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:08.528154  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 5396b1c71261414f9ca554acc690f489 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:08.530925  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5396b1c71261414f9ca554acc690f489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.539739  1683 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:08.541072  1535 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:08.548929  1729 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:08.549825  1748 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.556207  1672 tablet_service.cc:1511] Processing CreateTablet for tablet fac0c25895864a4e8a2926c7c5198ee7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:08.557717  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac0c25895864a4e8a2926c7c5198ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.558095  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 552871638635413bbd17d508b2a95e03 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:08.559334  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552871638635413bbd17d508b2a95e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.556456  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:08.560686  1732 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:08.561182  1732 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:08.561998  1732 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.557734  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 0246a4c90f2b48c5a3a10ad330723a67 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:08.565542  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0246a4c90f2b48c5a3a10ad330723a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.564394  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:08.570663  1729 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:08.570583  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 0246a4c90f2b48c5a3a10ad330723a67 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:08.572022  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0246a4c90f2b48c5a3a10ad330723a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.570623  1609 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:08.577371  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 552871638635413bbd17d508b2a95e03 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:08.577983  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 552871638635413bbd17d508b2a95e03 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:08.578761  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552871638635413bbd17d508b2a95e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.579229  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552871638635413bbd17d508b2a95e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.563724  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 0246a4c90f2b48c5a3a10ad330723a67 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:08.586117  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0246a4c90f2b48c5a3a10ad330723a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.597638  1748 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.600296  1748 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.601432  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:08.605048  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:08.605051  1498 leader_election.cc:343] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.611918  1729 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:08.613242  1501 leader_election.cc:343] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.612914  1729 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.613700  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:08.614418  1748 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:08.622560  1727 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:08.623291  1727 ts_tablet_manager.cc:1403] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.018s
I20260709 13:01:08.626224  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 1665355552db4e4e97ba80c516768367 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:08.627648  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1665355552db4e4e97ba80c516768367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.645329  1596 tablet_service.cc:1511] Processing CreateTablet for tablet 1665355552db4e4e97ba80c516768367 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:08.646813  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1665355552db4e4e97ba80c516768367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.650377  1724 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:08.650910  1724 ts_tablet_manager.cc:1403] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.181s	user 0.008s	sys 0.022s
I20260709 13:01:08.652921  1727 raft_consensus.cc:359] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.675380  1727 raft_consensus.cc:385] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.675899  1727 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.653818  1724 raft_consensus.cc:359] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.663305  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 1665355552db4e4e97ba80c516768367 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:08.676867  1724 raft_consensus.cc:385] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.677333  1724 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.677755  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1665355552db4e4e97ba80c516768367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.678150  1724 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.665367  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:08.680765  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443ffcfd9be74d9891a8cb9596947ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.715731  1432 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:08.717408  1420 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49457.4us
W20260709 13:01:08.720464  1418 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49837.4us
I20260709 13:01:08.721558  1724 ts_tablet_manager.cc:1434] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.006s
I20260709 13:01:08.722671  1724 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:08.725389  1725 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:08.725847  1725 ts_tablet_manager.cc:1403] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.264s	user 0.010s	sys 0.025s
I20260709 13:01:08.733069  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:08.734546  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443ffcfd9be74d9891a8cb9596947ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.735482  1431 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.727876  1725 raft_consensus.cc:359] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.738682  1725 raft_consensus.cc:385] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.740142  1725 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.739781  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:08.741323  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443ffcfd9be74d9891a8cb9596947ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.741616  1727 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.744314  1727 ts_tablet_manager.cc:1434] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.005s
I20260709 13:01:08.745323  1727 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:08.746218  1729 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.746713  1729 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.750949  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:08.751607  1609 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:08.752856  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:08.753856  1752 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:08.754242  1752 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.754575  1752 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.752959  1725 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.764797  1729 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.764853  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:08.766340  1501 leader_election.cc:343] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.768546  1727 tablet_bootstrap.cc:654] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.770093  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 5adb51b03e1142c4b3d2fe81051fecb9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:08.771400  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adb51b03e1142c4b3d2fe81051fecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.772095  1725 ts_tablet_manager.cc:1434] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:01:08.773543  1725 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:08.774622  1724 tablet_bootstrap.cc:654] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.778615  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 5adb51b03e1142c4b3d2fe81051fecb9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:08.780268  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 5adb51b03e1142c4b3d2fe81051fecb9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:08.795006  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5174ec6bd2452abb5d7617555ce4f7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:08.796295  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adb51b03e1142c4b3d2fe81051fecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.796388  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5174ec6bd2452abb5d7617555ce4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.796388  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5174ec6bd2452abb5d7617555ce4f7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:08.797868  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5174ec6bd2452abb5d7617555ce4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.800658  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adb51b03e1142c4b3d2fe81051fecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.801224  1725 tablet_bootstrap.cc:654] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:08.781127  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 5d54062a82c94b8c93a956fc9082a450 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:08.803308  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d54062a82c94b8c93a956fc9082a450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.804833  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5174ec6bd2452abb5d7617555ce4f7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:08.806191  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5174ec6bd2452abb5d7617555ce4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.805896  1519 tablet_service.cc:1511] Processing CreateTablet for tablet f66f028938a14af4a39a0e553938682b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:08.808014  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66f028938a14af4a39a0e553938682b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.782363  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 5d54062a82c94b8c93a956fc9082a450 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:08.783607  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 5d54062a82c94b8c93a956fc9082a450 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:08.817350  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d54062a82c94b8c93a956fc9082a450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.784780  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 148d93cd579345f7bda3407d430fed95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:08.821041  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148d93cd579345f7bda3407d430fed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.786357  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 148d93cd579345f7bda3407d430fed95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:08.787309  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 148d93cd579345f7bda3407d430fed95 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:08.788321  1732 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.830005  1732 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.832219  1732 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:08.831967  1667 tablet_service.cc:1511] Processing CreateTablet for tablet f66f028938a14af4a39a0e553938682b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:08.833348  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66f028938a14af4a39a0e553938682b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.834329  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:08.834980  1535 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:08.836737  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 11e72d8320164ed18fc7fccba3a0ecd3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:08.838841  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148d93cd579345f7bda3407d430fed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.840667  1752 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.842721  1752 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.847968  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:08.849704  1501 leader_election.cc:343] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:08.850729  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:08.851768  1732 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:08.852182  1732 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.852531  1732 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.852658  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148d93cd579345f7bda3407d430fed95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.852375  1599 tablet_service.cc:1511] Processing CreateTablet for tablet f66f028938a14af4a39a0e553938682b (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:08.854010  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66f028938a14af4a39a0e553938682b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.870923  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 11e72d8320164ed18fc7fccba3a0ecd3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:08.872380  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e72d8320164ed18fc7fccba3a0ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.875312  1727 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:08.875833  1727 ts_tablet_manager.cc:1403] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.131s	user 0.007s	sys 0.004s
I20260709 13:01:08.878211  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 11e72d8320164ed18fc7fccba3a0ecd3 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:08.878619  1727 raft_consensus.cc:359] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.879186  1727 raft_consensus.cc:385] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.879460  1727 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.879642  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e72d8320164ed18fc7fccba3a0ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.880151  1727 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.867214  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e72d8320164ed18fc7fccba3a0ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.890295  1724 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:08.890846  1724 ts_tablet_manager.cc:1403] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.168s	user 0.010s	sys 0.012s
I20260709 13:01:08.899421  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:08.900090  1608 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.899820  1521 tablet_service.cc:1511] Processing CreateTablet for tablet ace772102403442daf5f360432c323e9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:08.901199  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace772102403442daf5f360432c323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.901453  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:08.902073  1609 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:08.905486  1725 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:08.906039  1725 ts_tablet_manager.cc:1403] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.016s
I20260709 13:01:08.909713  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d54062a82c94b8c93a956fc9082a450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.913829  1596 tablet_service.cc:1511] Processing CreateTablet for tablet ace772102403442daf5f360432c323e9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:08.915364  1665 tablet_service.cc:1511] Processing CreateTablet for tablet ace772102403442daf5f360432c323e9 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:08.916047  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace772102403442daf5f360432c323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.916703  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace772102403442daf5f360432c323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.916909  1727 ts_tablet_manager.cc:1434] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:01:08.918581  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 1d120199a9d3441ab490816cfe76664f (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:08.930692  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d120199a9d3441ab490816cfe76664f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.931543  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 1d120199a9d3441ab490816cfe76664f (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:08.931650  1725 raft_consensus.cc:359] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.932507  1725 raft_consensus.cc:385] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.932955  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d120199a9d3441ab490816cfe76664f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.932858  1725 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.936550  1608 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:08.936275  1732 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.940148  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:08.940784  1535 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.942461  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:08.940729  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:08.943773  1609 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.943854  1752 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:08.944581  1752 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:08.945688  1752 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.940864  1732 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:08.970497  1474 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:08.971643  1724 raft_consensus.cc:359] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.972427  1724 raft_consensus.cc:385] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:08.972735  1724 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:08.973431  1724 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.980372  1593 tablet_service.cc:1511] Processing CreateTablet for tablet bc704e97e2774b19b6d4867b31f50723 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:08.981976  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc704e97e2774b19b6d4867b31f50723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.988186  1732 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:08.990105  1523 tablet_service.cc:1511] Processing CreateTablet for tablet bc704e97e2774b19b6d4867b31f50723 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:08.991559  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc704e97e2774b19b6d4867b31f50723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.993202  1729 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.993746  1729 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:08.996021  1729 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:08.997532  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:08.999873  1501 leader_election.cc:343] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:09.000161  1727 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:09.001698  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:09.005957  1725 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.006825  1727 tablet_bootstrap.cc:654] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.007148  1610 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:09.012007  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:09.013000  1729 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:09.013352  1729 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.013695  1729 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:08.975703  1724 ts_tablet_manager.cc:1434] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 13:01:09.026863  1669 tablet_service.cc:1511] Processing CreateTablet for tablet bc704e97e2774b19b6d4867b31f50723 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:09.021162  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 1d120199a9d3441ab490816cfe76664f (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:09.028950  1748 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.029456  1748 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.031517  1724 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:09.043462  1609 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:09.044833  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:09.045965  1732 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:09.046492  1732 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:09.047410  1732 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.047899  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:09.049741  1498 leader_election.cc:343] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:09.050437  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:09.050967  1737 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.056022  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.051473  1737 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.057258  1725 ts_tablet_manager.cc:1434] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.151s	user 0.015s	sys 0.000s
I20260709 13:01:09.058270  1725 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:09.059460  1737 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:09.063953  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:09.062871  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:09.067529  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:09.032753  1748 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:09.072556  1501 leader_election.cc:343] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:09.073212  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:09.087715  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:09.046061  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:09.089710  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.077821  1748 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:09.096650  1609 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:09.097750  1724 tablet_bootstrap.cc:654] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.098014  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:09.100319  1748 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.101802  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d120199a9d3441ab490816cfe76664f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.103320  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1845d3b47c5e4111a5c3c8f4e5de74ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.103241  1737 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.116714  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 8501e8317ed348cca428d77d106f937c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:09.118589  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8501e8317ed348cca428d77d106f937c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.075314  1535 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:09.133244  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 8501e8317ed348cca428d77d106f937c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:09.134609  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8501e8317ed348cca428d77d106f937c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.144316  1729 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.146644  1729 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:09.160928  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:09.161849  1608 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.163463  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 8501e8317ed348cca428d77d106f937c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:09.165702  1525 tablet_service.cc:1511] Processing CreateTablet for tablet d501527377474732bddb08ed904bd34d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:09.169371  1727 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:09.170022  1727 ts_tablet_manager.cc:1403] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.252s	user 0.028s	sys 0.055s
I20260709 13:01:09.173774  1727 raft_consensus.cc:359] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.175668  1727 raft_consensus.cc:385] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.176101  1727 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.177037  1727 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.180318  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc704e97e2774b19b6d4867b31f50723. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:09.191807  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 119298us
I20260709 13:01:09.194165  1727 ts_tablet_manager.cc:1434] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:01:09.196347  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d501527377474732bddb08ed904bd34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.196890  1600 tablet_service.cc:1511] Processing CreateTablet for tablet d501527377474732bddb08ed904bd34d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:09.217325  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d501527377474732bddb08ed904bd34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.194624  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8501e8317ed348cca428d77d106f937c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:09.209297  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:09.194170  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:09.225865  1727 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
W20260709 13:01:09.228708  1766 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:01:09.198994  1432 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.242553  1672 tablet_service.cc:1511] Processing CreateTablet for tablet d501527377474732bddb08ed904bd34d (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:01:09.243857  1501 leader_election.cc:343] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:09.243880  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d501527377474732bddb08ed904bd34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.251125  1608 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:09.251981  1737 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:09.281368  1725 tablet_bootstrap.cc:654] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.281613  1727 tablet_bootstrap.cc:654] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.277858  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:09.291263  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee4cb45f7c44278850093451991c78 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:09.292860  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee4cb45f7c44278850093451991c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.292367  1431 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.252950  1737 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:01:09.305613  1765 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:09.306200  1765 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:09.305817  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee4cb45f7c44278850093451991c78 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:09.307034  1765 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.307987  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee4cb45f7c44278850093451991c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.315971  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 1af5bea2a3c6428b9b6c07c96e3160ef (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:09.317314  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee4cb45f7c44278850093451991c78 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:09.321957  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6b1fc817984924ac96a7a2a29d76de (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:09.323236  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 1af5bea2a3c6428b9b6c07c96e3160ef (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:09.327045  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 1af5bea2a3c6428b9b6c07c96e3160ef (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:01:09.301288  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 114706us
I20260709 13:01:09.330318  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6b1fc817984924ac96a7a2a29d76de (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:09.331442  1729 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:09.333492  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6b1fc817984924ac96a7a2a29d76de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.338918  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee4cb45f7c44278850093451991c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.339917  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af5bea2a3c6428b9b6c07c96e3160ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.353838  1724 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:09.354460  1724 ts_tablet_manager.cc:1403] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.323s	user 0.021s	sys 0.012s
I20260709 13:01:09.362615  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af5bea2a3c6428b9b6c07c96e3160ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.365656  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af5bea2a3c6428b9b6c07c96e3160ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.368314  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6b1fc817984924ac96a7a2a29d76de (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:09.367727  1752 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:09.398612  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6b1fc817984924ac96a7a2a29d76de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.411032  1725 tablet_bootstrap.cc:492] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:09.411605  1725 ts_tablet_manager.cc:1403] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.354s	user 0.018s	sys 0.048s
I20260709 13:01:09.430528  1600 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbda5372a24182a9982a0d35ff91b7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:09.434957  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 891c34d92ded4b85948a508cf94b612c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:09.436578  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891c34d92ded4b85948a508cf94b612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.438458  1727 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:09.439064  1727 ts_tablet_manager.cc:1403] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.213s	user 0.024s	sys 0.016s
I20260709 13:01:09.438549  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 891c34d92ded4b85948a508cf94b612c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:09.442320  1727 raft_consensus.cc:359] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.447947  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6b1fc817984924ac96a7a2a29d76de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.449606  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbda5372a24182a9982a0d35ff91b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.454180  1665 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbda5372a24182a9982a0d35ff91b7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:09.454442  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba1b10b23d84716ad2e0452649e214e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:09.458460  1729 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.455899  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba1b10b23d84716ad2e0452649e214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.462556  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba1b10b23d84716ad2e0452649e214e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:09.449481  1520 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbda5372a24182a9982a0d35ff91b7 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:09.464628  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbda5372a24182a9982a0d35ff91b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.398656  1724 raft_consensus.cc:359] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.468303  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891c34d92ded4b85948a508cf94b612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.469183  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba1b10b23d84716ad2e0452649e214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.452273  1727 raft_consensus.cc:385] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.471839  1727 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.473726  1725 raft_consensus.cc:359] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.474568  1725 raft_consensus.cc:385] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.474872  1725 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.468444  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbda5372a24182a9982a0d35ff91b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.482956  1768 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.481638  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 891c34d92ded4b85948a508cf94b612c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:09.483580  1768 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.485924  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba1b10b23d84716ad2e0452649e214e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:09.494802  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:09.478729  1724 raft_consensus.cc:385] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.491755  1768 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:09.496146  1724 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.504910  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:09.505287  1523 tablet_service.cc:1511] Processing CreateTablet for tablet eca33b3bd986485893d6724a68cb2430 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:09.505635  1534 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:09.506546  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca33b3bd986485893d6724a68cb2430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.503908  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba1b10b23d84716ad2e0452649e214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.508733  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:09.509634  1768 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:09.509976  1768 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.510356  1768 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.475689  1725 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.512841  1608 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:09.514132  1432 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.515525  1725 ts_tablet_manager.cc:1434] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 13:01:09.516759  1725 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:09.519505  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891c34d92ded4b85948a508cf94b612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.524104  1522 tablet_service.cc:1511] Processing CreateTablet for tablet f2f5a84af4984d759b3126fa5852fb2e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:09.525564  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f5a84af4984d759b3126fa5852fb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.528755  1724 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.529893  1524 tablet_service.cc:1511] Processing CreateTablet for tablet e7f600ce14224412994ac233d95d67d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:09.531373  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f600ce14224412994ac233d95d67d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.531805  1724 ts_tablet_manager.cc:1434] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.177s	user 0.002s	sys 0.010s
I20260709 13:01:09.532858  1724 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:09.537905  1669 tablet_service.cc:1511] Processing CreateTablet for tablet f2f5a84af4984d759b3126fa5852fb2e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:09.539510  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f5a84af4984d759b3126fa5852fb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.520221  1600 tablet_service.cc:1511] Processing CreateTablet for tablet eca33b3bd986485893d6724a68cb2430 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:09.543538  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca33b3bd986485893d6724a68cb2430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.472813  1727 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.550945  1727 ts_tablet_manager.cc:1434] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.112s	user 0.010s	sys 0.000s
I20260709 13:01:09.551973  1727 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:09.561018  1594 tablet_service.cc:1511] Processing CreateTablet for tablet f2f5a84af4984d759b3126fa5852fb2e (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:09.562402  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f5a84af4984d759b3126fa5852fb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.565306  1767 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:09.565791  1768 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.568598  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:09.569160  1534 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.570564  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:09.571202  1610 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.584555  1534 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:09.586062  1672 tablet_service.cc:1511] Processing CreateTablet for tablet eca33b3bd986485893d6724a68cb2430 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:09.589010  1671 tablet_service.cc:1511] Processing CreateTablet for tablet e7f600ce14224412994ac233d95d67d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:09.601495  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f600ce14224412994ac233d95d67d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.601426  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:09.602479  1767 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:09.603066  1767 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:09.589989  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 3db5c09b405c47f6a1aaa189b76a0002 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:09.604008  1767 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.604658  1610 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:09.604975  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5c09b405c47f6a1aaa189b76a0002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.592677  1595 tablet_service.cc:1511] Processing CreateTablet for tablet e7f600ce14224412994ac233d95d67d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:09.594123  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 3db5c09b405c47f6a1aaa189b76a0002 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:09.607681  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eca33b3bd986485893d6724a68cb2430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.598683  1727 tablet_bootstrap.cc:654] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.607674  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f600ce14224412994ac233d95d67d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.620357  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5c09b405c47f6a1aaa189b76a0002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.627170  1724 tablet_bootstrap.cc:654] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.567883  1768 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:09.632581  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 3db5c09b405c47f6a1aaa189b76a0002 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:09.635030  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5c09b405c47f6a1aaa189b76a0002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.638902  1769 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:09.640453  1725 tablet_bootstrap.cc:654] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.682355  1725 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:09.682830  1725 ts_tablet_manager.cc:1403] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.002s
I20260709 13:01:09.719316  1673 tablet_service.cc:1511] Processing CreateTablet for tablet abc3085f661f457e8c8d15478c227311 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:09.720667  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc3085f661f457e8c8d15478c227311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.723353  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 4e287a2761794958b3002cd2258cf2f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:09.724702  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e287a2761794958b3002cd2258cf2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.737406  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 4e287a2761794958b3002cd2258cf2f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:09.732836  1433 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.740716  1727 tablet_bootstrap.cc:492] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:09.740322  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 32221e86161141d39327e18efdbbb226 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:09.741351  1727 ts_tablet_manager.cc:1403] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.012s
I20260709 13:01:09.741839  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32221e86161141d39327e18efdbbb226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.744942  1727 raft_consensus.cc:359] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.745792  1727 raft_consensus.cc:385] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.746187  1727 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.749588  1725 raft_consensus.cc:359] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.753123  1725 raft_consensus.cc:385] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.753495  1725 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.753693  1727 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.754319  1725 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.758435  1727 ts_tablet_manager.cc:1434] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:01:09.759629  1727 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:09.760342  1522 tablet_service.cc:1511] Processing CreateTablet for tablet abc3085f661f457e8c8d15478c227311 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:09.762133  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc3085f661f457e8c8d15478c227311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.763849  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e287a2761794958b3002cd2258cf2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.764104  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 4e287a2761794958b3002cd2258cf2f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:09.766614  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e287a2761794958b3002cd2258cf2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.767204  1595 tablet_service.cc:1511] Processing CreateTablet for tablet abc3085f661f457e8c8d15478c227311 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:09.768565  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc3085f661f457e8c8d15478c227311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.768656  1727 tablet_bootstrap.cc:654] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.773391  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 32221e86161141d39327e18efdbbb226 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:09.774755  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32221e86161141d39327e18efdbbb226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.790580  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 9a39df5ae9144c118d4158b68b17044c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:09.790906  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 32221e86161141d39327e18efdbbb226 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:09.791932  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39df5ae9144c118d4158b68b17044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.791967  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32221e86161141d39327e18efdbbb226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.792446  1725 ts_tablet_manager.cc:1434] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.000s
I20260709 13:01:09.798803  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 9a39df5ae9144c118d4158b68b17044c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:09.799844  1725 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:09.799983  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39df5ae9144c118d4158b68b17044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.799907  1724 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:09.804087  1724 ts_tablet_manager.cc:1403] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.005s
I20260709 13:01:09.806609  1724 raft_consensus.cc:359] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.810598  1724 raft_consensus.cc:385] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.810988  1724 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.811200  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 9a39df5ae9144c118d4158b68b17044c (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:09.813046  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39df5ae9144c118d4158b68b17044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.816913  1682 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.817888  1724 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.828632  1748 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.830044  1724 ts_tablet_manager.cc:1434] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:01:09.822803  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 208506ca334e4441af10e7c0e8432dbe (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:09.831331  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208506ca334e4441af10e7c0e8432dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.833182  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 208506ca334e4441af10e7c0e8432dbe (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:09.823176  1765 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.834339  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208506ca334e4441af10e7c0e8432dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.834092  1765 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.836275  1765 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:09.837924  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:09.838598  1684 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:09.820745  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 208506ca334e4441af10e7c0e8432dbe (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:09.822815  1725 tablet_bootstrap.cc:654] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.840517  1524 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b18d08269419485367169ac7d79c5 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:09.841071  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208506ca334e4441af10e7c0e8432dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.843953  1595 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b18d08269419485367169ac7d79c5 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:09.844511  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b18d08269419485367169ac7d79c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.845404  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:09.847285  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:09.847398  1671 tablet_service.cc:1511] Processing CreateTablet for tablet bb1b18d08269419485367169ac7d79c5 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:09.847954  1608 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:09.848789  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b18d08269419485367169ac7d79c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.851248  1765 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:09.851665  1765 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.852003  1765 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.856696  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b18d08269419485367169ac7d79c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.845434  1724 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:09.869733  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb69c6ea77a4b5680f9f2b453332415 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:09.871572  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb69c6ea77a4b5680f9f2b453332415. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:09.943380  1418 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69506.4us
I20260709 13:01:09.956269  1765 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.959954  1727 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:09.960520  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:09.960860  1727 ts_tablet_manager.cc:1403] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.201s	user 0.016s	sys 0.017s
I20260709 13:01:09.961156  1682 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.962555  1725 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:09.963114  1725 ts_tablet_manager.cc:1403] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.000s
I20260709 13:01:09.965916  1725 raft_consensus.cc:359] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.978577  1725 raft_consensus.cc:385] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.972695  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:09.984386  1608 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:09.973886  1790 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:09.975128  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb69c6ea77a4b5680f9f2b453332415 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:09.986769  1674 tablet_service.cc:1511] Processing CreateTablet for tablet d9a84223e947489c829c528c860660d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:09.987298  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb69c6ea77a4b5680f9f2b453332415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.976797  1727 raft_consensus.cc:359] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.977788  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6a74dd4014d38b1b536f6b0fc66ec (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:09.988090  1727 raft_consensus.cc:385] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:09.988662  1727 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.989049  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6a74dd4014d38b1b536f6b0fc66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.989571  1727 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:09.989141  1725 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:09.992098  1727 ts_tablet_manager.cc:1434] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:01:09.996064  1608 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:09.978295  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 4fb69c6ea77a4b5680f9f2b453332415 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:09.969966  1724 tablet_bootstrap.cc:654] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:09.979344  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6a74dd4014d38b1b536f6b0fc66ec (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:09.981683  1519 tablet_service.cc:1511] Processing CreateTablet for tablet d9a84223e947489c829c528c860660d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:09.982919  1592 tablet_service.cc:1511] Processing CreateTablet for tablet d9a84223e947489c829c528c860660d1 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:10.003054  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a84223e947489c829c528c860660d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.003334  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a84223e947489c829c528c860660d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.988088  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a84223e947489c829c528c860660d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.008338  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6a74dd4014d38b1b536f6b0fc66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.013911  1727 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.014560  1790 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.015179  1790 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.018059  1790 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.019169  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.020416  1790 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.020479  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.019323  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fb69c6ea77a4b5680f9f2b453332415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.019268  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:10.023268  1501 leader_election.cc:343] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.020973  1790 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:10.024768  1790 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.027127  1727 tablet_bootstrap.cc:654] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:10.028419  1498 leader_election.cc:343] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.029105  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.030045  1729 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.036932  1767 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:09.993813  1725 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.044518  1724 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.045024  1724 ts_tablet_manager.cc:1403] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.004s
I20260709 13:01:10.049607  1725 ts_tablet_manager.cc:1434] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 13:01:10.046598  1765 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.052901  1724 raft_consensus.cc:359] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.053586  1724 raft_consensus.cc:385] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.053851  1724 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.055624  1724 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.056453  1522 tablet_service.cc:1511] Processing CreateTablet for tablet baf31533a97f4325919d60e19d73b3f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:10.058106  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf31533a97f4325919d60e19d73b3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.066388  1724 ts_tablet_manager.cc:1434] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:01:10.066766  1600 tablet_service.cc:1511] Processing CreateTablet for tablet baf31533a97f4325919d60e19d73b3f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:10.067441  1724 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.068074  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf31533a97f4325919d60e19d73b3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.065490  1667 tablet_service.cc:1511] Processing CreateTablet for tablet baf31533a97f4325919d60e19d73b3f2 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:10.074637  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf31533a97f4325919d60e19d73b3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.080993  1524 tablet_service.cc:1511] Processing CreateTablet for tablet b748cae74bbb4bdc9765bc293b0b6702 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:10.082687  1682 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:10.085117  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6a74dd4014d38b1b536f6b0fc66ec (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:10.085700  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cae74bbb4bdc9765bc293b0b6702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.086357  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6a74dd4014d38b1b536f6b0fc66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.101742  1725 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.104398  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.112689  1600 tablet_service.cc:1511] Processing CreateTablet for tablet b748cae74bbb4bdc9765bc293b0b6702 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:10.113722  1724 tablet_bootstrap.cc:654] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.113791  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cae74bbb4bdc9765bc293b0b6702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.116379  1727 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.116817  1727 ts_tablet_manager.cc:1403] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.008s
I20260709 13:01:10.124840  1727 raft_consensus.cc:359] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.125613  1727 raft_consensus.cc:385] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.125887  1727 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.126592  1727 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.116741  1674 tablet_service.cc:1511] Processing CreateTablet for tablet b748cae74bbb4bdc9765bc293b0b6702 (DEFAULT_TABLE table=test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:10.129606  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b748cae74bbb4bdc9765bc293b0b6702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:10.130782  1727 ts_tablet_manager.cc:1434] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:10.131682  1727 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.133917  1768 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.134547  1768 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.137213  1768 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.144968  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.145673  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:10.146078  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:10.147562  1648 leader_election.cc:343] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.153110  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:10.154800  1768 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.155393  1768 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.155889  1768 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.165676  1768 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.170660  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:10.173273  1768 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.173779  1727 tablet_bootstrap.cc:654] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.175014  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:10.175583  1609 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:10.176432  1648 leader_election.cc:343] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.179343  1769 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:10.182411  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:10.183579  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:10.184846  1768 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.185319  1768 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:10.186587  1768 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.183581  1724 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.188606  1724 ts_tablet_manager.cc:1403] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.121s	user 0.035s	sys 0.018s
I20260709 13:01:10.193594  1724 raft_consensus.cc:359] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.194339  1724 raft_consensus.cc:385] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.194624  1724 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.195422  1724 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.195822  1727 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.196492  1727 ts_tablet_manager.cc:1403] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.009s
I20260709 13:01:10.197726  1724 ts_tablet_manager.cc:1434] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:01:10.198788  1724 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.200484  1725 tablet_bootstrap.cc:654] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.201761  1727 raft_consensus.cc:359] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.202701  1727 raft_consensus.cc:385] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.205487  1724 tablet_bootstrap.cc:654] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.205977  1727 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.206980  1727 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.209789  1727 ts_tablet_manager.cc:1434] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:01:10.210986  1727 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.231312  1727 tablet_bootstrap.cc:654] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:10.237776  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:10.246752  1727 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.247437  1727 ts_tablet_manager.cc:1403] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.004s
I20260709 13:01:10.251868  1727 raft_consensus.cc:359] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.256501  1727 raft_consensus.cc:385] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.256906  1727 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.257752  1727 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.259127  1724 tablet_bootstrap.cc:492] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.259581  1724 ts_tablet_manager.cc:1403] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.035s
I20260709 13:01:10.259898  1727 ts_tablet_manager.cc:1434] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:01:10.260950  1727 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.259603  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.262480  1724 raft_consensus.cc:359] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.263115  1724 raft_consensus.cc:385] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.263386  1724 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.264185  1724 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.268442  1727 tablet_bootstrap.cc:654] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.272279  1724 ts_tablet_manager.cc:1434] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:01:10.273576  1724 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.276868  1725 tablet_bootstrap.cc:492] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.277336  1725 ts_tablet_manager.cc:1403] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.011s
I20260709 13:01:10.279381  1724 tablet_bootstrap.cc:654] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.279542  1727 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.280103  1727 ts_tablet_manager.cc:1403] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:01:10.280190  1725 raft_consensus.cc:359] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.281314  1725 raft_consensus.cc:385] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.281600  1725 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.282335  1725 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.283994  1727 raft_consensus.cc:359] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.285059  1727 raft_consensus.cc:385] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.285480  1727 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.286609  1727 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.288400  1768 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.288851  1768 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.289717  1725 ts_tablet_manager.cc:1434] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:01:10.290270  1727 ts_tablet_manager.cc:1434] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:10.290771  1725 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.291082  1768 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.291347  1727 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.292889  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.293303  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:10.295107  1648 leader_election.cc:343] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:10.295822  1647 leader_election.cc:343] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.296345  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.297488  1768 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.301826  1727 tablet_bootstrap.cc:654] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.311393  1725 tablet_bootstrap.cc:654] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.311601  1724 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.312395  1724 ts_tablet_manager.cc:1403] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.011s
I20260709 13:01:10.316888  1724 raft_consensus.cc:359] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.317837  1724 raft_consensus.cc:385] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.318157  1724 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.318676  1724 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.319819  1725 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.320237  1725 ts_tablet_manager.cc:1403] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 13:01:10.320384  1724 ts_tablet_manager.cc:1434] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:10.321652  1724 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.322739  1725 raft_consensus.cc:359] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.323416  1725 raft_consensus.cc:385] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.323907  1725 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.324698  1727 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.325373  1727 ts_tablet_manager.cc:1403] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:01:10.325934  1736 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.326421  1736 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.328589  1724 tablet_bootstrap.cc:654] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.328697  1727 raft_consensus.cc:359] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.329399  1727 raft_consensus.cc:385] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.329658  1727 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.330271  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.330446  1727 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.330945  1534 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:10.332449  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.333302  1727 ts_tablet_manager.cc:1434] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:10.335594  1810 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.336100  1810 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.336480  1810 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.335775  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.340468  1682 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:10.344293  1810 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.346525  1810 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.347616  1727 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.353365  1736 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.354204  1727 tablet_bootstrap.cc:654] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.324715  1725 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.354676  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:10.355324  1534 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.356447  1725 ts_tablet_manager.cc:1434] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:01:10.357877  1725 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.353127  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:10.362397  1682 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.369287  1724 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.369999  1724 ts_tablet_manager.cc:1403] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.006s
I20260709 13:01:10.373862  1534 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:10.374392  1724 raft_consensus.cc:359] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.376825  1724 raft_consensus.cc:385] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.377225  1724 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.377810  1727 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.374794  1725 tablet_bootstrap.cc:654] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.378276  1727 ts_tablet_manager.cc:1403] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.000s
I20260709 13:01:10.378839  1682 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:10.379130  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.380007  1736 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.380487  1736 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:10.381034  1727 raft_consensus.cc:359] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.381738  1727 raft_consensus.cc:385] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.382016  1727 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.381302  1736 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.382691  1727 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.385143  1727 ts_tablet_manager.cc:1434] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:01:10.377923  1724 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.387320  1724 ts_tablet_manager.cc:1434] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:01:10.388672  1727 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.388809  1725 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.389330  1725 ts_tablet_manager.cc:1403] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:01:10.392558  1725 raft_consensus.cc:359] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.393205  1725 raft_consensus.cc:385] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.393477  1725 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.393502  1790 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.393992  1790 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.394209  1725 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.396198  1725 ts_tablet_manager.cc:1434] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:10.397071  1725 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.397221  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.398010  1790 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.398190  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.398803  1609 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:10.399333  1727 tablet_bootstrap.cc:654] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.400193  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.400928  1682 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:10.401773  1790 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.402633  1790 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.403046  1790 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.409081  1725 tablet_bootstrap.cc:654] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.410019  1724 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.411540  1727 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.412015  1727 ts_tablet_manager.cc:1403] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:01:10.418510  1724 tablet_bootstrap.cc:654] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.421301  1727 raft_consensus.cc:359] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.425328  1727 raft_consensus.cc:385] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.425628  1727 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.426512  1727 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.433562  1727 ts_tablet_manager.cc:1434] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:01:10.434577  1727 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.440395  1790 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.442035  1727 tablet_bootstrap.cc:654] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.443692  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:10.444778  1609 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.449213  1729 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:10.453979  1727 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.454164  1609 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:10.454481  1727 ts_tablet_manager.cc:1403] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:01:10.455386  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.456291  1729 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.456771  1729 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:10.458158  1729 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.458768  1727 raft_consensus.cc:359] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.459460  1727 raft_consensus.cc:385] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.459728  1727 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.460565  1727 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.463092  1727 ts_tablet_manager.cc:1434] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:10.464223  1725 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.464743  1725 ts_tablet_manager.cc:1403] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.068s	user 0.033s	sys 0.023s
I20260709 13:01:10.465240  1790 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.465379  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:10.466049  1683 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.465631  1727 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.455061  1431 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.473630  1724 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.474201  1724 ts_tablet_manager.cc:1403] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.000s
I20260709 13:01:10.485389  1729 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.488292  1729 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.494814  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.495123  1683 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:10.496348  1498 leader_election.cc:343] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.498859  1725 raft_consensus.cc:359] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.497599  1430 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.502875  1727 tablet_bootstrap.cc:654] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.497661  1729 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.500236  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.500835  1725 raft_consensus.cc:385] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.506414  1725 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.507228  1725 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.509020  1725 ts_tablet_manager.cc:1434] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:01:10.506762  1724 raft_consensus.cc:359] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.509711  1724 raft_consensus.cc:385] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:10.509932  1501 leader_election.cc:343] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.510556  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.512001  1725 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.511926  1752 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.509029  1790 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:10.516702  1768 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.517212  1768 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.521572  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:10.522989  1648 leader_election.cc:343] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.523578  1768 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.524417  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.525079  1609 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:10.526134  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:10.527559  1768 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.527930  1768 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.528303  1768 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.509992  1724 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.535573  1724 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.538491  1724 ts_tablet_manager.cc:1434] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:01:10.542992  1727 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.543799  1727 ts_tablet_manager.cc:1403] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.078s	user 0.030s	sys 0.020s
I20260709 13:01:10.543994  1790 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.544504  1790 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.546468  1727 raft_consensus.cc:359] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.547327  1727 raft_consensus.cc:385] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.547628  1727 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.547469  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.548589  1727 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.549319  1498 leader_election.cc:343] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.543035  1724 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.550757  1727 ts_tablet_manager.cc:1434] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:10.551657  1727 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.552376  1725 tablet_bootstrap.cc:654] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.555482  1768 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.557337  1724 tablet_bootstrap.cc:654] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.558856  1727 tablet_bootstrap.cc:654] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.559201  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:10.561002  1648 leader_election.cc:343] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.563313  1768 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.565491  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:10.566144  1610 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.570098  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.570991  1682 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:10.572696  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.573889  1729 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.574376  1729 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.574802  1729 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.574918  1610 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:10.576383  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:10.578219  1768 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.578951  1768 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:10.579872  1768 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.584172  1790 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.594499  1729 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.599623  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:10.599858  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:10.600736  1682 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:10.603296  1498 leader_election.cc:343] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.601811  1729 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.632349  1798 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.633379  1798 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.632537  1736 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.638511  1736 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.635787  1798 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.639559  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.689042  1724 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.659523  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.690619  1724 ts_tablet_manager.cc:1403] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.004s
I20260709 13:01:10.675235  1682 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:10.661897  1769 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.688975  1725 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.693084  1725 ts_tablet_manager.cc:1403] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.181s	user 0.020s	sys 0.002s
I20260709 13:01:10.664812  1767 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:01:10.695572  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.641027  1431 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.695058  1769 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.699318  1576 leader_election.cc:343] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.691203  1736 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.692523  1798 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.702162  1648 leader_election.cc:343] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.702486  1798 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.702875  1769 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.703828  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:10.703977  1647 leader_election.cc:343] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.704517  1798 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.704453  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.706182  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.706899  1534 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:10.706173  1767 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.707837  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.708388  1724 raft_consensus.cc:359] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.709048  1724 raft_consensus.cc:385] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.709363  1724 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.709859  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.709986  1724 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.710489  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.711068  1790 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.711997  1790 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:10.712961  1790 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.713482  1647 leader_election.cc:343] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:10.714591  1648 leader_election.cc:343] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:10.686681  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61893.2us
I20260709 13:01:10.711993  1724 ts_tablet_manager.cc:1434] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.003s
I20260709 13:01:10.715094  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.718287  1727 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:10.719448  1727 ts_tablet_manager.cc:1403] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.168s	user 0.031s	sys 0.028s
I20260709 13:01:10.718222  1724 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.720566  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:10.721697  1769 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.722307  1769 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.727394  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.728003  1769 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.730065  1534 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:10.731405  1790 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.731701  1727 raft_consensus.cc:359] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.731986  1790 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.732446  1727 raft_consensus.cc:385] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.735090  1534 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.735590  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.733570  1769 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.739060  1727 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.739566  1790 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:10.724690  1647 leader_election.cc:343] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.739780  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:10.744251  1769 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.745057  1431 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.751029  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:10.752636  1724 tablet_bootstrap.cc:654] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.753090  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.753960  1790 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.748438  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:10.755803  1534 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.746407  1769 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.747354  1798 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:10.748247  1736 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.756686  1725 raft_consensus.cc:359] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.757227  1736 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.757412  1725 raft_consensus.cc:385] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.757725  1736 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.757730  1725 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.759197  1725 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.739771  1727 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.761932  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:10.783881  1727 ts_tablet_manager.cc:1434] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 13:01:10.785872  1727 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:10.792104  1810 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.794598  1736 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.796977  1647 leader_election.cc:343] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.800592  1810 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.801728  1725 ts_tablet_manager.cc:1434] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:01:10.810230  1736 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.811920  1810 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.815013  1725 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:10.820988  1534 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:10.820827  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:10.825424  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.815013  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:10.827036  1826 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.829178  1533 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.831853  1724 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.832353  1724 ts_tablet_manager.cc:1403] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.114s	user 0.020s	sys 0.046s
I20260709 13:01:10.829728  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:10.830091  1576 leader_election.cc:343] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.815780  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.839390  1682 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:10.840301  1826 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:10.840617  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:10.841413  1810 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:10.841092  1826 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.842003  1574 leader_election.cc:343] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.841782  1810 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.842602  1810 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.839965  1533 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:10.844105  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:10.845206  1736 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.846724  1736 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:10.847563  1736 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.848944  1724 raft_consensus.cc:359] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.849629  1724 raft_consensus.cc:385] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.849912  1724 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.850479  1810 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.850941  1724 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.853236  1724 ts_tablet_manager.cc:1434] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:01:10.853587  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:10.854821  1724 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
W20260709 13:01:10.854772  1574 leader_election.cc:343] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.860194  1727 tablet_bootstrap.cc:654] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.870132  1831 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.871496  1810 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.871083  1831 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.872781  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:10.873399  1682 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:10.871078  1790 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.874390  1725 tablet_bootstrap.cc:654] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.874416  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:10.874715  1790 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:10.877350  1648 leader_election.cc:343] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.879875  1790 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:10.881315  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:10.881611  1831 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:10.881949  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:10.883937  1498 leader_election.cc:343] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:10.884511  1501 leader_election.cc:343] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.884902  1724 tablet_bootstrap.cc:654] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:10.884975  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.899121  1790 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.892864  1682 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:10.894148  1832 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:10.897415  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:10.902719  1647 leader_election.cc:343] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.903331  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:10.904294  1826 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:10.910004  1433 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.917853  1790 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:10.931999  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:10.932943  1832 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:10.939922  1832 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:10.941727  1832 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.951364  1725 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:10.951879  1725 ts_tablet_manager.cc:1403] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.026s
I20260709 13:01:10.955130  1725 raft_consensus.cc:359] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.955919  1725 raft_consensus.cc:385] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.956223  1725 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.959144  1724 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:10.959669  1724 ts_tablet_manager.cc:1403] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.011s
I20260709 13:01:10.963814  1724 raft_consensus.cc:359] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.964911  1724 raft_consensus.cc:385] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:10.965288  1724 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:10.965027  1736 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:10.966298  1724 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.976078  1724 ts_tablet_manager.cc:1434] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 13:01:10.977136  1724 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:10.967470  1725 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.980206  1432 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.979981  1810 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.990675  1810 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:10.997285  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:10.999073  1574 leader_election.cc:343] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:10.999814  1810 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.000609  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.001257  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:11.003463  1727 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.004186  1831 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.005261  1727 ts_tablet_manager.cc:1403] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.220s	user 0.014s	sys 0.016s
I20260709 13:01:11.005487  1831 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.008878  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.009517  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:11.009537  1534 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:11.010892  1729 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:11.011780  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.012248  1831 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.012784  1831 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.013058  1831 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.013607  1831 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.015803  1810 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.016345  1810 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.016800  1810 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.021052  1432 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.023877  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.025662  1647 leader_election.cc:343] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.028780  1724 tablet_bootstrap.cc:654] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.004791  1725 ts_tablet_manager.cc:1434] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:01:11.030089  1725 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.024413  1831 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.048981  1727 raft_consensus.cc:359] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.049964  1727 raft_consensus.cc:385] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.050292  1727 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.048331  1729 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.050820  1729 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.051106  1727 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.053303  1727 ts_tablet_manager.cc:1434] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:01:11.052868  1729 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.053930  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:11.054212  1727 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.054459  1831 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.054553  1534 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.059083  1810 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.061079  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:11.062180  1725 tablet_bootstrap.cc:654] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.061774  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.062932  1682 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
W20260709 13:01:11.063261  1647 leader_election.cc:343] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.064936  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.065012  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.065999  1729 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.066349  1729 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.066661  1729 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.069205  1826 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:11.069480  1498 leader_election.cc:343] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.071045  1752 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.071552  1752 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.073207  1534 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:11.076495  1810 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.077723  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:11.082329  1683 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.080611  1727 tablet_bootstrap.cc:654] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.080703  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.085032  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:11.086817  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.088114  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:11.088680  1574 leader_election.cc:343] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.089835  1724 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.089928  1826 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.090287  1724 ts_tablet_manager.cc:1403] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.010s
I20260709 13:01:11.075519  1752 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.091421  1826 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:11.092242  1826 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.094099  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.094990  1765 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.096282  1724 raft_consensus.cc:359] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.096961  1724 raft_consensus.cc:385] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.097234  1724 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.098060  1724 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.100333  1724 ts_tablet_manager.cc:1434] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:11.101500  1724 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.098373  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:11.103924  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:11.104686  1729 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.105166  1810 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.105688  1810 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:11.106240  1725 tablet_bootstrap.cc:492] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.106710  1725 ts_tablet_manager.cc:1403] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.008s
I20260709 13:01:11.106577  1810 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.107662  1724 tablet_bootstrap.cc:654] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.112782  1729 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.113749  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:11.115630  1498 leader_election.cc:343] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.119412  1725 raft_consensus.cc:359] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.120165  1725 raft_consensus.cc:385] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.121665  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:11.122270  1725 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.122524  1683 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.135440  1725 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:11.139003  1498 consensus_peers.cc:597] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.139282  1725 ts_tablet_manager.cc:1434] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:01:11.140519  1725 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.145660  1727 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.146121  1727 ts_tablet_manager.cc:1403] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.009s
I20260709 13:01:11.149008  1724 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.149519  1724 ts_tablet_manager.cc:1403] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.007s
I20260709 13:01:11.154450  1683 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:11.155807  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.155494  1724 raft_consensus.cc:359] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.156563  1724 raft_consensus.cc:385] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.156930  1724 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.157006  1729 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.157685  1724 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.158320  1729 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:11.159308  1729 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.159953  1724 ts_tablet_manager.cc:1434] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:11.161069  1724 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.163596  1765 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.163393  1433 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.164307  1765 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.166419  1765 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.170710  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.172453  1498 leader_election.cc:343] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.179051  1725 tablet_bootstrap.cc:654] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.168751  1533 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.169741  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:11.184900  1501 leader_election.cc:343] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.185781  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.187104  1765 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.188975  1727 raft_consensus.cc:359] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.189909  1727 raft_consensus.cc:385] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.190244  1727 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.192008  1727 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.186973  1432 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.197237  1727 ts_tablet_manager.cc:1434] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 13:01:11.198541  1727 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.205125  1831 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:11.206954  1724 tablet_bootstrap.cc:654] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.211452  1727 tablet_bootstrap.cc:654] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.224598  1724 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.224598  1725 tablet_bootstrap.cc:492] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.225389  1724 ts_tablet_manager.cc:1403] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.008s
I20260709 13:01:11.225450  1725 ts_tablet_manager.cc:1403] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.014s
I20260709 13:01:11.218797  1430 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.231971  1810 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.232753  1810 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.234381  1727 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.234866  1727 ts_tablet_manager.cc:1403] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:01:11.234954  1810 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.237280  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.237110  1725 raft_consensus.cc:359] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.238400  1725 raft_consensus.cc:385] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.237951  1727 raft_consensus.cc:359] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.238713  1725 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.239030  1727 raft_consensus.cc:385] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.239368  1727 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.239391  1725 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.238550  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.242817  1534 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:11.244066  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:11.245114  1810 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.251016  1768 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.240417  1727 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.251957  1768 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.253540  1727 ts_tablet_manager.cc:1434] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:01:11.254415  1727 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.256956  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.259395  1724 raft_consensus.cc:359] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.260257  1724 raft_consensus.cc:385] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.260515  1724 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.260654  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.261150  1724 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.261564  1768 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:11.263628  1647 leader_election.cc:343] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:11.264886  1648 leader_election.cc:343] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.265323  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.266263  1769 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.267613  1727 tablet_bootstrap.cc:654] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.270042  1725 ts_tablet_manager.cc:1434] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:01:11.271210  1725 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.280122  1810 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.263576  1724 ts_tablet_manager.cc:1434] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:01:11.282418  1724 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
W20260709 13:01:11.288842  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:11.294212  1725 tablet_bootstrap.cc:654] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.298856  1727 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.299367  1727 ts_tablet_manager.cc:1403] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.022s
I20260709 13:01:11.302939  1724 tablet_bootstrap.cc:654] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.302636  1727 raft_consensus.cc:359] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.303333  1727 raft_consensus.cc:385] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.303648  1727 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.303122  1729 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.304361  1727 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.306699  1727 ts_tablet_manager.cc:1434] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:01:11.307755  1727 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.311142  1729 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.311968  1729 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.314747  1727 tablet_bootstrap.cc:654] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.317831  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.320874  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.323658  1682 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:11.325918  1501 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.326727  1724 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.327472  1724 ts_tablet_manager.cc:1403] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.010s
I20260709 13:01:11.327385  1765 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.332518  1724 raft_consensus.cc:359] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.333242  1724 raft_consensus.cc:385] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.333525  1724 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.333482  1682 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.334458  1724 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.336226  1724 ts_tablet_manager.cc:1434] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:11.337210  1810 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:11.339500  1724 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.340687  1768 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.341490  1729 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.369750  1727 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.370777  1727 ts_tablet_manager.cc:1403] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.009s
I20260709 13:01:11.369632  1724 tablet_bootstrap.cc:654] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.375555  1727 raft_consensus.cc:359] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.376892  1727 raft_consensus.cc:385] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.371747  1765 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.378374  1727 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.379458  1727 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.383054  1727 ts_tablet_manager.cc:1434] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:01:11.384466  1727 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.394826  1725 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.395352  1725 ts_tablet_manager.cc:1403] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.038s
I20260709 13:01:11.398391  1727 tablet_bootstrap.cc:654] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.402329  1724 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.402832  1724 ts_tablet_manager.cc:1403] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.001s
I20260709 13:01:11.403133  1832 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:11.406396  1724 raft_consensus.cc:359] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.407162  1724 raft_consensus.cc:385] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.407433  1724 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.408129  1724 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.410442  1724 ts_tablet_manager.cc:1434] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:01:11.411378  1724 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.412150  1768 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.398339  1725 raft_consensus.cc:359] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.412729  1725 raft_consensus.cc:385] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.412657  1768 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.413079  1725 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.413844  1725 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.415310  1768 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.416579  1725 ts_tablet_manager.cc:1434] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:01:11.417017  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.417861  1725 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.418242  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:11.418617  1647 leader_election.cc:343] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.418860  1532 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:11.422278  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.423705  1768 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.424147  1768 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.424506  1768 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.424980  1725 tablet_bootstrap.cc:654] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.440346  1832 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.442755  1724 tablet_bootstrap.cc:654] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.443285  1831 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.446647  1826 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.447291  1826 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.450381  1826 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.455307  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.456207  1533 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:11.459792  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.460507  1609 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:11.460952  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.462102  1831 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.462607  1831 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.466964  1831 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.469887  1768 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.472857  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:11.473464  1535 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.474159  1736 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.481839  1752 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.482407  1752 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.484608  1752 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.486534  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.487737  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.489557  1498 leader_election.cc:343] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.476064  1831 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:11.491111  1501 leader_election.cc:343] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.493331  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.498975  1810 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.500787  1752 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.502506  1724 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.503064  1724 ts_tablet_manager.cc:1403] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.011s
I20260709 13:01:11.512068  1724 raft_consensus.cc:359] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.512784  1724 raft_consensus.cc:385] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.513103  1724 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.516393  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:11.518074  1647 leader_election.cc:343] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.525560  1826 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.526892  1768 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.526486  1826 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.531479  1724 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.532558  1725 tablet_bootstrap.cc:492] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.534615  1725 ts_tablet_manager.cc:1403] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.117s	user 0.036s	sys 0.015s
I20260709 13:01:11.537048  1725 raft_consensus.cc:359] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.537724  1725 raft_consensus.cc:385] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.538002  1725 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.538569  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.539283  1725 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.541014  1725 ts_tablet_manager.cc:1434] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:01:11.540956  1648 leader_election.cc:343] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.541989  1725 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.542287  1826 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.544173  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.546931  1647 leader_election.cc:343] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.547542  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.550246  1535 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:11.553455  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.554059  1826 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.554611  1769 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.555284  1769 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:11.557452  1769 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:11.560887  1498 consensus_peers.cc:597] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.561362  1724 ts_tablet_manager.cc:1434] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:01:11.565924  1724 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.568400  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:11.569425  1533 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.576164  1768 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:11.587366  1724 tablet_bootstrap.cc:654] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.592914  1752 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:11.595927  1647 consensus_peers.cc:597] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.614122  1430 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.616607  1534 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.617733  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:11.621845  1727 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.622300  1727 ts_tablet_manager.cc:1403] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.010s
I20260709 13:01:11.622875  1752 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.623400  1752 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.624078  1607 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.610558  1831 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.625366  1725 tablet_bootstrap.cc:654] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.625469  1752 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.625136  1727 raft_consensus.cc:359] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.627604  1727 raft_consensus.cc:385] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.628001  1727 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.628727  1727 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.630836  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.632095  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:11.642486  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.643360  1752 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.643735  1752 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.644073  1752 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.641815  1727 ts_tablet_manager.cc:1434] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:01:11.648471  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.650619  1498 leader_election.cc:343] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.640115  1533 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:11.660602  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.661721  1831 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.662221  1831 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:11.662340  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:11.663535  1831 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.665395  1810 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:11.665194  1752 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.671957  1752 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.678128  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:11.677769  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:11.678781  1683 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.680425  1724 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.680889  1724 ts_tablet_manager.cc:1403] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.001s
W20260709 13:01:11.681137  1498 leader_election.cc:343] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.683085  1725 tablet_bootstrap.cc:492] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.683514  1725 ts_tablet_manager.cc:1403] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.002s
I20260709 13:01:11.684262  1727 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.697126  1724 raft_consensus.cc:359] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.698148  1724 raft_consensus.cc:385] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.698493  1724 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.707085  1610 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.710300  1724 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.716938  1729 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.718185  1729 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.717166  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:11.720379  1729 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.723371  1724 ts_tablet_manager.cc:1434] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.006s
I20260709 13:01:11.724778  1724 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.717836  1432 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.725927  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.722546  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.729691  1498 leader_election.cc:343] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.730593  1729 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.744516  1725 raft_consensus.cc:359] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.748245  1725 raft_consensus.cc:385] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.748802  1725 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.749099  1727 tablet_bootstrap.cc:654] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.749861  1725 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.740944  1729 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:11.755054  1729 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.757175  1725 ts_tablet_manager.cc:1434] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.073s	user 0.013s	sys 0.006s
I20260709 13:01:11.758467  1725 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.769344  1810 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.769986  1810 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.765326  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.781296  1683 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:11.784977  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.785230  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.789709  1535 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:11.790560  1765 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.792316  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:11.793272  1765 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.793481  1832 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.793707  1765 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.793965  1832 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.794535  1810 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.794850  1832 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.805022  1727 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.805631  1727 ts_tablet_manager.cc:1403] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.021s
I20260709 13:01:11.807935  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.808620  1683 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:11.809285  1727 raft_consensus.cc:359] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.810002  1727 raft_consensus.cc:385] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.810490  1727 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.811213  1727 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.813361  1727 ts_tablet_manager.cc:1434] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:11.814342  1724 tablet_bootstrap.cc:654] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.814558  1727 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.814405  1765 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.815368  1832 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.817732  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:11.818472  1607 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:11.823836  1727 tablet_bootstrap.cc:654] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.824509  1765 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.825951  1725 tablet_bootstrap.cc:654] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.826149  1832 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.825922  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:11.826793  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:11.827069  1535 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:11.827450  1684 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.828476  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:11.814872  1432 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.830080  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.831383  1765 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.838438  1826 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.838963  1684 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:11.839123  1826 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.840262  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:11.841539  1832 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:11.842554  1832 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:11.843398  1832 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.846266  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:11.848781  1648 leader_election.cc:343] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.849570  1724 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.850055  1724 ts_tablet_manager.cc:1403] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.007s
I20260709 13:01:11.852515  1826 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.852999  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:11.852867  1724 raft_consensus.cc:359] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.856279  1724 raft_consensus.cc:385] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.856631  1724 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
W20260709 13:01:11.857265  1647 leader_election.cc:343] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.857937  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:11.858349  1724 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.859623  1826 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.863314  1727 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.863806  1727 ts_tablet_manager.cc:1403] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.000s
I20260709 13:01:11.861804  1725 tablet_bootstrap.cc:492] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.864449  1725 ts_tablet_manager.cc:1403] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.002s
I20260709 13:01:11.866504  1725 raft_consensus.cc:359] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.866998  1725 raft_consensus.cc:385] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.867159  1725 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.867333  1727 raft_consensus.cc:359] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.868023  1727 raft_consensus.cc:385] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.868266  1724 ts_tablet_manager.cc:1434] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:01:11.868398  1727 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.869369  1724 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.869517  1727 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.871905  1430 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.867856  1725 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.876184  1727 ts_tablet_manager.cc:1434] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:11.876262  1725 ts_tablet_manager.cc:1434] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:11.876262  1724 tablet_bootstrap.cc:654] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.877398  1725 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.880502  1727 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.885392  1725 tablet_bootstrap.cc:654] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.887265  1727 tablet_bootstrap.cc:654] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.901836  1886 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.902477  1886 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.910912  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:11.913578  1886 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:11.917004  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.917860  1535 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:11.919145  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:11.929983  1886 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.939159  1886 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:11.943038  1727 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.943491  1727 ts_tablet_manager.cc:1403] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.063s	user 0.035s	sys 0.022s
I20260709 13:01:11.944098  1724 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:11.944669  1724 ts_tablet_manager.cc:1403] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.026s
I20260709 13:01:11.945107  1725 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:11.945540  1725 ts_tablet_manager.cc:1403] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.038s
I20260709 13:01:11.946220  1727 raft_consensus.cc:359] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.946915  1727 raft_consensus.cc:385] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.947180  1727 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.947605  1724 raft_consensus.cc:359] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.947824  1727 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.948349  1724 raft_consensus.cc:385] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.948827  1769 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.949110  1724 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.948336  1725 raft_consensus.cc:359] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.949318  1769 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.949904  1725 raft_consensus.cc:385] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:11.949795  1724 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.950213  1725 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:11.950451  1727 ts_tablet_manager.cc:1434] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:01:11.951027  1831 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.951465  1727 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:11.951570  1725 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.952973  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.953593  1725 ts_tablet_manager.cc:1434] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:11.953575  1535 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:11.954704  1725 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:11.951434  1831 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.960162  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:11.961144  1826 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:11.961544  1826 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.961872  1826 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:11.963821  1725 tablet_bootstrap.cc:654] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.966002  1727 tablet_bootstrap.cc:654] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:11.966390  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:11.976228  1647 leader_election.cc:343] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:11.977455  1768 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.977898  1768 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.979838  1724 ts_tablet_manager.cc:1434] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:01:11.984673  1831 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.985321  1724 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:11.988540  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:11.990716  1727 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:11.991211  1727 ts_tablet_manager.cc:1403] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:01:11.951424  1769 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:11.979844  1768 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.004236  1727 raft_consensus.cc:359] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:11.990578  1533 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:12.006125  1727 raft_consensus.cc:385] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.006522  1727 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.008412  1727 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.011066  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.012576  1769 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.013079  1769 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.013501  1769 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.016219  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.020123  1727 ts_tablet_manager.cc:1434] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
W20260709 13:01:12.020323  1647 leader_election.cc:343] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.006390  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.021325  1727 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
W20260709 13:01:12.021823  1648 leader_election.cc:343] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.023120  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:12.025146  1647 leader_election.cc:343] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.028934  1768 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.030135  1725 tablet_bootstrap.cc:492] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.030604  1725 ts_tablet_manager.cc:1403] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.026s
I20260709 13:01:12.031806  1724 tablet_bootstrap.cc:654] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.026015  1647 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.035204  1826 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.037853  1768 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.039044  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:12.039314  1826 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.039708  1533 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.041164  1725 raft_consensus.cc:359] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.042943  1727 tablet_bootstrap.cc:654] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.041867  1725 raft_consensus.cc:385] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.046272  1725 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.047019  1725 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.049091  1533 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:12.049634  1725 ts_tablet_manager.cc:1434] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:01:12.053326  1724 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.054085  1724 ts_tablet_manager.cc:1403] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.003s
I20260709 13:01:12.057356  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:12.057559  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.058667  1768 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:12.061619  1647 leader_election.cc:343] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.061980  1725 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.065534  1769 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.068801  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:12.071120  1647 leader_election.cc:343] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.072382  1727 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.072963  1727 ts_tablet_manager.cc:1403] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.011s
I20260709 13:01:12.076386  1727 raft_consensus.cc:359] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.077301  1727 raft_consensus.cc:385] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.077632  1727 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.078233  1769 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.080484  1727 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.082722  1729 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.082832  1768 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:12.083364  1729 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.083949  1768 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.087375  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.082744  1725 tablet_bootstrap.cc:654] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.087862  1727 ts_tablet_manager.cc:1434] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:01:12.088050  1684 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:12.088853  1727 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.089874  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.090718  1765 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.091071  1765 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.091389  1765 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.091419  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.098826  1831 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.100133  1729 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.100929  1725 tablet_bootstrap.cc:492] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.100831  1765 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.101409  1725 ts_tablet_manager.cc:1403] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.007s
W20260709 13:01:12.104863  1498 leader_election.cc:343] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.106086  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:12.107111  1765 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.112226  1727 tablet_bootstrap.cc:654] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.110394  1831 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.110203  1724 raft_consensus.cc:359] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.110796  1725 raft_consensus.cc:359] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.107194  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:12.128170  1498 leader_election.cc:343] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.128435  1725 raft_consensus.cc:385] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.134187  1725 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.135017  1725 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.128731  1684 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.139611  1727 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.140221  1727 ts_tablet_manager.cc:1403] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.010s
I20260709 13:01:12.142373  1725 ts_tablet_manager.cc:1434] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:01:12.143337  1725 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.130178  1607 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.145032  1765 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.145910  1765 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.144239  1727 raft_consensus.cc:359] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.147409  1727 raft_consensus.cc:385] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.147805  1727 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.148874  1727 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.150257  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.150892  1683 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:12.151342  1727 ts_tablet_manager.cc:1434] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:12.152580  1727 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.152362  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.153693  1729 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.154064  1729 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.154400  1729 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.157457  1832 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.158200  1832 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.160372  1886 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.160859  1886 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.162387  1729 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.162813  1886 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.164542  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.165437  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:12.165995  1682 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.128367  1724 raft_consensus.cc:385] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.168522  1724 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.169237  1724 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.169600  1832 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.170852  1724 ts_tablet_manager.cc:1434] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.002s
I20260709 13:01:12.171986  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.172782  1683 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:12.174772  1682 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:12.175567  1765 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.176152  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.177009  1765 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.176127  1729 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.177228  1684 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:12.178790  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.179370  1724 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.181346  1727 tablet_bootstrap.cc:654] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.182082  1725 tablet_bootstrap.cc:654] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.187230  1610 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.188210  1752 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.188611  1765 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:12.194170  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.209753  1752 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:12.213819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:12.213553  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.266463  1724 tablet_bootstrap.cc:654] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.262143  1832 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.276185  1832 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.276750  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:12.277616  1886 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.279531  1826 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.280934  1826 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.286170  1826 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:12.290812  1498 leader_election.cc:343] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.295389  1832 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.296044  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:12.286298  1752 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.307209  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.309818  1736 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.313403  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.314711  1535 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:12.272596  1765 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.324362  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:12.326225  1736 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.326884  1886 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.331326  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:12.334815  1498 leader_election.cc:343] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.337882  1729 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.344985  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:12.347760  1647 leader_election.cc:343] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.353163  1724 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.353685  1724 ts_tablet_manager.cc:1403] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.030s
I20260709 13:01:12.355060  1736 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.359318  1832 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.361114  1727 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.361629  1727 ts_tablet_manager.cc:1403] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.021s
I20260709 13:01:12.365971  1904 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.366289  1727 raft_consensus.cc:359] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.372830  1727 raft_consensus.cc:385] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:12.372974  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:12.373148  1727 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.366580  1724 raft_consensus.cc:359] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.368672  1736 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:01:12.373888  1727 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.374332  1724 raft_consensus.cc:385] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.374423  1725 tablet_bootstrap.cc:492] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.374926  1725 ts_tablet_manager.cc:1403] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.232s	user 0.014s	sys 0.005s
I20260709 13:01:12.376216  1727 ts_tablet_manager.cc:1434] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:01:12.377115  1727 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.378743  1725 raft_consensus.cc:359] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.379429  1725 raft_consensus.cc:385] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.394330  1725 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.395299  1725 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.398085  1725 ts_tablet_manager.cc:1434] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:01:12.376246  1724 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
W20260709 13:01:12.400115  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 334484us
I20260709 13:01:12.411082  1432 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.420367  1725 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.411706  1896 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:01:12.411738  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.409433  1769 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.423535  1769 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.401270  1724 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.425758  1769 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.426751  1724 ts_tablet_manager.cc:1434] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:01:12.427006  1533 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:12.427827  1724 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.427987  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:12.429868  1647 leader_election.cc:343] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.431767  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.436551  1896 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.436936  1896 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.437258  1896 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.438814  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.440397  1724 tablet_bootstrap.cc:654] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.417999  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:12.440898  1535 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:12.444195  1648 leader_election.cc:343] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.449390  1896 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.458603  1727 tablet_bootstrap.cc:654] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.461248  1724 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.462774  1724 ts_tablet_manager.cc:1403] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.003s
I20260709 13:01:12.466383  1724 raft_consensus.cc:359] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.467070  1724 raft_consensus.cc:385] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.467355  1724 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.468020  1724 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.470147  1724 ts_tablet_manager.cc:1434] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:12.471047  1724 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.462597  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.475246  1769 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.479547  1896 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.482869  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:12.484594  1647 leader_election.cc:343] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.486666  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:12.487339  1533 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.483156  1725 tablet_bootstrap.cc:654] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.494017  1736 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.475261  1535 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:12.495071  1736 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.499169  1736 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.500380  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.501226  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.501088  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.501855  1533 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:12.505092  1684 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:12.506237  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:12.507323  1736 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.507977  1724 tablet_bootstrap.cc:654] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.508158  1769 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.508662  1769 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:12.508741  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.512468  1826 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.511996  1769 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.513550  1826 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:12.514420  1826 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.526743  1727 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.527297  1727 ts_tablet_manager.cc:1403] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.150s	user 0.006s	sys 0.006s
I20260709 13:01:12.527452  1736 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.530833  1727 raft_consensus.cc:359] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.531528  1727 raft_consensus.cc:385] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.538651  1727 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.540099  1727 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.554389  1727 ts_tablet_manager.cc:1434] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:01:12.556648  1727 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.551781  1433 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.559125  1725 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.559780  1725 ts_tablet_manager.cc:1403] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.005s
I20260709 13:01:12.561956  1433 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.570066  1724 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.570578  1724 ts_tablet_manager.cc:1403] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.002s
I20260709 13:01:12.576474  1724 raft_consensus.cc:359] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.577169  1724 raft_consensus.cc:385] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.577440  1724 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.578037  1724 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.579484  1724 ts_tablet_manager.cc:1434] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:01:12.580338  1724 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.585052  1725 raft_consensus.cc:359] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.585845  1725 raft_consensus.cc:385] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.586164  1725 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.586992  1727 tablet_bootstrap.cc:654] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.586959  1725 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.589406  1725 ts_tablet_manager.cc:1434] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:01:12.590461  1725 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.590148  1432 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.592729  1432 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.601688  1826 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.602619  1826 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.606725  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.607448  1534 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:12.607772  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.608624  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:12.609226  1647 leader_election.cc:343] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.605958  1826 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.609915  1895 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.610661  1895 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.610986  1895 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.616005  1725 tablet_bootstrap.cc:654] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.620781  1769 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.634135  1769 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.636729  1724 tablet_bootstrap.cc:654] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.637951  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.638690  1752 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.643333  1752 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.645750  1752 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.647730  1535 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:12.649118  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.649776  1684 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:12.649874  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.651214  1769 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.653162  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.654839  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.659413  1736 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.660329  1736 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.661082  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:12.662096  1647 leader_election.cc:343] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.662458  1736 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.663165  1768 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.663552  1768 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.663892  1768 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:12.665177  1498 leader_election.cc:343] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.668716  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:12.658203  1752 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.669404  1752 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.669535  1535 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:12.669797  1752 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.672688  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.676198  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:12.676149  1769 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.677963  1832 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.690810  1752 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.694936  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:12.696626  1498 leader_election.cc:343] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.697774  1752 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.698905  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:12.699819  1832 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.700369  1768 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.703998  1725 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.704535  1725 ts_tablet_manager.cc:1403] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.004s
I20260709 13:01:12.706212  1727 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.706676  1727 ts_tablet_manager.cc:1403] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.151s	user 0.029s	sys 0.032s
I20260709 13:01:12.708535  1684 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:12.708300  1725 raft_consensus.cc:359] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.709133  1725 raft_consensus.cc:385] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.709405  1725 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.710099  1727 raft_consensus.cc:359] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.709988  1725 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.710354  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:12.710736  1727 raft_consensus.cc:385] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.710769  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.711151  1727 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.700417  1895 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.712764  1724 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.712100  1727 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.712110  1725 ts_tablet_manager.cc:1434] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:12.714833  1727 ts_tablet_manager.cc:1434] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:01:12.714959  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:12.715502  1533 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.715687  1727 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.715711  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:12.717235  1647 leader_election.cc:343] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.718432  1768 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.711127  1535 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:12.720748  1790 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.713218  1724 ts_tablet_manager.cc:1403] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.133s	user 0.032s	sys 0.016s
I20260709 13:01:12.724997  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.726667  1727 tablet_bootstrap.cc:654] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.726663  1826 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.732981  1533 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:12.733157  1769 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.734246  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.734193  1724 raft_consensus.cc:359] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.736146  1724 raft_consensus.cc:385] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.736433  1724 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.737349  1831 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.737094  1724 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.737833  1831 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:12.738794  1831 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.739399  1724 ts_tablet_manager.cc:1434] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.003s
I20260709 13:01:12.748121  1895 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.749316  1725 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.749176  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:12.750701  1647 leader_election.cc:343] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.751255  1790 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.754657  1826 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.755127  1826 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.757788  1724 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.764407  1826 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.766201  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.767412  1725 tablet_bootstrap.cc:654] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.768694  1724 tablet_bootstrap.cc:654] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:12.769701  1647 leader_election.cc:343] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.770723  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:12.775796  1648 leader_election.cc:343] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.777004  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.778534  1831 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.805061  1729 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.805856  1729 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.809937  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:12.810571  1684 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:12.812876  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:12.813606  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:12.814987  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:12.815935  1904 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:12.816354  1904 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.816711  1904 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.818285  1729 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.824702  1727 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.825219  1727 ts_tablet_manager.cc:1403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.110s	user 0.027s	sys 0.011s
W20260709 13:01:12.828655  1498 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.828969  1727 raft_consensus.cc:359] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.829758  1727 raft_consensus.cc:385] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.830020  1727 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.832433  1727 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.842698  1904 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.851469  1727 ts_tablet_manager.cc:1434] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:01:12.852741  1727 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.864619  1724 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.864451  1729 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:12.836796  1431 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.866940  1831 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.867437  1831 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.870747  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:12.872733  1647 leader_election.cc:343] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.873342  1831 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:12.865190  1724 ts_tablet_manager.cc:1403] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.108s	user 0.026s	sys 0.012s
I20260709 13:01:12.876344  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:12.881625  1648 leader_election.cc:343] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:12.882138  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:12.882324  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:12.882942  1684 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.883359  1826 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:12.874161  1904 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:12.889954  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:12.890619  1606 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:12.894033  1725 tablet_bootstrap.cc:492] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:12.894575  1725 ts_tablet_manager.cc:1403] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.017s
I20260709 13:01:12.900918  1727 tablet_bootstrap.cc:654] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.903484  1725 raft_consensus.cc:359] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.904271  1725 raft_consensus.cc:385] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.904556  1725 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.905387  1752 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.906201  1725 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.910902  1684 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:12.912606  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:12.913650  1904 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:12.914153  1904 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:12.905304  1724 raft_consensus.cc:359] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.915426  1724 raft_consensus.cc:385] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.914984  1904 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.915720  1724 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.916455  1724 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.920997  1724 ts_tablet_manager.cc:1434] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:01:12.921983  1724 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:12.934036  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:12.937400  1724 tablet_bootstrap.cc:654] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.959024  1725 ts_tablet_manager.cc:1434] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:01:12.960393  1725 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:12.970377  1725 tablet_bootstrap.cc:654] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:12.976008  1727 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:12.976575  1727 ts_tablet_manager.cc:1403] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.029s
I20260709 13:01:12.955317  1430 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.979898  1727 raft_consensus.cc:359] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.980729  1727 raft_consensus.cc:385] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.983518  1724 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:12.981109  1727 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.983989  1724 ts_tablet_manager.cc:1403] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.004s
I20260709 13:01:12.984563  1727 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.986581  1724 raft_consensus.cc:359] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.987612  1724 raft_consensus.cc:385] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:12.987890  1724 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:12.990535  1724 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:12.991588  1727 ts_tablet_manager.cc:1434] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:12.992640  1727 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:12.993309  1768 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:12.996942  1724 ts_tablet_manager.cc:1434] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:01:12.997888  1724 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.001253  1727 tablet_bootstrap.cc:654] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.018879  1831 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.022264  1725 tablet_bootstrap.cc:492] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.022786  1725 ts_tablet_manager.cc:1403] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.001s
I20260709 13:01:13.024653  1826 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.025568  1725 raft_consensus.cc:359] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.026314  1725 raft_consensus.cc:385] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.026618  1725 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.027274  1725 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.029366  1725 ts_tablet_manager.cc:1434] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:13.030119  1725 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.034713  1724 tablet_bootstrap.cc:654] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.035876  1725 tablet_bootstrap.cc:654] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.062592  1606 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.068193  1752 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.068815  1752 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.071098  1752 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.072907  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.073864  1682 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:13.075696  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:13.077648  1498 leader_election.cc:343] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.081650  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.082737  1904 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.083846  1904 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.084300  1904 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.093647  1904 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.098486  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:13.104383  1498 leader_election.cc:343] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.106954  1904 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.109865  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:13.110649  1682 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.130443  1682 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:13.130745  1724 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:13.131474  1724 ts_tablet_manager.cc:1403] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.038s
I20260709 13:01:13.134657  1727 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.135159  1727 ts_tablet_manager.cc:1403] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.143s	user 0.025s	sys 0.031s
I20260709 13:01:13.131848  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.137269  1752 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.137744  1752 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:13.139644  1724 raft_consensus.cc:359] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.140475  1724 raft_consensus.cc:385] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.140923  1724 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.140460  1752 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.141474  1724 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.143003  1724 ts_tablet_manager.cc:1434] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 13:01:13.143960  1724 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.144563  1826 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:13.159924  1725 tablet_bootstrap.cc:492] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.160925  1725 ts_tablet_manager.cc:1403] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.022s
I20260709 13:01:13.165305  1904 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.165855  1904 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.168934  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.170501  1724 tablet_bootstrap.cc:654] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:13.170796  1498 leader_election.cc:343] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.174659  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.175328  1682 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:13.176615  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.177495  1752 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.178411  1752 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.178785  1752 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.180446  1765 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.180953  1765 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.181443  1727 raft_consensus.cc:359] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.182178  1727 raft_consensus.cc:385] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.182474  1727 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.183084  1765 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.183185  1727 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.185943  1727 ts_tablet_manager.cc:1434] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.050s	user 0.001s	sys 0.005s
I20260709 13:01:13.188766  1727 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.190227  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:13.191812  1501 leader_election.cc:343] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.195417  1727 tablet_bootstrap.cc:654] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:13.199220  1647 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.203855  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.205717  1904 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:13.205901  1498 leader_election.cc:343] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.206651  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.207463  1725 raft_consensus.cc:359] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.208184  1725 raft_consensus.cc:385] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.208542  1725 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.208088  1904 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.212092  1725 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.217439  1725 ts_tablet_manager.cc:1434] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:01:13.218410  1725 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.222857  1724 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:13.223544  1724 ts_tablet_manager.cc:1403] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.007s
I20260709 13:01:13.226033  1725 tablet_bootstrap.cc:654] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.227113  1724 raft_consensus.cc:359] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.228096  1724 raft_consensus.cc:385] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.228477  1724 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.230036  1724 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.233424  1724 ts_tablet_manager.cc:1434] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:01:13.234779  1724 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.237779  1725 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.238250  1725 ts_tablet_manager.cc:1403] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:01:13.240823  1725 raft_consensus.cc:359] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.241482  1725 raft_consensus.cc:385] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.241755  1725 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.249735  1431 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.253962  1826 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.242429  1725 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.260253  1752 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.261561  1904 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.262066  1904 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.264492  1725 ts_tablet_manager.cc:1434] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:01:13.264930  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.265461  1725 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.265794  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:13.266167  1498 leader_election.cc:343] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.262940  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:13.266502  1682 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
W20260709 13:01:13.267918  1498 leader_election.cc:343] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.268206  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.269583  1765 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.270042  1765 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.270457  1765 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.276135  1904 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.279735  1725 tablet_bootstrap.cc:654] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.280123  1765 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.282284  1752 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.284108  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:13.284914  1684 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.286731  1736 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.287220  1736 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.287899  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:13.288367  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:13.288969  1682 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:13.289600  1498 leader_election.cc:343] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.291555  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.291194  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.293437  1736 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.293808  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:13.295651  1736 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.301878  1684 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:13.307694  1724 tablet_bootstrap.cc:654] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.309980  1682 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:13.311249  1609 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.312675  1727 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.313143  1727 ts_tablet_manager.cc:1403] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.125s	user 0.038s	sys 0.034s
I20260709 13:01:13.316309  1765 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.317611  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.318809  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.320382  1752 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.321317  1752 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:13.322110  1752 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.324482  1904 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.325021  1904 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:13.325857  1904 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.329860  1727 raft_consensus.cc:359] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.330588  1727 raft_consensus.cc:385] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.330865  1727 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.331544  1727 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.333748  1727 ts_tablet_manager.cc:1434] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:01:13.335777  1727 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.345682  1790 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.347091  1725 tablet_bootstrap.cc:492] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.348346  1725 ts_tablet_manager.cc:1403] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.034s
I20260709 13:01:13.349709  1727 tablet_bootstrap.cc:654] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.356639  1725 raft_consensus.cc:359] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.357442  1725 raft_consensus.cc:385] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.357714  1725 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.358389  1725 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.363375  1727 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.360654  1725 ts_tablet_manager.cc:1434] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:01:13.363857  1727 ts_tablet_manager.cc:1403] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:01:13.364627  1725 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.366964  1727 raft_consensus.cc:359] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.367617  1727 raft_consensus.cc:385] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.367883  1727 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.368577  1727 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.370580  1727 ts_tablet_manager.cc:1434] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:13.370795  1790 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.371455  1727 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.371228  1790 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.371629  1725 tablet_bootstrap.cc:654] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.373253  1790 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.373980  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.374513  1431 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:13.375523  1498 leader_election.cc:343] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.376987  1431 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.383139  1725 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.383651  1725 ts_tablet_manager.cc:1403] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:01:13.386046  1725 raft_consensus.cc:359] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.386613  1725 raft_consensus.cc:385] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.386894  1725 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.387620  1725 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.388690  1727 tablet_bootstrap.cc:654] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.383823  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.390678  1682 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:13.391795  1725 ts_tablet_manager.cc:1434] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:13.391893  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.393797  1904 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.394959  1725 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.394168  1904 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.398483  1904 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.401798  1725 tablet_bootstrap.cc:654] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.404716  1727 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.405177  1727 ts_tablet_manager.cc:1403] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:01:13.407724  1727 raft_consensus.cc:359] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.408468  1727 raft_consensus.cc:385] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.408731  1727 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.409392  1727 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.421916  1727 ts_tablet_manager.cc:1434] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:01:13.422972  1727 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.429414  1727 tablet_bootstrap.cc:654] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:13.432500  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:13.437830  1769 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.438405  1769 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.440697  1727 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.441190  1727 ts_tablet_manager.cc:1403] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:01:13.441072  1769 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.444408  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:13.445734  1648 leader_election.cc:343] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.446063  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.446918  1609 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:13.448307  1727 raft_consensus.cc:359] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.448589  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:13.449115  1727 raft_consensus.cc:385] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.449569  1727 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.449800  1896 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.450186  1896 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.450398  1727 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.450555  1896 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.453727  1727 ts_tablet_manager.cc:1434] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:01:13.454249  1724 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:13.454742  1724 ts_tablet_manager.cc:1403] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.008s
I20260709 13:01:13.457635  1724 raft_consensus.cc:359] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.458353  1724 raft_consensus.cc:385] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.458632  1724 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.459268  1724 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.465751  1727 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.469272  1904 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.472540  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:13.473882  1498 leader_election.cc:343] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.474596  1727 tablet_bootstrap.cc:654] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.475145  1752 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.479912  1724 ts_tablet_manager.cc:1434] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:13.483824  1896 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.488224  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:13.488440  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:13.488885  1535 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.488981  1606 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.494485  1904 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.500130  1727 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.500605  1727 ts_tablet_manager.cc:1403] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.014s
I20260709 13:01:13.501430  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:13.502063  1684 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.503288  1535 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:13.505272  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:13.506137  1769 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.506585  1769 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:13.507171  1727 raft_consensus.cc:359] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.507874  1727 raft_consensus.cc:385] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.508160  1727 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.507380  1769 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.508991  1727 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.510720  1727 ts_tablet_manager.cc:1434] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:01:13.511725  1727 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.514849  1725 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.515331  1725 ts_tablet_manager.cc:1403] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.025s
I20260709 13:01:13.517513  1684 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:13.521363  1736 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.522234  1736 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.524554  1736 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.526257  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.527382  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.528381  1727 tablet_bootstrap.cc:654] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.528430  1682 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:13.531006  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:13.532610  1736 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.535434  1725 raft_consensus.cc:359] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.536222  1725 raft_consensus.cc:385] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.536505  1725 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.539287  1606 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:13.485265  1724 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.542229  1725 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.549636  1725 ts_tablet_manager.cc:1434] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:01:13.554275  1736 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.522037  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.555629  1725 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.560228  1768 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.560781  1768 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.562947  1724 tablet_bootstrap.cc:654] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.562994  1768 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.564785  1904 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.560141  1896 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.565742  1904 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:13.566597  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:13.569624  1648 leader_election.cc:343] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.569785  1904 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.573452  1725 tablet_bootstrap.cc:654] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.576368  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:13.577857  1647 leader_election.cc:343] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.578346  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.580098  1896 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.587096  1936 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.588095  1936 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.591776  1936 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.596990  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.599124  1682 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:13.606443  1431 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.625789  1725 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.626425  1725 ts_tablet_manager.cc:1403] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.007s
W20260709 13:01:13.632695  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44480.9us
I20260709 13:01:13.634770  1727 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.634655  1736 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.635280  1727 ts_tablet_manager.cc:1403] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.124s	user 0.049s	sys 0.058s
I20260709 13:01:13.636179  1769 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.636615  1725 raft_consensus.cc:359] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.637801  1725 raft_consensus.cc:385] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.636759  1769 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.638113  1725 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.640784  1725 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.641559  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.638069  1727 raft_consensus.cc:359] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.643092  1727 raft_consensus.cc:385] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:13.643235  1648 leader_election.cc:343] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.643435  1727 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.644199  1727 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.638442  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.645464  1535 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:13.648140  1724 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:13.648101  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:13.648696  1724 ts_tablet_manager.cc:1403] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.014s
I20260709 13:01:13.649017  1936 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.649968  1769 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.651398  1724 raft_consensus.cc:359] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.652173  1724 raft_consensus.cc:385] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.652446  1724 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.653044  1724 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.655011  1724 ts_tablet_manager.cc:1434] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:13.635385  1736 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.656124  1724 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.658592  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.646469  1727 ts_tablet_manager.cc:1434] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:13.661062  1725 ts_tablet_manager.cc:1434] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:01:13.664470  1725 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.666646  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.669970  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:13.670666  1725 tablet_bootstrap.cc:654] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.670753  1972 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.661854  1727 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.660982  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.672331  1790 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.672109  1769 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.673652  1769 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:13.677821  1647 leader_election.cc:343] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.678637  1727 tablet_bootstrap.cc:654] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.678493  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.681516  1724 tablet_bootstrap.cc:654] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.682915  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.683691  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:13.684966  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:13.685856  1896 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.686534  1896 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.686827  1896 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.687211  1896 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.690055  1724 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:13.690543  1724 ts_tablet_manager.cc:1403] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:01:13.695904  1725 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:13.696408  1725 ts_tablet_manager.cc:1403] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:01:13.699806  1725 raft_consensus.cc:359] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.700507  1725 raft_consensus.cc:385] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.700840  1725 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.701442  1725 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.703801  1725 ts_tablet_manager.cc:1434] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:13.693171  1724 raft_consensus.cc:359] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.706199  1724 raft_consensus.cc:385] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.706523  1724 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.708422  1724 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.710564  1724 ts_tablet_manager.cc:1434] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:01:13.711351  1736 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.713567  1727 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:13.714085  1727 ts_tablet_manager.cc:1403] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.013s
I20260709 13:01:13.695749  1896 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.714444  1936 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.711517  1724 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:13.716778  1896 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.711982  1725 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:13.712458  1769 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.717974  1727 raft_consensus.cc:359] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.718704  1727 raft_consensus.cc:385] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:13.719002  1727 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:13.757308  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:13.765010  1768 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.769397  1752 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.766428  1768 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.759624  1535 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.714341  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.791632  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:13.794247  1768 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:13.783077  1727 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.798938  1604 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:13.800298  1647 leader_election.cc:343] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.801327  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:13.802603  1610 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.804725  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.805639  1533 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
W20260709 13:01:13.802428  1647 leader_election.cc:343] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.813954  1727 ts_tablet_manager.cc:1434] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.100s	user 0.010s	sys 0.000s
I20260709 13:01:13.816730  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:13.818513  1647 leader_election.cc:343] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.822846  1765 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:13.831108  1727 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:13.820524  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.842013  1765 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:13.824493  1768 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:13.844813  1768 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.851944  1768 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.866601  1736 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.867830  1736 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.870249  1727 tablet_bootstrap.cc:654] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.872444  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:13.877740  1725 tablet_bootstrap.cc:654] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.891652  1769 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.892051  1606 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.897542  1769 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.914449  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:13.916961  1648 leader_election.cc:343] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.889938  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:13.925112  1736 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.930032  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:13.931056  1681 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:13.932576  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:13.934258  1647 leader_election.cc:343] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:13.934696  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.935860  1826 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:13.937062  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:13.940248  1736 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:13.945230  1936 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.951797  1752 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.952486  1752 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.976019  1752 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:13.990671  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:13.992169  1896 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:13.996554  1896 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:13.987290  1826 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:01:13.997650  1896 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:13.998099  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:14.006325  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.007119  1682 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:14.001338  1752 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:14.020718  1724 tablet_bootstrap.cc:654] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:13.960767  1936 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.033223  1768 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.043612  1727 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.044190  1727 ts_tablet_manager.cc:1403] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.228s	user 0.024s	sys 0.015s
I20260709 13:01:14.059865  1727 raft_consensus.cc:359] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.061146  1727 raft_consensus.cc:385] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.061576  1727 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.063090  1727 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.063849  1831 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.069095  1498 leader_election.cc:343] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.072386  1826 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:14.072974  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:14.040540  1769 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.075964  1533 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.075821  1831 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.079813  1727 ts_tablet_manager.cc:1434] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 13:01:14.081110  1727 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:14.083701  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:14.075395  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53450.6us
I20260709 13:01:14.092279  1987 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.092715  1987 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:14.092844  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46749.1us
I20260709 13:01:14.093123  1987 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.092660  1936 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.093504  1752 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:14.098289  1831 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.101656  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.106208  1936 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.106494  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:14.107029  1936 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.107179  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.108709  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:14.109895  1647 leader_election.cc:343] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.104760  1831 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.118687  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.111456  1831 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.121361  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.121686  1725 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.122438  1725 ts_tablet_manager.cc:1403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.411s	user 0.015s	sys 0.008s
I20260709 13:01:14.123081  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:14.125120  1647 leader_election.cc:343] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:14.134382  1648 leader_election.cc:343] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.121742  1831 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.143913  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:14.148748  1724 tablet_bootstrap.cc:492] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.135782  1768 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.142697  1736 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.176822  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.143286  1936 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.269007  1433 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.312860  1768 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.313732  1768 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.327894  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.336906  1727 tablet_bootstrap.cc:654] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.346318  1995 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:14.354671  1533 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:14.364341  1724 ts_tablet_manager.cc:1403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.653s	user 0.025s	sys 0.018s
W20260709 13:01:14.369729  1647 leader_election.cc:343] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.370460  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.373586  1768 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.241290  1987 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.382283  1831 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.382965  1576 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:14.389045  1995 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:14.396623  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:14.398856  1648 leader_election.cc:343] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.404310  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.406433  1826 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.406332  1752 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:14.409807  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.410820  1533 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:14.399395  1724 raft_consensus.cc:359] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.411849  1724 raft_consensus.cc:385] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.413997  1724 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.403605  1831 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:14.415377  1831 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:14.414988  1724 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.416818  1724 ts_tablet_manager.cc:1434] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:01:14.416325  1831 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.417971  1724 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:14.429162  1987 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.432116  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:14.432911  1610 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:14.431367  1725 raft_consensus.cc:359] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.437350  1725 raft_consensus.cc:385] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.437450  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:14.437683  1725 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.438442  1725 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.442451  1725 ts_tablet_manager.cc:1434] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.320s	user 0.012s	sys 0.007s
I20260709 13:01:14.444943  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:14.445122  1498 leader_election.cc:343] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.455197  1769 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:14.460479  1769 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.460891  1769 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.467607  1725 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:14.468858  1724 tablet_bootstrap.cc:654] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.486611  1769 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.491559  1727 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.492116  1727 ts_tablet_manager.cc:1403] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.411s	user 0.017s	sys 0.004s
I20260709 13:01:14.505131  1979 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.505545  1724 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.506043  1979 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.507694  1724 ts_tablet_manager.cc:1403] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.001s
I20260709 13:01:14.509585  1979 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.511337  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:14.513675  1724 raft_consensus.cc:359] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.514387  1724 raft_consensus.cc:385] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.515039  1724 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.511852  1769 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.513163  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:14.514524  1647 leader_election.cc:343] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.515743  1724 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.511373  1727 raft_consensus.cc:359] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.516606  1605 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.516937  1727 raft_consensus.cc:385] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.517344  1727 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.518401  1724 ts_tablet_manager.cc:1434] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:01:14.518750  1727 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.519694  1724 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:14.521021  1727 ts_tablet_manager.cc:1434] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:01:14.522281  1727 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:14.527556  1724 tablet_bootstrap.cc:654] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:14.535804  1647 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.554451  1605 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:14.556219  1725 tablet_bootstrap.cc:654] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.557813  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:14.564787  1987 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:01:14.562108  1769 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:01:14.563663  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90766.7us
I20260709 13:01:14.580093  1769 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:14.588249  1769 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.592515  1727 tablet_bootstrap.cc:654] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.596673  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:14.597337  1534 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.607807  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.608574  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:14.609182  1684 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.610929  1995 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.607198  1534 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:14.611433  1995 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.611773  1433 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.618839  1995 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:14.619765  1648 leader_election.cc:343] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.619055  1826 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:14.620113  1765 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.621573  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.628477  1683 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:14.627883  1765 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.630330  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:14.631547  1995 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.631681  1765 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.623701  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.624754  1724 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.632861  1534 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:14.631935  1995 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.634459  1995 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.633720  1724 ts_tablet_manager.cc:1403] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.017s
I20260709 13:01:14.626526  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.640688  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:14.640688  1684 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:14.641613  1769 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.653851  1725 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.656595  1725 ts_tablet_manager.cc:1403] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.189s	user 0.008s	sys 0.011s
I20260709 13:01:14.667320  1769 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.668507  1769 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.669736  1727 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.670257  1727 ts_tablet_manager.cc:1403] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.013s
I20260709 13:01:14.671955  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.666296  1724 raft_consensus.cc:359] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.672679  1724 raft_consensus.cc:385] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.673012  1724 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.672083  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:14.677582  1647 leader_election.cc:343] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.690657  1724 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.691751  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:14.692145  1648 leader_election.cc:343] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.692608  1987 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:14.695776  1727 raft_consensus.cc:359] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.696547  1727 raft_consensus.cc:385] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.696784  1987 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:14.685855  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.697584  1682 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:14.697875  1987 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.698889  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.699709  1826 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.673780  1769 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.696815  1727 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.686026  1725 raft_consensus.cc:359] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.711360  1727 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.711768  1725 raft_consensus.cc:385] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.712103  1725 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.712792  1725 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.713666  1727 ts_tablet_manager.cc:1434] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:01:14.714624  1727 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:14.714962  1725 ts_tablet_manager.cc:1434] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:01:14.683655  1433 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 2, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.687327  1995 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.716766  1605 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 1: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:14.720919  1727 tablet_bootstrap.cc:654] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.721575  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.722271  1724 ts_tablet_manager.cc:1434] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.006s
I20260709 13:01:14.723287  1724 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:14.727764  1725 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:14.723165  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:14.738408  1433 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.723807  1765 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.723925  2004 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.732666  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:14.733405  1995 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.742722  1684 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.741662  2004 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.743523  1535 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.745625  2004 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:14.747146  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:14.748672  1648 leader_election.cc:343] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.752453  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:14.756846  1647 leader_election.cc:343] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.757267  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.760313  1725 tablet_bootstrap.cc:654] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.764700  2004 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:14.765635  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:14.767143  1765 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.767540  1765 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.767344  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:14.768882  1995 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:14.769500  1995 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:14.770547  1995 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:14.774607  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:14.778236  1765 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.780450  1727 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.780946  1727 ts_tablet_manager.cc:1403] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.066s	user 0.039s	sys 0.023s
I20260709 13:01:14.781811  1684 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:14.790462  1724 tablet_bootstrap.cc:654] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.789938  1727 raft_consensus.cc:359] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.792186  1727 raft_consensus.cc:385] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.792615  1727 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.793533  1727 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.796473  1727 ts_tablet_manager.cc:1434] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:01:14.797734  1727 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:14.806190  1431 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.810592  1724 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.811092  1724 ts_tablet_manager.cc:1403] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 13:01:14.811937  1727 tablet_bootstrap.cc:654] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.813639  1724 raft_consensus.cc:359] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.814352  1724 raft_consensus.cc:385] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.814630  1724 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.815279  1724 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.816900  1724 ts_tablet_manager.cc:1434] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
W20260709 13:01:14.816998  1647 consensus_peers.cc:597] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.817673  1724 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:14.821527  1725 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.822002  1725 ts_tablet_manager.cc:1403] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.010s
I20260709 13:01:14.824687  1725 raft_consensus.cc:359] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.825357  1725 raft_consensus.cc:385] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.825627  1725 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.826290  1725 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.828236  1725 ts_tablet_manager.cc:1434] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:14.829306  1725 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:14.835530  1724 tablet_bootstrap.cc:654] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.839325  1725 tablet_bootstrap.cc:654] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.843472  1987 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.844245  1987 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.848824  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.849778  1684 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:14.851558  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:14.852909  2000 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.853539  2000 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.853962  2000 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.860754  1725 tablet_bootstrap.cc:492] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.861466  1725 ts_tablet_manager.cc:1403] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 13:01:14.865499  1725 raft_consensus.cc:359] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.866580  1725 raft_consensus.cc:385] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.866961  1725 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.867563  1725 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.870419  1725 ts_tablet_manager.cc:1434] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:14.874478  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:14.876736  1498 leader_election.cc:343] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:14.877947  1725 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:14.882668  1987 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.883659  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:14.886449  1765 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.887722  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:14.888511  1684 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.904826  1725 tablet_bootstrap.cc:654] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.910549  1727 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.911154  1727 ts_tablet_manager.cc:1403] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.114s	user 0.059s	sys 0.043s
I20260709 13:01:14.913792  1995 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.914467  1995 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.915572  1684 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:14.916744  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:14.917238  1972 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.917706  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.918033  1987 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:14.917763  1972 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.918617  1535 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:14.918551  1987 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:14.919447  1987 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.920501  1725 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.921548  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.921820  1725 ts_tablet_manager.cc:1403] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.003s
I20260709 13:01:14.922195  1972 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.921592  2000 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.923159  1724 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.923071  1995 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.923871  1724 ts_tablet_manager.cc:1403] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.106s	user 0.037s	sys 0.033s
I20260709 13:01:14.924443  1727 raft_consensus.cc:359] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.925134  1727 raft_consensus.cc:385] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.924830  1725 raft_consensus.cc:359] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.925428  1727 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.925499  1725 raft_consensus.cc:385] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.925869  1725 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.926177  1727 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.926517  1725 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.927579  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.927368  1724 raft_consensus.cc:359] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.928712  1724 raft_consensus.cc:385] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.929112  1724 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.930199  1725 ts_tablet_manager.cc:1434] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:14.928767  1727 ts_tablet_manager.cc:1434] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:01:14.931339  1727 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:14.928968  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:14.935930  1725 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:14.929814  1724 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.938719  1724 ts_tablet_manager.cc:1434] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:01:14.939746  1724 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:14.928449  1682 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:14.943778  1725 tablet_bootstrap.cc:654] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.945849  1727 tablet_bootstrap.cc:654] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.946277  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:14.947620  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:14.948159  1972 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.951803  1724 tablet_bootstrap.cc:654] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:14.951372  1972 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.953764  1972 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.954245  1972 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.948647  1995 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.957525  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:14.958357  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:14.959786  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:14.967358  2026 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.967770  2026 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.968137  2026 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.975878  1727 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:14.977582  1727 ts_tablet_manager.cc:1403] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.004s
I20260709 13:01:14.979614  2026 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.981778  2026 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:14.975864  1724 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:14.983381  1724 ts_tablet_manager.cc:1403] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.007s
I20260709 13:01:14.986907  1725 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:14.991820  1725 ts_tablet_manager.cc:1403] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.016s
I20260709 13:01:14.986635  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:14.993772  1534 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:14.994726  1725 raft_consensus.cc:359] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.995422  1725 raft_consensus.cc:385] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.995697  1725 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:14.996320  1725 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:14.999378  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.004823  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.025486  1725 ts_tablet_manager.cc:1434] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.011s
I20260709 13:01:15.027040  1725 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.030458  1683 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.033643  1995 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.036481  1768 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.036959  1768 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.038763  1768 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.039219  1972 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.040531  2028 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.041154  2028 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.035813  2000 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.043776  2028 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.044620  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.049116  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:15.051339  1609 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:15.052983  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.055297  1725 tablet_bootstrap.cc:654] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.055788  1979 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.058358  2004 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:15.058947  1647 leader_election.cc:343] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.053004  1498 leader_election.cc:343] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.060309  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.060971  1682 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:15.062071  1576 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:15.063031  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.066083  2029 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:14.990322  1724 raft_consensus.cc:359] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.066463  1725 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.066632  1724 raft_consensus.cc:385] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:14.981824  1727 raft_consensus.cc:359] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.067107  1727 raft_consensus.cc:385] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.066501  2029 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.066874  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:15.067698  2029 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.066970  1725 ts_tablet_manager.cc:1403] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.008s
I20260709 13:01:15.069803  1605 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.071404  1725 raft_consensus.cc:359] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.072131  1725 raft_consensus.cc:385] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.072438  1725 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.067572  1727 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.072922  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.073448  1684 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.075134  1535 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:15.066980  1724 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.074277  1725 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.068491  2026 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.082027  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.082445  1725 ts_tablet_manager.cc:1434] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 13:01:15.080500  1724 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.088621  1684 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.085336  1431 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 2, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.080556  1683 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:15.093732  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.094414  1725 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.094492  2000 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.095150  2000 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.095947  2000 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.099997  1724 ts_tablet_manager.cc:1434] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.004s
I20260709 13:01:15.097596  1987 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.101329  1724 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
W20260709 13:01:15.105266  1648 leader_election.cc:343] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.105727  1648 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.106755  1896 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:15.104598  1574 leader_election.cc:343] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.101673  1987 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.110911  1987 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.111893  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.112761  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.113838  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.116379  1727 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.098011  2026 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:15.123800  1727 ts_tablet_manager.cc:1434] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.003s
I20260709 13:01:15.126221  1999 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.126711  1999 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.128448  1999 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.129207  1896 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.135753  1987 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.135488  2026 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.138046  1727 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:15.144671  1433 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.154758  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:15.164331  1498 leader_election.cc:343] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.150179  1999 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.164702  2029 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.183669  1752 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.195166  2028 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.212821  1725 tablet_bootstrap.cc:654] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.216780  2029 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.227639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:15.228780  1574 leader_election.cc:343] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.236425  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.237110  1680 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.237197  1724 tablet_bootstrap.cc:654] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.212878  1752 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.242492  1752 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.222626  2028 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.243923  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.245698  1683 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.246068  1531 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:15.246567  2028 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.247047  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.248641  1752 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.250833  1752 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.252664  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.254207  1682 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:15.254029  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.254774  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.251247  1752 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.255635  1681 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:15.256953  1995 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.257675  1995 consensus_queue.cc:1243] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:01:15.258134  1972 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.258960  1995 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:15.259301  1995 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:15.258167  1498 leader_election.cc:343] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.265975  1680 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:15.273384  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:15.274256  2028 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.275206  1576 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:15.276068  1972 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.276542  1972 raft_consensus.cc:697] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:15.276304  1995 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.277602  1995 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:15.277321  1972 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.281914  1430 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.293359  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:15.294212  2036 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:01:15.294425  1999 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:15.295945  1498 leader_election.cc:343] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.299914  1727 tablet_bootstrap.cc:654] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.308115  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.311304  1680 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.322889  1752 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.339394  1680 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.346199  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.348666  2000 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.349818  2028 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.350011  2000 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.350608  2000 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.351436  2000 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.352782  1725 tablet_bootstrap.cc:492] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.353215  1725 ts_tablet_manager.cc:1403] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.259s	user 0.020s	sys 0.034s
I20260709 13:01:15.357712  1725 raft_consensus.cc:359] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.359373  1725 raft_consensus.cc:385] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.359750  1725 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.360630  1725 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.362254  1725 ts_tablet_manager.cc:1434] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:15.363209  1725 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.365559  1724 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.369472  1724 ts_tablet_manager.cc:1403] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.032s
I20260709 13:01:15.369501  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.370296  1684 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.371292  1725 tablet_bootstrap.cc:654] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.368201  1752 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.368608  1727 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:15.378060  1727 ts_tablet_manager.cc:1403] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.002s
I20260709 13:01:15.381693  1724 raft_consensus.cc:359] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.385334  1724 raft_consensus.cc:385] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.385715  1724 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.386060  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.386441  1724 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.388784  1724 ts_tablet_manager.cc:1434] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:01:15.383908  1727 raft_consensus.cc:359] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.389734  1727 raft_consensus.cc:385] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.390082  1727 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
W20260709 13:01:15.390503  1498 leader_election.cc:343] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.390882  1727 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.392935  1431 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.394172  1684 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.395694  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.397163  1752 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.397886  1752 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.399171  1752 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.409256  1727 ts_tablet_manager.cc:1434] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:01:15.411266  1725 tablet_bootstrap.cc:492] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.412192  1724 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:15.412716  1725 ts_tablet_manager.cc:1403] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.011s
I20260709 13:01:15.415643  1725 raft_consensus.cc:359] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.417230  1727 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:15.423691  1727 tablet_bootstrap.cc:654] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.416525  1725 raft_consensus.cc:385] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.426010  1724 tablet_bootstrap.cc:654] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.426357  1725 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.427073  1725 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.429527  1725 ts_tablet_manager.cc:1434] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:01:15.430497  1725 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.435770  1790 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.436493  1790 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.439505  1896 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.440958  1790 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.439990  1896 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.444780  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.445124  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.445736  1605 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
W20260709 13:01:15.446602  1648 leader_election.cc:343] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.448760  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.449189  1605 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:01:15.449721  1605 pending_rounds.cc:85] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 0
W20260709 13:01:15.450059  1647 leader_election.cc:343] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.450497  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.451306  1768 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.451525  1725 tablet_bootstrap.cc:654] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.450060  1605 pending_rounds.cc:107] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:01:15.456166  1605 raft_consensus.cc:2889] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.457517  1896 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.459883  1680 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:15.464007  1999 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.466379  1725 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.467049  1725 ts_tablet_manager.cc:1403] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 13:01:15.470745  1725 raft_consensus.cc:359] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.471542  1725 raft_consensus.cc:385] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.471880  1725 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.472604  1725 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.473102  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:15.475255  1725 ts_tablet_manager.cc:1434] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:15.476478  1725 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.478117  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.478960  1684 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.479501  1727 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:15.479923  1727 ts_tablet_manager.cc:1403] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.006s
I20260709 13:01:15.482530  1727 raft_consensus.cc:359] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.485328  1724 tablet_bootstrap.cc:492] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.485810  1724 ts_tablet_manager.cc:1403] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.006s
I20260709 13:01:15.488518  1724 raft_consensus.cc:359] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.489459  1724 raft_consensus.cc:385] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.489724  1724 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.490559  1724 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.492693  1724 ts_tablet_manager.cc:1434] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:15.483177  1727 raft_consensus.cc:385] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.507732  1727 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.508282  1987 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.508906  1987 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.508814  1727 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.496191  1725 tablet_bootstrap.cc:654] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.509497  1987 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.512180  1724 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:15.518333  1727 ts_tablet_manager.cc:1434] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.003s
W20260709 13:01:15.518504  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45498.3us
I20260709 13:01:15.519999  1727 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:15.519968  1999 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.532462  1724 tablet_bootstrap.cc:654] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.528934  1727 tablet_bootstrap.cc:654] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.546589  1724 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.547210  1724 ts_tablet_manager.cc:1403] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:01:15.551213  1724 raft_consensus.cc:359] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.556964  1724 raft_consensus.cc:385] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.557246  1724 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.557861  1724 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.560582  1724 ts_tablet_manager.cc:1434] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:01:15.556524  1727 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:15.561882  1727 ts_tablet_manager.cc:1403] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 13:01:15.563143  1724 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:15.564819  1727 raft_consensus.cc:359] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.565637  1727 raft_consensus.cc:385] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.565945  1727 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.566351  1790 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.566602  1727 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.566895  1790 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.569242  1790 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.569344  1727 ts_tablet_manager.cc:1434] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:15.572667  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.595309  1683 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.581542  2000 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.596304  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.584249  1724 tablet_bootstrap.cc:654] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.595800  1727 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:15.596592  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.598327  1987 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.596612  1972 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:01:15.605180  1727 tablet_bootstrap.cc:654] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.621567  1752 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.622110  1752 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.622498  1752 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.626269  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.627104  1987 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.627159  1680 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.630482  1725 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.630980  1725 ts_tablet_manager.cc:1403] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.155s	user 0.038s	sys 0.049s
I20260709 13:01:15.633561  1725 raft_consensus.cc:359] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.634265  1725 raft_consensus.cc:385] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.634544  1725 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.638818  1724 tablet_bootstrap.cc:492] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.639292  1724 ts_tablet_manager.cc:1403] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.013s
I20260709 13:01:15.642429  1725 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.644100  1725 ts_tablet_manager.cc:1434] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:01:15.645035  1725 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.646325  1680 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.647636  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:15.648772  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54306us
I20260709 13:01:15.650498  2000 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.650962  2000 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.651742  2000 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.652125  1904 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.654054  1724 raft_consensus.cc:359] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.654764  1724 raft_consensus.cc:385] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.655062  1724 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.655637  1724 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.657603  1724 ts_tablet_manager.cc:1434] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:01:15.658528  1724 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:15.659458  1725 tablet_bootstrap.cc:654] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:15.666049  1498 leader_election.cc:343] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.668944  1752 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.671281  1724 tablet_bootstrap.cc:654] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.672748  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.673815  1680 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.676546  1725 tablet_bootstrap.cc:492] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:15.677065  1725 ts_tablet_manager.cc:1403] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 13:01:15.677587  1724 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.678041  1724 ts_tablet_manager.cc:1403] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:01:15.681931  1724 raft_consensus.cc:359] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.682618  1724 raft_consensus.cc:385] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.682891  1724 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.683503  1724 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.684010  1725 raft_consensus.cc:359] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.684756  1725 raft_consensus.cc:385] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.685031  1725 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.685742  1724 ts_tablet_manager.cc:1434] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:15.685541  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.685262  1432 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.686901  1724 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:15.686486  1605 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.687692  1725 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.691751  1725 ts_tablet_manager.cc:1434] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:15.693383  1724 tablet_bootstrap.cc:654] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.695263  1725 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:15.706840  1972 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:15.715765  1904 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.716580  1904 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.717392  1972 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.719679  1904 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.723313  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.732105  1790 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.733152  1790 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.734911  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.735569  1684 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.738646  1896 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.739199  1896 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.741164  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.744150  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.744908  1535 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:15.746387  1765 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.746879  1765 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.747239  1765 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.748716  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.749873  1768 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.750296  1768 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.750609  1768 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.755983  1896 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.761446  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:15.764704  1647 leader_election.cc:343] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.766021  1790 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.768175  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.768850  1684 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.770605  1768 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.768437  1765 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.783138  1769 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.794502  1769 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.797384  1769 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.794512  1972 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.799163  1972 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.801156  1765 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.790390  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:15.801869  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.806802  1790 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:15.807348  1790 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.807734  1790 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.807564  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:15.810650  1647 leader_election.cc:343] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.811960  1648 leader_election.cc:343] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.813041  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.814114  1979 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.817257  1752 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.823869  1727 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:15.824481  1727 ts_tablet_manager.cc:1403] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.229s	user 0.044s	sys 0.011s
I20260709 13:01:15.806217  1972 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.827735  1752 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.829279  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:15.828141  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:15.833417  1768 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.838224  1535 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.850147  1752 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.855805  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.860788  1534 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.860829  1609 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.861310  1727 raft_consensus.cc:359] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.862293  1727 raft_consensus.cc:385] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:15.862730  1727 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:15.848443  2028 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.868214  1727 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.868963  1680 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:15.867619  1498 leader_election.cc:343] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.872547  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.874817  1752 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.878705  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.883047  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.883834  1724 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:15.885265  1724 ts_tablet_manager.cc:1403] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.199s	user 0.057s	sys 0.087s
I20260709 13:01:15.891705  1725 tablet_bootstrap.cc:654] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:15.873278  2028 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.893463  1605 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.880429  1904 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:15.900636  1647 leader_election.cc:343] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:15.904155  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:15.905627  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.906396  1727 ts_tablet_manager.cc:1434] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 13:01:15.883823  1602 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:15.907428  1727 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:15.909076  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.909657  1609 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.906210  1681 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.913646  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.914546  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:15.894624  2070 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.916193  2070 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.920109  2070 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:15.919292  2028 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.909714  1904 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.931304  1904 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.932430  1604 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.938761  1609 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.941296  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:15.943607  1648 leader_election.cc:343] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.945225  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:15.942982  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:15.948089  1647 leader_election.cc:343] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:15.948542  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.951032  1752 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:15.951640  1752 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:15.952324  1752 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.952551  1790 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:15.954602  1790 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:15.954668  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.952551  1769 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.955402  1684 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:15.959913  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:15.960604  1684 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:15.963027  1501 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:15.965278  1765 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:15.964226  1790 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:15.965663  1987 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:15.967397  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:15.968992  1684 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.979276  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:15.980177  1607 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:15.968848  1681 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:15.998030  1727 tablet_bootstrap.cc:654] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.000629  1535 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:16.001967  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.003212  1769 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.003623  1769 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:16.004336  1769 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.009666  1684 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:15.964421  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99535.8us
I20260709 13:01:16.011085  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:16.020563  1725 tablet_bootstrap.cc:492] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.021277  1725 ts_tablet_manager.cc:1403] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.326s	user 0.017s	sys 0.008s
I20260709 13:01:16.028613  1609 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.036281  1752 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.023219  1904 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.040132  1904 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:16.041024  1904 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.047683  1752 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.087164  1724 raft_consensus.cc:359] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.088281  1724 raft_consensus.cc:385] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.088650  1724 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.089540  1724 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.093924  1725 raft_consensus.cc:359] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.094657  1725 raft_consensus.cc:385] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.094918  1725 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.095551  1725 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.095678  1607 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:16.100417  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.101598  1724 ts_tablet_manager.cc:1434] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.216s	user 0.009s	sys 0.001s
I20260709 13:01:16.102671  1724 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.104007  1725 ts_tablet_manager.cc:1434] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.002s
I20260709 13:01:16.105005  1725 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.106441  1752 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.113899  1727 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:16.114408  1727 ts_tablet_manager.cc:1403] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.003s
I20260709 13:01:16.126622  1727 raft_consensus.cc:359] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.127594  1727 raft_consensus.cc:385] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.127879  1727 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.142938  1727 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.146605  1727 ts_tablet_manager.cc:1434] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:01:16.146260  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:16.148718  1727 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:16.148582  2071 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.153227  1430 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.159327  1430 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.165431  1430 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.167631  1430 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.172495  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:16.173796  2071 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.174357  1972 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:16.209498  2077 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:16.220479  1725 tablet_bootstrap.cc:654] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.237772  1724 tablet_bootstrap.cc:654] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.250216  2071 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.250928  2071 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.254339  2071 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.257800  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.259479  1727 tablet_bootstrap.cc:654] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.262214  1724 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.262669  1724 ts_tablet_manager.cc:1403] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.004s
I20260709 13:01:16.268291  1725 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.268778  1725 ts_tablet_manager.cc:1403] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.164s	user 0.026s	sys 0.031s
I20260709 13:01:16.269330  1724 raft_consensus.cc:359] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.283809  1724 raft_consensus.cc:385] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.284420  1724 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.296327  1769 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.296828  1769 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.294467  1904 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:16.297758  1724 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.298655  1769 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.300807  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:16.299875  1724 ts_tablet_manager.cc:1434] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.009s
I20260709 13:01:16.302574  1724 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.304450  1725 raft_consensus.cc:359] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.305104  1725 raft_consensus.cc:385] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.305394  1725 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.306046  1725 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.307551  1725 ts_tablet_manager.cc:1434] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:01:16.308694  1725 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
W20260709 13:01:16.311419  1647 leader_election.cc:343] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.318308  1725 tablet_bootstrap.cc:654] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.321195  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.321784  1432 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:16.323130  1648 leader_election.cc:343] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.323789  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.324523  1896 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.324644  1904 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.325132  1904 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.327386  1904 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.329603  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:16.331072  1498 leader_election.cc:343] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.331889  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.332828  1680 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:16.343858  1725 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.344370  1725 ts_tablet_manager.cc:1403] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:01:16.346837  1725 raft_consensus.cc:359] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.347501  1725 raft_consensus.cc:385] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.347765  1725 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.348605  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.348620  1725 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.350201  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:16.350637  1725 ts_tablet_manager.cc:1434] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:16.351045  2084 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.351648  1725 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.357908  1724 tablet_bootstrap.cc:654] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.358459  1725 tablet_bootstrap.cc:654] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.360388  1430 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:16.363420  1501 leader_election.cc:343] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.363961  1501 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.365723  2000 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.368171  1769 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.368800  1769 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.370944  1769 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.368105  1727 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:16.371727  1727 ts_tablet_manager.cc:1403] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.223s	user 0.003s	sys 0.012s
I20260709 13:01:16.372076  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:16.372519  1725 tablet_bootstrap.cc:492] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.372951  1725 ts_tablet_manager.cc:1403] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.010s
W20260709 13:01:16.373422  1647 leader_election.cc:343] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.375300  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.375331  1725 raft_consensus.cc:359] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.376143  1725 raft_consensus.cc:385] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.376075  1531 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:16.376528  1725 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.377249  1725 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.378129  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.378887  1725 ts_tablet_manager.cc:1434] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:16.379463  1972 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.370774  2084 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.379969  1972 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.382000  1724 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.382467  1724 ts_tablet_manager.cc:1403] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:01:16.382802  1972 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.384461  1725 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.384989  1724 raft_consensus.cc:359] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.385673  1724 raft_consensus.cc:385] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.385931  1724 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.386647  1724 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.388520  1724 ts_tablet_manager.cc:1434] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:16.390049  1724 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.399718  1724 tablet_bootstrap.cc:654] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.400862  1725 tablet_bootstrap.cc:654] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.400460  1999 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.406056  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.406755  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.407625  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.408536  2084 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.408865  2084 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.409180  2084 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.416355  1724 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.416642  1725 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.416837  1724 ts_tablet_manager.cc:1403] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 13:01:16.417038  1725 ts_tablet_manager.cc:1403] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.014s
I20260709 13:01:16.420590  2084 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.420888  1724 raft_consensus.cc:359] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.421612  1724 raft_consensus.cc:385] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.421882  1724 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
W20260709 13:01:16.422937  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44901.4us
I20260709 13:01:16.423532  2070 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.423907  2070 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.424284  2070 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.425817  1725 raft_consensus.cc:359] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.426527  1725 raft_consensus.cc:385] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.426795  1725 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.426962  1727 raft_consensus.cc:359] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.427626  1727 raft_consensus.cc:385] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.427413  1725 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.427932  1727 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.428650  1727 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.429569  1725 ts_tablet_manager.cc:1434] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:16.430526  1727 ts_tablet_manager.cc:1434] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:01:16.431509  1727 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:16.434517  2000 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.434844  1724 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.435956  2000 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.436491  2000 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.438664  2000 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.439405  1725 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.439775  2084 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.440021  1727 tablet_bootstrap.cc:654] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.440713  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:16.441826  1531 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.446759  1724 ts_tablet_manager.cc:1434] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:01:16.449306  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:16.450369  1725 tablet_bootstrap.cc:654] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.451741  1498 leader_election.cc:343] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.456614  1531 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.462770  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.464061  2084 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.464570  2084 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:16.465323  2084 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.466845  1724 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.473685  1724 tablet_bootstrap.cc:654] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.489179  1724 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.489650  1724 ts_tablet_manager.cc:1403] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:01:16.492653  1724 raft_consensus.cc:359] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.493353  1724 raft_consensus.cc:385] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.493598  1724 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.496246  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.497159  1683 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.497931  1725 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.498370  1725 ts_tablet_manager.cc:1403] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.011s
I20260709 13:01:16.499042  1724 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.505051  1724 ts_tablet_manager.cc:1434] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:01:16.506551  1725 raft_consensus.cc:359] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.507315  1725 raft_consensus.cc:385] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.507580  1725 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.508761  1727 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:16.508379  1725 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.510928  1769 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.512111  1727 ts_tablet_manager.cc:1403] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.000s
I20260709 13:01:16.512058  1769 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.514122  1769 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.515596  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:16.515467  1727 raft_consensus.cc:359] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.516292  1727 raft_consensus.cc:385] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.516683  1727 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.516795  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.511538  1724 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.517426  1531 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 0.
I20260709 13:01:16.517359  1727 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.518798  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:16.520056  1769 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.520248  1727 ts_tablet_manager.cc:1434] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:01:16.519781  1647 leader_election.cc:343] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.520710  1725 ts_tablet_manager.cc:1434] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:01:16.520737  1769 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.521365  1769 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.522081  1727 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:16.522356  1725 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.529922  1725 tablet_bootstrap.cc:654] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.533236  1769 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.534770  2070 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.552780  1979 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.536015  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:16.554437  1531 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.555043  2070 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.537396  1724 tablet_bootstrap.cc:654] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.556687  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:16.557272  1606 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.560408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.562498  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:16.563123  1533 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.565402  1790 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.537549  1727 tablet_bootstrap.cc:654] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.537856  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:16.573359  1647 leader_election.cc:343] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.538357  1769 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.540421  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:16.541923  1725 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.574308  1680 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.574463  1725 ts_tablet_manager.cc:1403] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.005s
I20260709 13:01:16.574694  1533 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:16.549719  1604 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.577590  1725 raft_consensus.cc:359] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.578270  1725 raft_consensus.cc:385] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.578510  1725 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.579258  1725 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:16.547618  1710 tablet.cc:2406] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:16.581964  1725 ts_tablet_manager.cc:1434] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:16.582904  1790 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.575390  1531 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:16.585436  2070 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.582914  1725 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.590090  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:16.591485  1501 leader_election.cc:343] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.592084  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.593171  1790 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.593317  1769 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.594485  1769 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:16.595652  1769 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.591518  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.599526  1725 tablet_bootstrap.cc:654] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.599871  2069 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.601241  2069 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:16.602078  1790 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.602949  1724 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.602398  2069 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.604668  1724 ts_tablet_manager.cc:1403] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.008s
I20260709 13:01:16.606370  1790 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.609097  1680 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.621721  1606 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:16.620514  1724 raft_consensus.cc:359] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.631379  2084 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.644959  1724 raft_consensus.cc:385] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.645465  1724 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.645112  2084 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.646353  1724 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.647656  2084 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.649412  1724 ts_tablet_manager.cc:1434] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:01:16.649391  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.650175  1681 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.650612  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.650841  1724 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.651230  1531 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.651612  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.652725  1972 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.653085  1972 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.653424  1972 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.653967  1769 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.654701  1769 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.636651  1725 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.686196  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.683933  1431 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.703043  1972 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.707526  1724 tablet_bootstrap.cc:654] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.708585  1725 ts_tablet_manager.cc:1403] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.003s
W20260709 13:01:16.710161  1648 leader_election.cc:343] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.719756  1972 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.725937  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:16.726511  1535 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.727090  1725 raft_consensus.cc:359] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.727752  1725 raft_consensus.cc:385] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.727998  1725 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.729471  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:16.730170  1683 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.730290  1725 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.732807  1725 ts_tablet_manager.cc:1434] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:01:16.733736  1725 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.734735  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:16.736399  1647 leader_election.cc:343] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:16.736809  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:16.737489  2070 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:16.739857  1769 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:16.746289  1535 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.748322  1683 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.756953  1727 tablet_bootstrap.cc:492] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:16.757465  1727 ts_tablet_manager.cc:1403] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.011s
I20260709 13:01:16.744369  1972 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.760007  1727 raft_consensus.cc:359] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.767171  1727 raft_consensus.cc:385] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.767407  1727 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.773263  1430 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.761168  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.760906  1972 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.784078  2084 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.778203  1430 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.785948  1727 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.791703  1727 ts_tablet_manager.cc:1434] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.034s	user 0.000s	sys 0.006s
I20260709 13:01:16.787992  2084 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:16.793668  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.794387  1535 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.793941  2084 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.798283  1727 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:16.798748  1972 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.795686  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.796320  1725 tablet_bootstrap.cc:654] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.803941  1972 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.804425  1972 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.804944  1972 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.807662  1727 tablet_bootstrap.cc:654] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.812291  1724 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.812899  1724 ts_tablet_manager.cc:1403] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.162s	user 0.037s	sys 0.020s
I20260709 13:01:16.818758  1724 raft_consensus.cc:359] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.819669  1724 raft_consensus.cc:385] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.820022  1724 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.820406  1765 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.820951  1765 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.821231  1724 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.823695  1972 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.832320  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:16.833092  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:16.834960  1972 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.836603  1724 ts_tablet_manager.cc:1434] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:01:16.837852  1724 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.838510  1765 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.837657  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.839928  1765 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:16.840622  1765 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.840830  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.839887  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:16.844370  1683 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:16.845177  1765 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.845184  1534 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.853075  1724 tablet_bootstrap.cc:654] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.871132  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.871871  1683 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:16.871337  1765 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.873059  1725 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:16.873631  1725 ts_tablet_manager.cc:1403] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.019s
I20260709 13:01:16.874791  1727 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:16.874929  1765 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.875223  1727 ts_tablet_manager.cc:1403] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.014s
I20260709 13:01:16.875946  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:16.876565  1606 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.878832  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:16.879482  1682 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.878388  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:16.880733  1680 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.882360  1725 raft_consensus.cc:359] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.884267  1725 raft_consensus.cc:385] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.884712  1725 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.885727  1725 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.886323  1534 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.888175  1725 ts_tablet_manager.cc:1434] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:16.892632  1682 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:16.888170  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:16.896941  1972 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.897482  1972 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:16.897797  1727 raft_consensus.cc:359] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.898542  1680 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:16.898334  1972 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.900337  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:16.902149  1999 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:16.902688  1999 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:16.903014  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:16.898387  1727 raft_consensus.cc:385] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.908864  1727 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.912530  1724 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:16.913017  1724 ts_tablet_manager.cc:1403] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.000s
I20260709 13:01:16.903555  1999 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.923460  1725 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:16.927090  1727 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.930814  1724 raft_consensus.cc:359] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.932091  1724 raft_consensus.cc:385] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:16.932420  1724 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:16.940460  2071 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.941023  2071 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.941884  2028 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:16.944509  1724 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:16.953840  1431 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.957288  1724 ts_tablet_manager.cc:1434] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:01:16.961129  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:16.961900  1535 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:16.962895  2071 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:16.966706  1724 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:16.975301  1725 tablet_bootstrap.cc:654] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:16.975935  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:16.977331  1724 tablet_bootstrap.cc:654] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:16.978870  1481 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:16.980695  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:16.981961  1972 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:16.987601  2071 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:16.981545  1430 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.998148  1727 ts_tablet_manager.cc:1434] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.004s
I20260709 13:01:17.003997  1972 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.013756  1725 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:17.016812  1725 ts_tablet_manager.cc:1403] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.007s
I20260709 13:01:17.018828  1724 tablet_bootstrap.cc:492] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:17.019358  1724 ts_tablet_manager.cc:1403] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.016s
I20260709 13:01:17.023615  1727 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Bootstrap starting.
I20260709 13:01:17.023852  1724 raft_consensus.cc:359] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.024673  1724 raft_consensus.cc:385] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.024987  1724 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.025735  1724 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.028628  1724 ts_tablet_manager.cc:1434] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:01:17.029876  1724 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Bootstrap starting.
I20260709 13:01:17.035320  1431 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.037144  2000 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.037703  2000 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.054772  1724 tablet_bootstrap.cc:654] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.046949  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:17.061683  1727 tablet_bootstrap.cc:654] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.065672  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:17.066395  1680 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:17.067567  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:17.072577  1765 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.072608  2070 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.073134  1765 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.073540  1765 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.074258  2000 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:17.080425  1498 leader_election.cc:343] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.080255  1765 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.083150  1725 raft_consensus.cc:359] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.084022  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:17.084286  1725 raft_consensus.cc:385] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.084688  1725 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.088542  1765 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.090116  2000 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.090600  2000 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.091737  1725 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.092628  2000 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.092921  2069 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.096228  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:17.096982  1683 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.100790  1498 leader_election.cc:343] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.101670  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:17.103281  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:17.103945  1680 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 0.
I20260709 13:01:17.105197  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:17.105918  1765 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.106254  1765 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.106542  1765 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:17.112478  1498 leader_election.cc:343] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.121840  1765 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.124310  1725 ts_tablet_manager.cc:1434] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260709 13:01:17.125337  1725 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:17.125389  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:17.126013  1680 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.136098  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:17.143988  1896 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:17.147003  1498 leader_election.cc:343] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:17.147308  1727 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: No bootstrap required, opened a new log
I20260709 13:01:17.149756  1765 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.152773  1769 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.153504  1725 tablet_bootstrap.cc:654] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.147785  1727 ts_tablet_manager.cc:1403] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.000s
I20260709 13:01:17.154793  1683 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:17.155061  1724 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: No bootstrap required, opened a new log
I20260709 13:01:17.157203  1724 ts_tablet_manager.cc:1403] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent bootstrapping tablet: real 0.128s	user 0.040s	sys 0.047s
I20260709 13:01:17.158782  1727 raft_consensus.cc:359] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.159473  1727 raft_consensus.cc:385] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.159729  1727 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.160456  1724 raft_consensus.cc:359] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.160410  1727 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.161101  1724 raft_consensus.cc:385] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.161387  1724 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.161938  1724 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.164016  1724 ts_tablet_manager.cc:1434] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:17.168998  1727 ts_tablet_manager.cc:1434] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:17.179543  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:17.152901  1680 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:17.188510  1972 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.206982  1972 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.210574  1790 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.211293  1790 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:17.212136  1790 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.218513  1972 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.242564  1725 tablet_bootstrap.cc:492] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:17.243713  1725 ts_tablet_manager.cc:1403] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.023s
I20260709 13:01:17.251094  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:17.251828  1535 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:17.247782  1972 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.251881  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:17.259568  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:17.269289  1725 raft_consensus.cc:359] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.270048  1725 raft_consensus.cc:385] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.270404  1725 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.271341  1725 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.257891  1972 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.274334  1725 ts_tablet_manager.cc:1434] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:01:17.274765  1972 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.275322  1725 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Bootstrap starting.
I20260709 13:01:17.266266  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:17.277343  2121 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.277709  2121 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.278054  2121 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.283531  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:17.284264  1535 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:17.284713  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:17.285832  1680 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 0.
I20260709 13:01:17.291769  1725 tablet_bootstrap.cc:654] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:17.291757  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:17.298906  2028 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:17.299345  2028 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.299669  2028 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.310853  1972 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.322963  2028 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.298795  2121 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:17.325804  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 108918us
I20260709 13:01:17.329640  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:17.330240  1534 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.330751  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:17.333012  2137 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.333598  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:17.334378  1680 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.336802  1534 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:17.338572  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:17.339206  1531 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.340291  2137 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:17.346215  2121 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.347332  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:17.349113  2137 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.345568  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:17.360121  1531 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:17.361639  2028 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.362897  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:17.364019  2028 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.364545  2028 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:17.365356  2028 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.366591  1431 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.377173  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:17.377815  1683 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.353865  2121 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:17.380822  1972 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.385800  2121 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:17.400549  1683 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:17.400614  2121 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.409813  1725 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: No bootstrap required, opened a new log
I20260709 13:01:17.410296  1725 ts_tablet_manager.cc:1403] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.002s
I20260709 13:01:17.416656  1725 raft_consensus.cc:359] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.417553  1725 raft_consensus.cc:385] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:17.417886  1725 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Initialized, Role: FOLLOWER
I20260709 13:01:17.427578  2028 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.428957  1430 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.430207  2134 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:17.422626  1725 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.442595  1725 ts_tablet_manager.cc:1434] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:01:17.448559  2028 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.449141  2028 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.452441  2028 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.454934  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:17.455308  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:17.455991  1683 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:17.458869  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:17.461237  2084 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:17.469252  2084 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:17.472250  1430 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.492192  2071 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.498571  1999 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:17.535461  1432 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 0 to 1, leader changed from <none> to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.912712  2152 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.913488  2152 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:17.918908  2152 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:17.922538  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:17.926410  1972 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.014099  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:18.014987  1682 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 1: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:18.086316  2084 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.088016  1606 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:18.103385  2084 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:18.106755  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:18.107513  2137 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.108948  2152 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.110970  2152 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:18.122635  1904 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.176007  2134 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.177971  2134 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:18.316054   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:18.346382  2166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:18.346338  2169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:18.347275  2167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:18.349104   431 server_base.cc:1061] running on GCE node
I20260709 13:01:18.351271   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:18.351514   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:18.351720   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602078351702 us; error 0 us; skew 500 ppm
I20260709 13:01:18.352440   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:18.355981   431 webserver.cc:533] Webserver started at http://127.0.107.196:44117/ using document root <none> and password file <none>
I20260709 13:01:18.356694   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:18.357023   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:18.357491   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:18.358903   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-3-root/instance:
uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
format_stamp: "Formatted at 2026-07-09 13:01:18 on dist-test-slave-rrf3"
I20260709 13:01:18.363849   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:18.367707  2174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:18.368647   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:18.368938   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-3-root
uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
format_stamp: "Formatted at 2026-07-09 13:01:18 on dist-test-slave-rrf3"
I20260709 13:01:18.369189   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:18.388206   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:18.390090   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:18.391851   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:18.394384   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:18.394634   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:18.394922   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:18.395097   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:18.535012   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39631
I20260709 13:01:18.535152  2236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39631 every 8 connection(s)
I20260709 13:01:18.573727   431 auto_leader_rebalancer-test.cc:384] add a tserver: e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:01:18.602133  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4ca0 after lost signal to thread 434
W20260709 13:01:18.603752  1631 debug-util.cc:398] Leaking SignalData structure 0x7b080024cc20 after lost signal to thread 1559
W20260709 13:01:18.604703  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0780 after lost signal to thread 1634
W20260709 13:01:18.605468  1631 debug-util.cc:398] Leaking SignalData structure 0x7b080026a400 after lost signal to thread 1708
I20260709 13:01:18.626031  2237 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37403
I20260709 13:01:18.626541  2237 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:18.627555  2237 heartbeater.cc:507] Master 127.0.107.254:37403 requested a full tablet report, sending...
I20260709 13:01:18.630024  1432 ts_manager.cc:194] Registered new tserver with Master: e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:18.639632  1432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57670
I20260709 13:01:19.216563  1606 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.229825  1679 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.232106  2152 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.236482  1535 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.238921  2246 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.254527  2152 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:01:19.257031  1574 consensus_peers.cc:597] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f31cf514617428594649c1ecf3b2547. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.260821  1679 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.263232  1535 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.273208  1606 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.291397  1432 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.308231  1681 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:19.311298  1574 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4cbda5372a24182a9982a0d35ff91b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.313529  1535 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.315378  2152 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.321378  2246 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.352577  2246 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.354570  1679 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.381285  1535 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.431685  1431 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.452946  1535 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.492708  1679 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.494928  1765 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.497550  1607 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.499380  1904 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.523829  1999 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.529479  1679 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.534411  1606 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.553781  1432 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.563740  1679 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.595328  1607 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.597496  2154 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:19.603813  1499 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f66f028938a14af4a39a0e553938682b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.628116  1535 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.630069  2070 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.631953  2156 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.639593  1535 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.642897  2237 heartbeater.cc:499] Master 127.0.107.254:37403 was elected leader, sending a full tablet report...
I20260709 13:01:19.670073  1607 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:19.661135  1430 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:19.678009  1648 consensus_peers.cc:597] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a39df5ae9144c118d4158b68b17044c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.693285  2269 ts_tablet_manager.cc:933] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:19.732909  2269 tablet_copy_client.cc:323] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:01:19.750698  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 0f31cf514617428594649c1ecf3b2547 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:01:19.751263  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 0f31cf514617428594649c1ecf3b2547 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-0f31cf514617428594649c1ecf3b2547
I20260709 13:01:19.763738  1620 tablet_copy_source_session.cc:215] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.772668  2269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31cf514617428594649c1ecf3b2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.795688  2269 tablet_copy_client.cc:806] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.796427  2269 tablet_copy_client.cc:670] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.803539  2269 tablet_copy_client.cc:538] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.810376  2273 ts_tablet_manager.cc:933] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:19.821313  2269 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:19.831171  2273 tablet_copy_client.cc:323] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:01:19.833220  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet c4cbda5372a24182a9982a0d35ff91b7 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:01:19.833814  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet c4cbda5372a24182a9982a0d35ff91b7 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-c4cbda5372a24182a9982a0d35ff91b7
I20260709 13:01:19.846448  1620 tablet_copy_source_session.cc:215] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.850174  2273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbda5372a24182a9982a0d35ff91b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.879118  2269 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:19.895882  2276 ts_tablet_manager.cc:933] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:01:19.897014  2269 tablet_bootstrap.cc:492] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:19.897801  2269 ts_tablet_manager.cc:1403] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.077s	user 0.036s	sys 0.005s
I20260709 13:01:19.903682  2273 tablet_copy_client.cc:806] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.906994  2269 raft_consensus.cc:359] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.908005  2269 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:01:19.908720  2269 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:19.911882  2273 tablet_copy_client.cc:670] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.923300  2273 tablet_copy_client.cc:538] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.930529  2276 tablet_copy_client.cc:323] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:01:19.944849  2269 ts_tablet_manager.cc:1434] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.009s
I20260709 13:01:19.950196  2273 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:19.953996  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet f66f028938a14af4a39a0e553938682b from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:01:19.954877  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet f66f028938a14af4a39a0e553938682b from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-f66f028938a14af4a39a0e553938682b
I20260709 13:01:19.955863  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-0f31cf514617428594649c1ecf3b2547 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:01:19.956409  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-0f31cf514617428594649c1ecf3b2547 on tablet 0f31cf514617428594649c1ecf3b2547 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:19.971843  1545 tablet_copy_source_session.cc:215] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.991748  2276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66f028938a14af4a39a0e553938682b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.083492  2276 tablet_copy_client.cc:806] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:20.084405  2276 tablet_copy_client.cc:670] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:20.087661  2273 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.088768  2273 tablet_bootstrap.cc:492] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:20.090524  2273 ts_tablet_manager.cc:1403] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.141s	user 0.057s	sys 0.055s
I20260709 13:01:20.096441  2273 raft_consensus.cc:359] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.097415  2273 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:01:20.098142  2273 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.098886  2276 tablet_copy_client.cc:538] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:20.100816  2273 ts_tablet_manager.cc:1434] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:20.107096  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c4cbda5372a24182a9982a0d35ff91b7 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:01:20.107595  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c4cbda5372a24182a9982a0d35ff91b7 on tablet c4cbda5372a24182a9982a0d35ff91b7 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:20.120497  2276 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:20.146149  2276 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.149453  2276 tablet_bootstrap.cc:492] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:20.150225  2276 ts_tablet_manager.cc:1403] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 13:01:20.152539  2276 raft_consensus.cc:359] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.153172  2276 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:01:20.153749  2276 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.155649  2276 ts_tablet_manager.cc:1434] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:01:20.157687  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-f66f028938a14af4a39a0e553938682b received from {username='slave'} at 127.0.0.1:37256
I20260709 13:01:20.158151  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-f66f028938a14af4a39a0e553938682b on tablet f66f028938a14af4a39a0e553938682b with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:20.178086  2276 ts_tablet_manager.cc:933] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:20.192591  2212 raft_consensus.cc:1217] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.212463  2276 tablet_copy_client.cc:323] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:01:20.265419  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet 9a39df5ae9144c118d4158b68b17044c from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:01:20.265985  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet 9a39df5ae9144c118d4158b68b17044c from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-9a39df5ae9144c118d4158b68b17044c
I20260709 13:01:20.275362  1694 tablet_copy_source_session.cc:215] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:20.278622  2276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39df5ae9144c118d4158b68b17044c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.296237  2212 raft_consensus.cc:1217] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.332602  2276 tablet_copy_client.cc:806] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:20.333292  2276 tablet_copy_client.cc:670] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:20.339114  2276 tablet_copy_client.cc:538] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:20.349133  2276 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:20.385351  2212 raft_consensus.cc:1217] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.440518  2276 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.441774  2276 tablet_bootstrap.cc:492] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:20.442476  2276 ts_tablet_manager.cc:1403] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.094s	user 0.041s	sys 0.025s
I20260709 13:01:20.445849  2276 raft_consensus.cc:359] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.446673  2276 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:01:20.447304  2276 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:20.450830  2276 ts_tablet_manager.cc:1434] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:01:20.454085  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-9a39df5ae9144c118d4158b68b17044c received from {username='slave'} at 127.0.0.1:50950
I20260709 13:01:20.454986  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-9a39df5ae9144c118d4158b68b17044c on tablet 9a39df5ae9144c118d4158b68b17044c with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:20.570096  2212 raft_consensus.cc:1217] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.596149  2084 raft_consensus.cc:1064] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:01:20.598663  2084 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:20.619489  2212 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.621399  1530 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.622799  2283 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.624635  2283 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:20.631295  1679 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.651439  2084 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.663587  2084 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.675984  1530 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.704749  2212 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.724555  1679 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.726470  1432 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.794057  1605 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:20.801107  1682 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:20.802598  2284 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.802634  2212 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:20.805716  2084 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.811549  2152 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.823956  2211 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.825503  1681 raft_consensus.cc:2955] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.828488  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f31cf514617428594649c1ecf3b2547 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:20.836802  1999 raft_consensus.cc:1064] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:01:20.839066  1999 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:20.861356  1433 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.876456  1605 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.877952  2211 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.879503  1681 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.888787  2263 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:20.891841  2299 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.892515  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f31cf514617428594649c1ecf3b2547 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:01:20.896205  2263 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.901888  2084 raft_consensus.cc:1064] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:01:20.905282  2084 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:20.938897  2298 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.940922  1679 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.944134  2211 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.945585  2284 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:20.951498  2300 tablet_replica.cc:333] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:01:20.952373  2210 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.960129  2300 raft_consensus.cc:2243] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:20.968595  1432 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.971436  2300 raft_consensus.cc:2272] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:20.977849  1534 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:20.980355  2300 ts_tablet_manager.cc:1916] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:20.978924  1606 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:20.993044  2283 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.013512  1679 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.019675  1530 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:21.021919  2084 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.051477  1679 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.057741  2212 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.060503  2284 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.065418  2298 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.065570  1534 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.067662  2299 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.085044  1682 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.085384  2306 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.087335  2210 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.105517  2212 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.110430  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f66f028938a14af4a39a0e553938682b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.118911  1679 raft_consensus.cc:2955] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.124738  1432 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.130611  2287 raft_consensus.cc:1064] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:01:21.131127  1430 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 3 to 4, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.135906  2287 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:21.150868  2212 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.153210  1607 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.154386  2288 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.156297  1605 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:21.162106  2310 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.167877  1534 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.169435  2287 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.178118  1530 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.193717  2283 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.198287  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet f66f028938a14af4a39a0e553938682b with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35638
I20260709 13:01:21.220780  2283 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.222616  1534 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.246750  2300 ts_tablet_manager.cc:1929] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.253945  2300 log.cc:1199] T 0f31cf514617428594649c1ecf3b2547 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/0f31cf514617428594649c1ecf3b2547
I20260709 13:01:21.273087  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4cbda5372a24182a9982a0d35ff91b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.275198  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 0f31cf514617428594649c1ecf3b2547 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:01:21.274897  1433 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.278131  2212 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.281533  2283 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.290143  2314 tablet_replica.cc:333] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:01:21.291496  2314 raft_consensus.cc:2243] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.293850  2314 raft_consensus.cc:2272] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.293476  2212 raft_consensus.cc:2955] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.295997  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet c4cbda5372a24182a9982a0d35ff91b7 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39164
I20260709 13:01:21.307794  2314 ts_tablet_manager.cc:1916] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.334234  1530 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.346961  2211 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.344082  2310 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.364341  2316 tablet_replica.cc:333] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:01:21.368623  2316 raft_consensus.cc:2243] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.381152  2316 raft_consensus.cc:2272] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.378052  1432 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.386721  2316 ts_tablet_manager.cc:1916] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.404860  2314 ts_tablet_manager.cc:1929] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.405340  2314 log.cc:1199] T f66f028938a14af4a39a0e553938682b P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/f66f028938a14af4a39a0e553938682b
I20260709 13:01:21.407058  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet f66f028938a14af4a39a0e553938682b (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:01:21.413194  1608 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.429786  1679 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:21.444833  1605 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.447135  2157 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.448736  2212 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.452451  2157 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.454591  2157 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.457074  1605 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.460901  2316 ts_tablet_manager.cc:1929] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.469269  2212 raft_consensus.cc:2955] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:21.471249  2316 log.cc:1199] T c4cbda5372a24182a9982a0d35ff91b7 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/c4cbda5372a24182a9982a0d35ff91b7
I20260709 13:01:21.472146  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a39df5ae9144c118d4158b68b17044c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.501096  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 3 to 4, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.503618  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet c4cbda5372a24182a9982a0d35ff91b7 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:01:21.521019  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a39df5ae9144c118d4158b68b17044c with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57250
I20260709 13:01:21.522526  2300 tablet_replica.cc:333] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:01:21.523620  2300 raft_consensus.cc:2243] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.524525  2300 raft_consensus.cc:2272] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.532442  2300 ts_tablet_manager.cc:1916] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.558107  2300 ts_tablet_manager.cc:1929] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.558571  2300 log.cc:1199] T 9a39df5ae9144c118d4158b68b17044c P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/9a39df5ae9144c118d4158b68b17044c
I20260709 13:01:21.560240  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 9a39df5ae9144c118d4158b68b17044c (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:01:23.582458  2318 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.583248  2318 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.586941  2318 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.588765  2318 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.588809  2317 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.589455  2318 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.589532  2317 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.591596  2317 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.591569  2318 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.596228  2319 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.597157  2319 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.600706  2319 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.604411  2319 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.605228  2319 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.601390  2317 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.607446  2317 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.610108  2317 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.602633  2318 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.610934  2318 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.613152  2318 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.615984  2319 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.629458  2318 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.630267  2319 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.630095  2318 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.631057  2319 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.637385  2318 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.649609  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 463) took 1400 ms. Trace:
I20260709 13:01:23.650511  2321 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.651072  2321 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.650300  1530 rpcz_store.cc:276] 0709 13:01:22.248765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.648550 (+1399785us) service_pool.cc:224] Handling call
0709 13:01:23.648967 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.649181 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.649218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:23.649275 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:23.649322 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.649393 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.649518 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:23.652387  2318 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.655848  2321 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.658763  2318 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.660274  2322 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.660840  2322 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.661556  2318 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.662945  2322 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.663379  2318 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.664078  2318 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.664740  2322 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.665397  2322 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.669278  2317 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.669915  2317 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.671792  2318 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.672513  2317 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.670275  2322 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.674751  2322 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.675092  2320 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.675316  2322 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.675724  2320 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.677536  2322 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.677654  2320 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.678143  2322 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.678227  2320 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.678884  2322 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.678962  2320 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.681074  2320 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.681851  2317 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.682662  2322 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.682598  2317 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.685703  2317 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.687651  2317 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.688629  2318 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.688284  2323 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.689563  2323 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:23.692266  2320 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.689210  2318 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.697881  2322 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.698966  2322 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.700587  2318 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.692757  2325 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.703847  2325 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.695551  2320 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.708613  2322 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.709784  2320 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.718204  2320 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.718492  2325 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.688865  2317 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.715924  2318 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.719764  2318 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.711400  2321 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.720439  2324 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.720739  2321 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.721005  2324 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.721395  2317 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.718793  2320 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.723135  2324 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.716483  2323 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:23.736996  2327 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.737515  2327 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.739527  2327 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.739980  2327 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.740417  2327 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.735350  2321 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.746919  2318 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.734306  2320 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.753026  2327 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.793241  2321 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.793828  2321 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.800808  2335 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.801488  2335 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.802619  2321 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.803232  2321 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.800809  2318 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.804641  2318 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.803840  2321 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.803992  2335 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.806805  2318 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.827137  2328 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.833231  2325 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.841449  2327 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.863308  1904 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.864403  1904 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.867955  1904 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.858639  2325 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.875058  1605 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:23.887719  2318 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:23.873453  2337 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.891053  2334 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.857851  2328 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.872740  2327 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.939111  2340 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.939553  2321 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.928184  2331 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.926309  2333 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.939857  2340 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.940133  2327 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.936945  2337 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.937873  2334 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.944983  2340 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.941112  2348 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.945293  2334 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.948983  2343 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.940253  2331 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.951836  2328 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.935218  2318 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.949540  2343 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.954282  2331 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.955164  2343 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.957206  2337 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.945904  2333 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:23.958479  2351 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.950237  2347 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.951078  2325 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.961962  2345 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.962613  2340 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:23.963090  2340 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.958024  2318 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:23.964191  2333 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.964955  2333 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.959123  2351 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.960310  2347 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.965147  2340 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.968346  2326 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:23.963019  2345 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.972268  2326 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.976452  2347 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.968376  2333 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:23.951647  2348 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:23.979003  2351 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.979521  2348 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:23.979017  2345 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.038285  2329 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.048341  2337 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.049399  2337 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.053328  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.057760  2326 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.083115  2355 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.069752  2326 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.069494  1904 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.093659  2349 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.069222  2348 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.093530  1904 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.094837  2349 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.069625  2334 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.099428  2341 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.086208  2326 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.102360  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.103518  1681 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.099915  2334 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.107782  2331 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.067921  2351 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.108645  2331 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.109099  2351 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.111575  2331 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.106389  2325 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.115861  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.115746  2325 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.116820  1684 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.117092  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.117444  2333 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.117941  1679 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.118036  2333 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.083712  2329 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.118335  2325 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.067332  2345 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.113209  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.106374  2344 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.095549  2348 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.124692  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.124620  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.126174  1904 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.126267  2348 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.129740  2357 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.119239  2345 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.084496  2355 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.100661  2341 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.131341  2357 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.138115  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.118804  2333 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.154924  2342 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.148953  1680 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.142969  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.142205  2326 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.162578  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.131541  2344 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.163988  1681 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.166481  1678 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.166846  2344 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.168013  2346 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:24.168929  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.154189  2351 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.156271  2325 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:24.176560  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.179376  2320 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.181747  2322 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.177325  2348 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.183523  2317 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.183426  2322 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.184320  2348 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.184577  2317 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.186764  2322 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.173748  2354 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.192412  2354 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.155848  2342 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.168793  2346 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:24.289786  2360 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:24.283856  2317 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.177459  2344 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.296258  1904 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.180650  2319 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.193183  2348 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.301035  1904 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.301604  2358 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.277006  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.306172  2352 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.224692  2337 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.262945  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.188148  2341 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.277280  2334 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.180222  2320 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.277482  2329 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.203795  2351 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.220217  2324 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.317173  2357 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.288769  2325 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.220516  2318 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.220758  2323 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.201171  2347 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.309401  2358 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.321784  2335 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.306524  2338 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.323230  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.322649  2352 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.334427  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.334761  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:24.332615  2355 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.337054  2325 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.338361  1904 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.338969  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.315042  1681 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.340553  2333 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.318110  2353 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.318048  2348 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.316725  2337 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.349304  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.348472  2344 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.329020  2345 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.352183  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.361346  2335 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.353499  2211 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.344071  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.356053  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.351450  1904 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.357617  2317 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.360638  2328 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.339015  2332 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.333361  2334 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.352010  2356 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.369041  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.370607  1682 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.375166  1904 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.376084  2358 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.367719  2344 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.381161  1904 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.384009  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.357810  2351 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.359999  2319 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.372562  1677 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.393218  2320 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.393937  2320 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.394718  2320 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.392979  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.387297  2328 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.396870  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.397234  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.374074  2321 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.399468  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:24.399979  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.399802  2321 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.400702  1682 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 1.
I20260709 13:01:24.401500  2333 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:24.401731  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.404609  1682 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.405681  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.403613  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:24.406814  1574 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.407932  2333 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.386861  1605 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 1.
I20260709 13:01:24.380089  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.376906  2356 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.372298  2317 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.383805  2353 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.359419  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.382862  2323 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.379557  2338 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.382215  2348 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.442242  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.445395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.460328  2321 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.383239  2324 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:24.461067  1574 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abc3085f661f457e8c8d15478c227311. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:24.408383  2333 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.410285  2322 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.461139  2320 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.456516  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.478404  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.433573  2328 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.411116  2354 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.464458  2349 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.436129  2361 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.431845  1678 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.391459  2337 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.433120  1681 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.480775  1684 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.479101  1679 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.482909  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.433210  2330 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.410569  2335 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.487350  2324 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.482985  2355 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.500895  1605 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.501502  2355 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.483471  1904 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.482913  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:24.504316  1904 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.505007  2341 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.505399  2341 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.505771  2341 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.506271  1904 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.483150  2339 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.412420  2347 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.410655  2318 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.409289  2334 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.477613  2333 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.438841  2319 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.477421  2322 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.493506  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.490134  1676 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.489761  2346 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.495198  1682 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.497991  2352 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.499059  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.501915  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.488657  2356 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.490170  2362 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.503841  2355 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.507074  2339 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.510871  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.487362  2317 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.513792  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.514213  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.516449  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.516595  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.517035  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.517563  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.424741  2332 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.520325  2342 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:24.518966  1684 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.511384  1675 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.510874  2322 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.524165  2358 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.524474  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.525177  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.521989  2361 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.528422  1904 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.514096  2330 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.575423  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.600674  2341 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.574736  2363 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.564296  2339 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.596693  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.597878  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.598155  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.559407  2351 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.598820  1534 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.560113  2356 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.575129  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.589740  1682 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:24.608635  1680 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:24.562752  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.599912  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.610447  2330 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.611598  1904 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.573137  2337 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.613086  2358 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.613484  1677 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.614543  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.615175  1677 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.616094  2358 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:24.616659  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.616739  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:24.617390  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.617456  1677 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.618536  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.619283  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.620492  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.621366  1904 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.621701  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.623808  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.623961  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.618626  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.543686  1683 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.626160  1535 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.627022  2335 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.628726  2335 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.629196  2335 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.629448  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.630079  1607 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.630259  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.630903  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.630983  1603 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.563421  2348 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.530200  2329 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:24.581189  2334 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.639326  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.610240  2363 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.631462  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.643069  2356 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.628746  2353 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.644109  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.577142  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.644971  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.611395  2319 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.543645  2328 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:24.662801  2323 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.645597  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:01:24.675455  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002feee0 after lost signal to thread 434
I20260709 13:01:24.745477  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:24.746424  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff5c0 after lost signal to thread 1467
I20260709 13:01:24.703670  2329 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.746821  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.645790  1681 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.768913  2361 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.659934  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.748008  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.715278  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.749399  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:24.747941  2233 debug-util.cc:398] Leaking SignalData structure 0x7b0800299c20 after lost signal to thread 1559
I20260709 13:01:24.755333  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.763199  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.769969  2363 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.704124  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:24.782601  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 150754us
I20260709 13:01:24.787138  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.776855  1602 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:24.788224  2361 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.789254  2361 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.788264  2319 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.789776  2361 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.789916  2319 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.792439  2319 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.793021  2333 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.799767  2333 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.781190  2328 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.800822  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.799923  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.802067  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.771809  2335 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.781591  2347 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.803578  2341 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.779243  2322 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.806070  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:24.806923  2335 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.637830  2362 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.808632  2210 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:24.818112  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.820446  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.820856  2362 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.820776  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.822106  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.822365  2329 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.822738  1602 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:24.816212  2356 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.824111  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.825045  2361 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.825815  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.827872  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.828223  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.828735  1534 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:24.829267  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.830996  1603 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:24.818154  2334 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:01:24.824143  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.832077  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.835652  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.838384  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.832973  2335 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.840333  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.832314  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:24.839200  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.832906  2361 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.841552  2335 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.844060  2335 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.845424  2322 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:24.845980  2338 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.848167  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.849231  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.850330  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.850979  1604 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:24.848559  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.852272  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.849053  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.847184  2347 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:24.842944  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.855144  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.857447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.854421  2347 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:24.862039  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.861923  2347 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:24.863322  2347 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.863354  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.865024  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:24.857935  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.858017  2332 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.858686  2318 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.858919  2328 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.859828  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.855096  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.872927  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.873919  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.875133  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.860725  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.860927  2361 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.872120  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.875882  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.877389  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.877499  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.878083  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.878458  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.879148  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.889137  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.889709  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.879835  2361 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.891151  2361 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.881589  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.883213  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.893715  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.894311  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.886823  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.884652  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.879319  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.899622  1528 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.899734  2335 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.886811  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.887758  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.888378  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.900712  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.888477  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.885322  2324 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.894387  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:24.886049  2233 debug-util.cc:398] Leaking SignalData structure 0x7b080027fc00 after lost signal to thread 1634
I20260709 13:01:24.895147  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.903012  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:24.903475  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08001278c0 after lost signal to thread 1708
I20260709 13:01:24.904470  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:24.904987  2233 debug-util.cc:398] Leaking SignalData structure 0x7b0800294de0 after lost signal to thread 2236
I20260709 13:01:24.904498  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.905714  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.906061  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.883833  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.907158  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.908102  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.886569  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.910151  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.910858  1532 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.902047  2324 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.911363  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.911789  2324 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.879767  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.911991  1531 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.910943  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.913669  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.913758  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.914635  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.915387  1532 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.917022  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.918330  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.922297  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.923317  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.919401  2319 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.905071  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:24.929193  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.929715  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.931890  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.936986  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.937245  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.938299  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.929191  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.939940  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.940608  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.941817  2348 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.942229  2348 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.942471  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.943373  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.943760  2351 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.944231  2351 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.942662  2348 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.944621  2351 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.944685  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.947190  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.948383  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.948828  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.949136  2353 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.948402  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:24.949769  2334 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.950212  2334 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.949590  2353 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.950817  2334 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.951169  2353 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.953562  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.958557  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.956779  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.962586  2365 ts_tablet_manager.cc:933] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:24.962801  2335 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.963984  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.964229  2361 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.965322  2335 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.966653  2335 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.967139  2335 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.968588  2319 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:24.965425  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.971186  2348 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:24.971463  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.972535  2322 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.972913  2322 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.973254  2322 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:24.973697  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.966092  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.978020  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:24.978883  2318 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.979517  2318 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.979955  2318 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.987530  2319 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.988343  2319 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:24.988989  2319 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.990631  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.987112  1527 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:24.997984  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:24.989540  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.032158  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.016335  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.036398  2361 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.037402  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.038113  2361 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.038599  2361 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.039089  2361 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.039949  2322 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.042281  2322 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.042476  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.042915  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.023494  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.043602  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.044938  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.049695  2348 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.049651  2317 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.050383  2317 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.050840  2317 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.049939  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.055928  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.043345  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.065110  1682 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.069520  2356 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.070669  2356 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.071138  2356 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.071260  2318 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.072086  2356 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.073221  2356 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.054694  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.076215  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.078958  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.079243  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.078958  2341 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.080490  2346 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.081048  2346 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.081432  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.082414  2347 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.082765  2347 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.081538  2346 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.083122  2347 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.071472  2317 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.091940  2323 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.092412  2323 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.092754  2323 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.095820  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.060081  2351 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.100834  2210 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.101990  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.101994  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.103631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.102317  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.106108  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.107021  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.104317  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.103899  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.108601  2328 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:25.105134  2348 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.114673  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.112903  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.122870  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.094543  2361 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.129711  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.129465  2322 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.121081  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.132238  2341 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.132474  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.131621  2322 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.113502  2324 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.135689  2324 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.138345  2335 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.139139  2347 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.140962  2318 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.141914  2337 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.113245  2365 tablet_copy_client.cc:323] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:01:25.142452  2337 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.143401  2335 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.133250  2322 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.145378  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.146944  2347 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.143570  2319 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.150791  2346 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.145524  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.145393  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.152549  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.154423  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.143566  2337 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:25.155925  2337 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.143705  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.155725  2322 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:25.158686  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62931.6us
I20260709 13:01:25.159354  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.163388  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.164799  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.165129  2361 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.166108  2353 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.166632  1528 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:25.167030  2334 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.168438  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.169678  2317 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.170555  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.173624  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.177148  2367 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.179973  1677 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.180394  2323 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.180924  2346 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.179986  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.183166  2332 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.183504  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.183697  2323 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.184494  2332 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.183214  2318 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.185034  2332 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.185767  2318 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.186306  2318 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.186431  2332 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.187613  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.187776  2332 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.184984  2324 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:25.192190  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.192494  2324 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.192917  2324 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.183194  2353 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.193202  2367 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.197149  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.197877  2342 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.198235  1648 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.198331  2318 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.199000  2342 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.200959  2334 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.177446  2317 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.174607  2319 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.204448  2317 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.204962  2317 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.206797  2351 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.205116  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:25.208945  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.527s (SENT) [suppressed 2 similar messages]
I20260709 13:01:25.210172  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.211124  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.211879  2361 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.212293  2361 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.212673  2361 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.215773  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.216151  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.220237  2319 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.216055  2351 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.221177  2322 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.220727  2319 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.221894  2319 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.221331  1529 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:25.225098  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.225265  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.227595  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.225908  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.228184  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.230373  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.231215  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.232188  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.233505  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.233289  2317 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.235689  2317 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.236150  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.236523  2346 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.236896  2346 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.226356  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.237731  2346 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.238400  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.238814  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.239675  2335 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.240051  2335 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.240325  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.240600  2335 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.241978  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.242959  2322 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.243330  2322 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.243705  2322 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.244269  2323 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.245445  2346 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.246210  2351 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.236855  2318 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.250759  2317 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.251513  2317 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.250736  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.251900  2317 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.254531  2335 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:25.255534  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.262085  2335 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.256459  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.257552  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.258148  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.258622  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.258850  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.263101  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.264492  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.264775  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.253737  2324 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.267228  2317 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:25.268468  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59548.9us
I20260709 13:01:25.273844  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.273897  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.275507  2324 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.277419  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.277693  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.278494  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.279309  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.279467  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.280650  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.281090  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.281453  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.281791  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.282588  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.283243  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.283360  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.270442  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.298547  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.283959  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.264246  2322 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.298475  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:25.286263  2319 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.300709  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.302385  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.303436  2368 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.304450  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.295782  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.307296  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.308795  2346 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.309669  2334 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.310315  2334 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.305400  2335 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.311599  2335 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.311970  2335 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.315052  1677 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.316538  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.317361  2356 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.317719  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.317927  2362 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.318370  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.319101  2328 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.319197  2367 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.319537  2328 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.319666  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.320598  2356 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.320436  2328 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.321607  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.302132  2347 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.322368  2368 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.322751  2368 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.323235  2368 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.323762  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.321626  2328 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.324935  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.325558  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.324541  2322 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.325987  2356 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.328749  2324 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.329404  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:25.329461  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.332195  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.332561  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.333089  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.330408  2324 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.333873  2362 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.334133  2324 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.330687  2347 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.330328  2356 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:25.335256  2356 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.334800  2347 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.336203  2347 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.336148  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.336416  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:25.336958  2332 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.338845  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.339504  2370 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.341020  2370 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:25.341498  2370 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.346268  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.341202  2361 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.353513  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.354676  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.340261  2322 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.346339  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.368168  2322 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:25.368652  2322 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.368826  1526 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:25.369042  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.348743  2367 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.369709  2335 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.349218  1676 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.371336  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.371656  2317 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.350479  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.349951  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:25.362432  2338 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.362299  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.384797  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.362813  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.363309  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.350965  2362 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.386806  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.364197  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.365301  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.352252  2332 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.371786  2335 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.387866  2319 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.388079  2332 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:25.388583  2332 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.389786  2370 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.346838  2346 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.372583  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.392601  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.349921  1682 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.394066  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.373405  2361 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.373872  2324 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.375387  2356 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.376811  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:25.377724  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44735us
I20260709 13:01:25.379858  2322 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.386833  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.367468  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.404273  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.403467  2347 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.405076  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.405260  2328 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.405536  2322 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.405912  2362 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.406219  2347 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.407125  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.407306  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.408478  2361 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.409895  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.410924  2361 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.411482  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.412181  1683 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.400192  1681 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:25.400626  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.401165  2317 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.402531  2324 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.402565  2356 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.379868  2368 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.412890  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.409987  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.416271  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.416771  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.417520  1603 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:25.391953  2370 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.417829  2362 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.414307  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.419175  2346 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.417351  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.419533  2346 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.419975  2346 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.420437  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.415066  2347 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.419557  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.416136  2328 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.422122  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.423084  2367 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.423365  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet abc3085f661f457e8c8d15478c227311 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:01:25.423730  2367 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.424223  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet abc3085f661f457e8c8d15478c227311 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-abc3085f661f457e8c8d15478c227311
I20260709 13:01:25.424880  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:25.425640  2367 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.427115  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.427825  2367 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.428062  2346 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.429108  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.429822  2367 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.430276  2338 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.434165  2338 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:25.434562  2338 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.431413  1904 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.432060  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.413251  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.432515  2346 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.433637  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.453521  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.454221  2328 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.454618  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.454954  2328 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.454742  2338 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.457751  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.455598  2328 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.435205  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.439103  2368 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.458936  2368 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.459172  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.439359  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.439646  2361 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.440006  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.460652  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.460896  2341 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.461529  1683 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.461750  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.462059  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.462774  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.463079  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.464360  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.440622  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.465444  2361 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.465728  2322 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.444303  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.466266  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.459326  2368 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:25.466638  2370 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.467137  2368 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.467207  2317 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.467885  2319 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.468322  2319 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.469245  2319 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.470429  2351 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.438458  2332 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.466487  2322 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.472407  2322 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.472550  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.473299  2351 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:25.473721  2332 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.473541  2319 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.473332  2322 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.445242  2371 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.474449  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.474851  2322 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.474987  2371 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.475162  2351 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.475485  2371 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.476218  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.476323  2371 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.476967  2351 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.477609  1904 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.477857  2371 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.478889  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.479751  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.480847  2328 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.481269  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.477449  2351 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.482504  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.483199  2337 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.483553  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.482625  2351 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.477411  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:25.502004  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.526603  2362 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:25.527791  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50468.8us
I20260709 13:01:25.489426  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.483840  2337 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.525246  2338 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:25.502945  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.489993  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.489128  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.532199  2322 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.533317  2370 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.533762  2370 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.534545  2370 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.535637  2370 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.490548  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.540239  1529 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.541358  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.484046  2368 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.542742  1534 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.543370  1678 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.491031  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.529232  2361 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.502537  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.544858  2361 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.545827  2361 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:25.547551  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.548437  1527 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:25.515029  1620 tablet_copy_source_session.cc:215] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:25.550593  1678 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.552022  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.554127  1601 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.555475  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:25.556983  2365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc3085f661f457e8c8d15478c227311. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:25.527248  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43762.9us
I20260709 13:01:25.557964  2367 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.558676  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.558991  2367 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.559365  2367 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.559830  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.560648  2362 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:25.562131  2362 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.560202  2367 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.563196  2367 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.568684  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.569542  2337 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.569898  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.571177  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.484591  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.571269  2337 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:25.572528  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88029us
I20260709 13:01:25.572667  2361 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.573282  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.574435  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.574859  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.575131  2346 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.575798  2371 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.576117  2368 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:25.576180  2361 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.577013  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.578367  2346 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.578420  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.579367  1527 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.579777  2347 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.580521  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.581975  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.582659  1430 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.586066  1533 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:25.587595  2347 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.588812  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.589833  2347 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.599496  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.600914  1678 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.601677  2362 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.602351  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.603626  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.604470  2328 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.605499  2328 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.607121  1602 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.608664  2332 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.609134  2332 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.608989  1432 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.610726  2332 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.611210  2370 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:25.612576  2365 tablet_copy_client.cc:806] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:25.612430  2332 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.613260  2365 tablet_copy_client.cc:670] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:25.615162  2367 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.616472  2347 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.616820  2347 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.617080  2322 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.618913  2347 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.609825  2328 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.610333  2361 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.620972  2361 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.621498  2361 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.622447  2361 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.623597  2361 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:25.624445  2319 consensus_queue.cc:1175] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36f53e9bfce749bbba4a4b34829f563d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:25.625079  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.626299  1602 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.627624  1678 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.628336  1676 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:25.632252  2334 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.633013  2334 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.633158  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.634119  2367 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.634509  2367 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.634600  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.635512  2322 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.635563  2367 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.636265  2322 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.637681  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.637837  2322 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.638523  2347 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.640293  2319 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.641531  2319 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.641883  2319 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.644203  2319 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.646010  2334 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.647917  2319 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.649570  1602 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.649817  2322 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.652711  2322 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.654148  2322 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.655562  2322 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.666476  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.660286  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.667207  2365 tablet_copy_client.cc:538] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:25.661067  2367 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.664654  1603 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:25.674337  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.676211  2334 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.662303  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.677789  2351 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.678326  1603 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.679318  2351 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.679704  2351 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.680796  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.680758  2351 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.687323  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.689425  2351 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.689651  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.690690  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.692440  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.693971  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.681453  2371 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:25.678714  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.682722  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:25.676179  2322 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.684719  1602 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.686192  1607 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.697630  2347 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.702248  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.703205  2334 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.703780  2334 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:25.706233  2334 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.710726  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.711258  2365 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:25.711979  1527 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:25.713542  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.715802  1607 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.717945  1607 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.719897  1607 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.721635  2324 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.721697  2361 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.723119  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56298 (request call id 2) took 1851 ms. Trace:
I20260709 13:01:25.723652  2370 rpcz_store.cc:276] 0709 13:01:23.871951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.872152 (+   201us) service_pool.cc:224] Handling call
0709 13:01:23.903131 (+ 30979us) log.cc:844] Serialized 506 byte log entry
0709 13:01:24.406319 (+503188us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b540012ee20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff2142 00007f4697fd2eaa 00007f4697fd9d53 00007f4697fd9cd9 00007f4697fd9c69 00007f4697fd9c31 00007f4697fd8dfd 000000000038f354 000000000038f199 00007f4694f8c475
0709 13:01:25.722992 (+1316673us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12754,"raft.queue_time_us":10449,"raft.run_cpu_time_us":5008,"raft.run_wall_time_us":133736,"spinlock_wait_cycles":3035264,"thread_start_us":373789,"threads_started":1,"wal-append.queue_time_us":320058,"wal-append.run_cpu_time_us":4413,"wal-append.run_wall_time_us":1068291}
I20260709 13:01:25.728457  1607 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.732252  1607 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.733665  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.738783  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.740391  2370 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.740984  1430 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.753625  2324 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.754866  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.749755  2328 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.750957  2332 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.752010  2338 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.756675  2328 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.757032  2328 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.757171  2337 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.757577  2337 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.758010  2328 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.758328  2337 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.759363  2328 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.759558  2337 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.757045  2338 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.760634  2338 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.761369  2338 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.762694  2338 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.776255  2370 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.783905  1432 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.752190  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.792409  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.802129  2370 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.803687  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.793149  2328 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.792670  2365 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:01:25.795522  2338 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:25.806336  2338 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:25.808965  2338 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.809974  2338 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.793751  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.811365  2328 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.806944  2370 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:25.807797  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.813225  2328 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.808399  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.806411  2365 tablet_bootstrap.cc:492] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:25.814286  2337 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.814785  2337 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.815690  2337 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.817183  2337 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.813418  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:25.820595  2328 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.821982  2328 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.822954  2332 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.823320  2332 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.823612  2328 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.824162  2332 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.824798  1904 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.825120  1904 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.825503  2332 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.825927  1904 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.827502  1904 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.837271  2328 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.837451  2362 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:25.837718  2329 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:25.838930  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.839259  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.840653  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.814911  2365 ts_tablet_manager.cc:1403] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.030s
I20260709 13:01:25.841661  1607 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.839692  2356 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:25.841749  2370 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.838537  2332 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:25.844203  2319 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.844352  2324 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.842583  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.854821  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.854094  2370 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.856729  2324 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.857554  2338 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.857772  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.859962  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.860855  2324 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.865772  2365 raft_consensus.cc:359] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.872959  2329 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.873299  2328 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.873853  2328 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.866438  1904 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.874799  1904 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.875423  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.875656  1904 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.873914  2365 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:01:25.878108  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.878679  2370 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.878554  2386 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.879974  2329 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.880420  2386 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.880501  2329 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.879967  2365 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:25.881399  2329 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.877058  2324 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.882902  2329 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.885838  1904 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.886186  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.887332  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.888455  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.888861  2322 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.889360  2319 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.889515  2322 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.889810  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.890545  2319 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.890486  2322 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.890969  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.891777  2319 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.892217  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.893002  2319 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.893404  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.894212  2319 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.895721  2384 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.896107  2384 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.896564  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.897099  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:25.896886  2384 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.898164  2384 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.898329  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.900342  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.887183  2324 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.887269  2370 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.904978  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.905906  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.907508  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.908823  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.910478  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:25.913843  2328 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.915967  1535 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:25.917225  2328 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.918295  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.920153  2370 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.921506  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.922051  1607 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.923547  2370 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.924885  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.926821  2370 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.928294  2332 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:25.929560  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.930039  2385 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.930845  2385 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.931658  2365 ts_tablet_manager.cc:1434] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:01:25.931931  2385 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.933251  2385 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.944769  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.946084  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.943035  2370 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.944123  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-abc3085f661f457e8c8d15478c227311 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:01:25.951457  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-abc3085f661f457e8c8d15478c227311 on tablet abc3085f661f457e8c8d15478c227311 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:25.951689  2361 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.952082  2383 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:25.952246  2361 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.952484  2383 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:25.953269  2361 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.953425  2383 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.954797  2383 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.961265  1535 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:25.947116  2324 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:25.963191  1527 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:25.973697  1528 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:25.973380  1432 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.977502  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:25.980571  2370 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:25.981422  2370 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:25.982256  2370 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:25.965286  1534 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:25.988126  1607 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.992214  1602 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.996922  1533 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:25.998641  1607 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:25.999814  1602 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.001171  1603 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.002786  2362 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.003490  2332 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.005184  2382 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.006637  1603 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.008472  2332 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.011437  2384 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.012259  2384 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.012646  2329 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.013355  2329 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.014673  2329 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.016623  2382 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.017022  2382 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.017753  1904 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.018038  2337 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.018080  2382 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.018718  1904 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.019284  1904 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.019912  2382 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.021621  1904 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.022284  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:26.023324  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:26.023312  1607 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.004868  2386 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.027105  1904 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.027644  2322 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:26.026928  2317 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:26.028170  2337 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.032498  2322 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:26.032531  2317 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:26.030143  2337 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.033558  2322 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.033727  2317 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.034622  2337 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.044269  2356 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.046533  2356 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.035986  2337 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.052974  1528 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.053289  2329 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.037732  2338 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:26.057158  2367 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:26.060307  1607 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:26.061226  1499 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f5eb582ff4540bb9b59540cc56f458a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:26.063205  2334 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.046031  2384 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.065232  2384 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.067211  2386 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.089613  1432 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.092626  1432 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.081432  2356 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.103001  1603 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.116751  2356 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.118371  2332 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.119431  2332 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.119738  2332 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.125181  2328 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:26.139617  2328 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.140516  2328 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.142143  2328 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.152725  1603 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.155265  2210 raft_consensus.cc:1217] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:26.156185  2210 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:26.158686  1678 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:26.152410  2332 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:26.164738  2332 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.169457  1603 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.171939  2334 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.236166  1432 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 3, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.238942  1432 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.241679  1535 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.243312  2351 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.283968  2210 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:26.285558  2322 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:26.293726  1678 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:26.296059  2322 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:26.366608  1535 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.367167  1678 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.368917  2317 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.370543  2361 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.371114  1678 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.380780  1678 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.383558  2317 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.394547  1528 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.396669  2317 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.403502  2328 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.404362  2328 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:26.409965  2328 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:26.410279  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:26.411221  2210 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:26.411605  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:26.413050  1499 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:26.414192  2397 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:26.414635  2397 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.415045  2397 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.446775  2397 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:26.454366  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:26.459617  1534 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.462600  2324 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.465036  1681 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.480969  2397 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:26.482303  1681 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.482849  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:26.483525  2210 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.484469  2317 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.494033  1535 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.504261  2370 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.510283  1528 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:26.512122  2317 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.536615  2210 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:26.546005  1499 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:26.547197  2328 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:26.547699  2328 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:26.549539  2328 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:26.560698  1681 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.570688  1681 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:26.578523  2322 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.592607  1678 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.605039  1678 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:26.606472  2322 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:26.614173  2322 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.614746  2322 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.617700  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.618379  1534 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:26.619797  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:26.622560  2370 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:26.622964  2370 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.623296  2370 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.631219  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:26.631978  1676 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:26.633780  2322 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:26.644513  2370 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.648784  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:26.650139  2324 raft_consensus.cc:1064] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:01:26.649441  1432 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.657383  2324 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:26.660458  2370 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:26.667071  1535 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.668154  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:26.670229  1680 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.679103  1680 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:26.680637  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:26.682269  2370 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:26.682826  2370 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:26.683645  2370 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.684267  2210 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.685297  1535 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:26.686241  2317 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.692843  1680 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.694443  2317 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.711159  1535 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:26.712955  2317 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.720669  2324 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.724876  1680 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.736893  1534 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.737658  2210 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.759879  1432 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 2 to 3, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.783098  1431 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.786650  2370 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.787482  2370 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.800436  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.808478  2347 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.809168  2347 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.812915  2347 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.812808  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.813488  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.813817  1603 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.814080  1534 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.815228  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:26.816124  2395 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.816496  2395 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.816845  2395 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.818934  2351 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.819617  2351 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.822109  2351 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.826141  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.828507  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.829440  1603 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.831103  2370 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:26.831050  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:26.831838  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:26.834182  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:26.836390  2324 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:26.836795  2324 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.837163  2324 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.839078  1534 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.840466  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:26.841434  2347 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.841809  2347 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.842188  2347 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.842844  2399 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.843366  2399 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.845700  2399 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.860544  2347 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.861595  1603 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:26.857447  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.863448  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:26.875483  1535 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.846469  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.876327  1534 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.877358  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:26.878520  2351 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:26.878907  2351 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.879262  2351 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.878690  2395 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.884095  2210 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.885556  1528 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:26.892616  2317 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:26.894848  2317 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.903891  2347 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.907634  2322 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.868273  2324 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.912561  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:26.913160  1680 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.886984  2351 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.916791  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:26.920089  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:26.923564  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:26.924402  1607 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.924543  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:26.920580  2324 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:26.926000  1534 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.929426  2324 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:26.929949  2324 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:26.930778  2324 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.933336  1603 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.934594  2351 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.919999  2210 raft_consensus.cc:2955] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:26.922461  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:26.948145  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:26.908644  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:26.958928  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abc3085f661f457e8c8d15478c227311 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.961701  2351 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:26.962415  2351 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:26.963518  2351 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.922500  2395 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.970507  2422 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.971184  2347 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:26.971029  2422 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.971679  2347 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.973248  2422 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:26.974167  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65615.3us
I20260709 13:01:26.974645  2347 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:26.976383  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:26.977015  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.977632  1528 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.979504  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:26.980093  1528 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.981297  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:26.981900  1535 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.984066  1533 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:26.989177  2328 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:26.989761  2328 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:26.991850  2328 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:26.994854  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:26.995518  1680 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:26.996206  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.997009  1603 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.997287  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:26.998188  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.998915  1607 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:26.999145  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:26.999856  1603 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.000837  2328 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.001217  2328 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:27.001564  2328 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.009948  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.011476  2347 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.011974  2347 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.012538  2347 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.017421  1535 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:27.020290  2347 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.021183  2328 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.030812  1432 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 3 to 4, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:27.034195  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.034442  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.035136  1603 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.026779  2351 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.037223  2351 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.038622  2328 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.042913  2351 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.044159  1680 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.044462  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.047526  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.048745  2328 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:27.050251  2328 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:27.050705  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet abc3085f661f457e8c8d15478c227311 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39164
I20260709 13:01:27.051388  2328 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.056550  2395 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.057147  2395 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.057902  2425 tablet_replica.cc:333] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:01:27.059270  2425 raft_consensus.cc:2243] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:27.059629  2395 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.060343  2422 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.060863  2422 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.062808  2422 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.065354  1432 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.030073  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.068316  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.072193  2425 raft_consensus.cc:2272] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:27.074003  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.105000  1603 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.097118  2427 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.105688  2427 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.105088  1607 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.079478  2397 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.107875  2427 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.109258  2397 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.112005  2397 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.112941  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.113631  1607 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.113090  2397 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.114864  2397 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.115593  1681 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.117448  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.118175  1678 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.119448  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:27.120241  2425 ts_tablet_manager.cc:1916] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:27.120462  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.121398  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.121620  2351 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.122017  2351 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.122466  2351 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.123047  2427 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.123464  2427 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.123821  2427 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.124366  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:27.127224  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97218.5us
I20260709 13:01:27.127990  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.129469  2399 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:27.129987  2399 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:27.130904  2399 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.122165  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.135185  1681 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.118196  2397 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.141319  2397 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:27.141888  2397 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.148995  2351 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.151250  2351 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.158360  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.162437  2429 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:27.169553  2427 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.174881  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.175140  2430 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.175573  1607 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.176378  2432 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:27.165149  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80369.5us
I20260709 13:01:27.178653  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.178186  1431 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.179450  1603 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.181388  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.182253  1602 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.184484  2435 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.192553  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:27.178138  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.185220  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.193481  1534 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.186301  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.194097  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:27.194393  1533 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.185477  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.166687  2397 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.195451  1535 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.196501  1607 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.196867  2427 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.197777  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:27.200204  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.200911  1607 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.204244  2397 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.204725  2397 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.205075  2397 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.206772  1528 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.175583  2430 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.186369  2210 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.109232  2347 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:27.187206  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50709.6us
I20260709 13:01:27.213306  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:27.209523  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.215600  2429 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:27.216837  2433 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.217257  2395 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.213037  2432 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.192291  2435 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.213456  2324 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.233383  2322 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.233968  2322 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.235160  2425 ts_tablet_manager.cc:1929] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:27.235633  2425 log.cc:1199] T abc3085f661f457e8c8d15478c227311 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/abc3085f661f457e8c8d15478c227311
I20260709 13:01:27.235786  2430 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.238016  2322 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.238772  2434 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.239248  2434 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.240233  2322 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:27.221302  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.222944  2395 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.223757  2328 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.229071  2432 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.243625  1533 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.240829  2322 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.251523  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.255211  2432 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.252647  2395 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.240233  2324 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.259269  2322 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.259414  2324 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.256775  1432 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 2, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.253328  2435 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.249079  2328 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:27.229837  2433 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.253789  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet abc3085f661f457e8c8d15478c227311 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:01:27.256449  2427 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:27.248238  2430 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.262799  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.263020  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.263500  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.263918  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.268301  1533 raft_consensus.cc:2368] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:27.268187  1604 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.270044  1535 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.264452  2324 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.270941  2430 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.271184  2324 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.271938  2434 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.272293  2433 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.273031  1607 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.250736  2397 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.263633  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.275355  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.275738  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.276872  1681 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:27.277994  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.278574  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.280061  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.280915  1678 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:27.282320  2397 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.282646  1676 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:27.266238  2328 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.284336  2430 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.240700  2429 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.289974  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.292744  1574 leader_election.cc:400] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:27.293087  1574 leader_election.cc:403] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.293934  2438 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.295424  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.295889  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.296355  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.296721  2322 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.297894  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.298435  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.299135  1607 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.299271  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.299844  1681 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.300820  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:27.301941  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.298508  1682 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.302536  1679 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.302031  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.304050  1683 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.305259  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.306150  1676 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:27.306198  2351 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.310274  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.310886  1680 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.310074  2351 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.292470  2435 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:27.302999  2397 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.315395  2397 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.315949  2397 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.311087  2428 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.320547  2428 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.320889  2428 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.302241  2430 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.329226  1679 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.317418  2328 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.303557  2361 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.331881  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:27.331902  2444 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.333878  2442 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.336884  2433 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.337584  2434 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.337568  2347 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.338860  2445 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.363055  2430 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.345247  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.346417  2440 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.345069  2446 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.355669  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.356881  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.358500  1432 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.359870  1607 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.360544  2322 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:27.408509  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.410910  2446 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.367515  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.414559  1528 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.414937  2328 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.415105  2446 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.375692  2361 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.294469  2438 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.390750  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.412619  1432 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.398485  1680 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.338649  2399 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.361182  2429 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.361642  1679 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:27.377537  2324 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.418769  1604 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.411587  1602 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.389456  2444 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.410741  2440 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.432982  2399 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.435508  2429 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.437537  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.417035  2430 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.428431  2361 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.415657  2328 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.416131  2445 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.406873  2434 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.433591  2427 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:27.422951  2347 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.405838  2433 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:27.468434  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 136647us
I20260709 13:01:27.447934  2444 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.487373  2347 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.487864  2445 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.489806  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.490051  2440 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.490489  1532 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.490573  2440 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.491102  2440 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.491365  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.493322  2434 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.498100  2439 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.498656  2439 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.500154  2429 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.502408  2433 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.503156  2438 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.496711  2432 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.504928  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.505798  1602 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.505154  2351 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.485828  2428 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.467916  2328 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.509701  1531 raft_consensus.cc:2368] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:27.510725  2428 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.510799  2328 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.491760  2397 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.513720  2399 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.514066  1530 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:27.484120  2447 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.515558  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.512794  1603 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.512352  2446 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.515635  2328 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:27.538573  2322 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.544112  2322 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.546439  2322 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.525795  2324 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.559854  2428 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:27.560778  2428 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.562163  2435 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:27.563555  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 197408us
I20260709 13:01:27.573352  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.574293  1604 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:27.575402  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.576483  1607 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.579861  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.580852  1604 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:27.584194  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.546260  2328 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.603300  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.550628  2324 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.604825  1604 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.609162  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.610067  1601 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.544238  2446 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.612282  2397 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.523584  2447 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:27.614012  2351 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.614738  2446 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.614521  2437 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.612226  2435 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.609293  1608 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.622035  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.625319  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.611815  2428 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.616370  2437 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.623633  1604 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.625955  1607 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.607035  2324 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.629261  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.631393  2445 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.630241  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.622181  2370 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.634195  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.634747  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.635087  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.614581  2351 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.635421  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.672545  1679 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:27.636416  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.624363  2430 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.637075  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.674974  1681 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.675695  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.637741  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.678404  1684 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.679801  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.638516  2440 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.614888  2447 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.639489  2432 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.617094  2450 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.625679  2397 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.640143  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.640918  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.641667  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.648000  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:27.690009  1605 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.690341  1534 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:27.711822  2449 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.649739  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.644498  1606 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.632836  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.658010  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.712471  2449 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.659302  1683 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.671020  2322 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.713827  1680 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.716336  2322 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.717159  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:27.713393  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 55479.3us
I20260709 13:01:27.717763  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.668584  1607 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.635744  2439 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.722193  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.684098  2448 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.723007  1684 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.660349  2427 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:27.681679  1676 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.687037  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:27.734517  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47602.6us
I20260709 13:01:27.683066  1675 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:27.660435  2399 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.649199  1535 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.743093  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:27.718400  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.718406  1683 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.751646  1680 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.753002  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.753952  1680 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:27.672917  2446 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:01:27.725281  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:27.761015  1684 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:27.725281  1681 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.726266  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:27.727849  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 78184.6us
I20260709 13:01:27.625648  2457 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:27.765137  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:27.765547  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.688593  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.746253  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:27.723201  2376 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:27.763773  1684 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:27.766718  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.727152  2449 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.716970  2328 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.660944  2445 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.671164  2370 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.769462  1606 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:27.741484  2451 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.740767  2432 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.714847  2351 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.730793  1601 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.774119  2447 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.672762  2361 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.780100  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.728644  1610 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.723747  2448 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.800269  2458 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:27.803185  2448 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.760372  2440 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.748011  2428 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.765923  2399 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.711846  2397 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.773856  2317 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.777453  1501 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:27.807704  1679 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:27.812707  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:27.816437  1535 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:27.818217  1501 leader_election.cc:403] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.783960  2456 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.787819  2432 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.811975  2458 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:27.861196  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 94930.1us
I20260709 13:01:27.862896  2458 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.796149  2447 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.813027  2437 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.812098  2448 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.864853  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:27.874390  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 125563us
W20260709 13:01:27.875030  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62401.9us
I20260709 13:01:27.740871  2450 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.817404  2328 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:27.822698  2399 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.817941  2428 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.821960  2317 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.867110  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.822350  2429 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:27.823870  2432 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.865238  2441 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.877786  2447 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.773456  2457 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.914876  2468 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.913483  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.907194  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:27.921916  2439 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:27.922377  1606 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.921965  2468 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.922616  2439 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.924876  2439 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.925218  2468 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.820894  2440 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.900287  2435 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.821178  2427 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.929809  2455 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.908247  2448 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.961428  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.963430  2448 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.940249  1608 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.955341  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:27.957945  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 193705us
I20260709 13:01:27.964941  1607 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:27.966166  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:27.966804  1678 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.973341  2468 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.974257  2468 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.875684  2456 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:27.977963  2456 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:27.977844  1606 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.917586  2428 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.916888  2317 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.960543  1605 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.939846  1683 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:27.982366  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:27.984212  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.011s	sys 0.019s
W20260709 13:01:27.984668  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.011s	sys 0.020s
W20260709 13:01:27.985046  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 622275us
I20260709 13:01:27.986155  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.988139  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.919261  2328 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:27.931439  2446 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.948520  2460 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.929508  2466 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:27.987059  1601 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:28.001705  2459 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:28.002326  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.003264  1675 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:27.958343  2430 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.003747  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:27.985126  2441 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.003110  2452 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.935127  2435 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.984391  2468 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:27.996743  2446 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.004408  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:28.062242  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57911.1us
W20260709 13:01:28.063282  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81018.4us
W20260709 13:01:28.015640  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 150836us
I20260709 13:01:28.064769  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:27.928566  2429 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:28.020776  1531 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:28.066067  2370 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.066686  2466 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.004205  2460 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:28.022137  2430 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.032316  2328 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.034595  1678 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.041687  2450 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.013677  2453 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.038890  2432 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.043941  2452 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:28.017808  2441 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.996495  2455 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.064201  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.067997  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:28.064159  2438 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.068811  2466 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.069325  2351 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.070817  2440 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.072367  2361 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.090118  2438 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.091588  2449 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.098008  2438 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.098354  2449 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.099108  2317 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.078994  2324 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.073081  2445 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:28.101465  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.019924  2435 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.074580  2460 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.085985  2457 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.082104  2452 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.086191  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.086606  2432 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.086884  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.088268  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.121893  1609 raft_consensus.cc:2368] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.090093  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.090114  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.090934  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.124078  1681 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.076979  2430 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.093237  2465 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.094167  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.080427  2453 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:28.104096  1604 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:28.063424  2446 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:28.119251  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55360.8us
W20260709 13:01:28.118880  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 192044us
I20260709 13:01:28.104614  2450 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.138955  1681 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:28.110741  2351 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:28.145767  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 55007.3us
I20260709 13:01:28.154151  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.167650  1607 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:28.154876  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:28.111907  2440 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.101713  2467 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:01:28.172607  2440 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.173413  2467 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.173941  2467 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.174889  2440 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.176831  2467 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.179119  2455 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:28.177186  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46899.8us
I20260709 13:01:28.187985  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.128139  2430 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.195070  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.196100  1605 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:28.140657  2457 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.150528  2453 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.185271  2444 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
I20260709 13:01:28.180472  2432 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.163336  1677 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
W20260709 13:01:28.217116  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127082us
I20260709 13:01:28.219735  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.186281  2450 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:28.220965  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:28.221433  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66685.1us
I20260709 13:01:28.241381  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:28.242107  1606 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.243129  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.243415  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.243743  1530 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.243813  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.244850  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.246395  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.247200  1530 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.247316  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.248081  1607 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:28.248237  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:28.248967  1530 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.249123  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.250660  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.242125  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.253343  1534 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.254700  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.255538  1534 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.243956  1533 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.244549  1535 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.259428  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.269127  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.270818  1533 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.274370  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.280680  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.281626  1605 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
W20260709 13:01:28.288290  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 111555us
I20260709 13:01:28.289933  1648 leader_election.cc:400] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.290593  1648 leader_election.cc:403] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.292186  1648 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.292838  1648 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.292558  1530 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:28.220477  2432 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:28.254314  2455 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.256880  2468 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.207976  2457 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.300786  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.261152  2442 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.217599  2444 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.274091  1601 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:28.274601  2467 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.323052  1606 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.298296  2434 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.325956  1531 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.309618  2468 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.334857  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:28.353217  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 116050us
I20260709 13:01:28.317224  2455 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:28.358173  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.358492  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.356153  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.358846  2455 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.361722  2428 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:28.320649  2449 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.326395  2467 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.323665  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.369629  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.384682  1610 raft_consensus.cc:2368] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:28.356840  2468 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.376178  2439 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.335036  2434 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.329088  2442 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:28.377738  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.382097  2475 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.329793  2465 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:28.414917  1602 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:28.382160  2477 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:01:28.390959  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.394737  2447 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.382812  2467 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.396203  1527 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:28.383095  2428 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.398065  2451 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.400306  2466 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.400770  1603 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.401517  1526 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:28.306936  2351 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.373790  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:28.433101  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59418.7us
I20260709 13:01:28.401749  2457 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.355755  2317 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:28.409236  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 218531us
I20260709 13:01:28.363725  2435 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.414058  2434 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.387804  2438 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.355804  2399 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.417342  1528 raft_consensus.cc:2368] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.414999  2442 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.414813  2475 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.399514  2452 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.329152  2450 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.427264  1535 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:28.425148  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64215.6us
I20260709 13:01:28.405627  2460 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.434486  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:28.461855  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.385076  2470 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.472513  1684 raft_consensus.cc:2368] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:28.473052  1682 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:28.429596  2446 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.430588  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.427032  2451 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.383082  2432 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.429086  2444 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.442435  2361 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.444989  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:28.476276  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.479079  1680 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:28.475106  2317 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.481084  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.484126  1531 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:28.485463  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:28.490695  2475 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:28.487286  1676 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.720s	user 0.013s	sys 0.000s
W20260709 13:01:28.497102  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52259.1us
I20260709 13:01:28.493844  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:28.488955  2361 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.493276  2317 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.499948  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.500864  2476 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.429947  2465 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.497094  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.499768  2483 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:01:28.519842  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.521812  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.523031  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.526409  2322 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.487913  2449 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.507907  2477 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.512557  2444 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.547029  1681 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.527884  2361 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.547662  1683 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:28.509213  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.529280  2475 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.530081  2317 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.538846  2447 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.546275  2435 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.560725  1527 raft_consensus.cc:2368] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.549168  2476 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.550331  2477 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.551962  2449 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.556937  2444 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.561638  1677 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.582545  2475 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.585667  1526 raft_consensus.cc:2368] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.527756  2441 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.592052  2477 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.605315  1681 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:28.591359  2449 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.592804  2444 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.590699  2476 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.593209  2399 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:28.596907  2452 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:28.614523  2446 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.604209  2475 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.595871  2479 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:28.646762  2438 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:28.647073  2397 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.630776  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.656385  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.657114  1681 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:28.658058  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.658591  1681 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.659581  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.632565  2460 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.660197  1684 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:28.664328  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.665670  1683 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.665846  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.663792  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.666533  1684 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:28.674204  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 152) took 1303 ms. Trace:
I20260709 13:01:28.675791  1533 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:28.677662  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:28.690495  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.691998  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.694373  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.696954  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:28.703408  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 187022us
I20260709 13:01:28.707252  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:28.708700  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 195699us
I20260709 13:01:28.712131  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:28.716934  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 245660us
I20260709 13:01:28.707883  1684 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:28.718281  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.720793  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 695) took 1078 ms. Trace:
I20260709 13:01:28.722147  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:28.721295  1682 rpcz_store.cc:276] 0709 13:01:27.634111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.636130 (+  2019us) service_pool.cc:224] Handling call
0709 13:01:28.712785 (+1076655us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540037fad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:28.712951 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819800832}
I20260709 13:01:28.727560  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.709972  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:28.730821  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:28.732576  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:28.692772  2460 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.706228  2475 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.705739  2397 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:28.739972  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:28.740782  1682 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.743266  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:28.753396  1605 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:01:28.754148  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44304.4us
I20260709 13:01:28.705464  1676 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:28.755924  1501 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:28.723889  2440 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.724745  2455 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.769526  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:28.723237  2471 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.732935  2439 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.750411  2397 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.728312  2447 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:01:28.791508  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 654) took 1132 ms. Trace:
I20260709 13:01:28.822901  2324 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.777278  2457 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.830324  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.830789  1681 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.831262  1682 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:28.832604  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:28.838716  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:28.839306  1535 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.756584  2460 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.795380  2440 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:28.802034  2397 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.674712  1432 rpcz_store.cc:276] 0709 13:01:27.354325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.354478 (+   153us) service_pool.cc:224] Handling call
0709 13:01:28.657480 (+1303002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:27.543318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:27.548522 (+  5204us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:27.548577 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:01:27.548596 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:27.605723 (+ 57127us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:27.608578 (+  2855us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:27.617309 (+  8731us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:27.631790 (+ 14481us) tablet.cc:701] Row locks acquired
0709 13:01:27.631819 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:01:27.631954 (+   135us) write_op.cc:270] Start()
0709 13:01:27.632086 (+   132us) write_op.cc:276] Timestamp: P: 1783602087631913 usec, L: 0
0709 13:01:27.632106 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.632720 (+   614us) log.cc:844] Serialized 928 byte log entry
0709 13:01:27.635716 (+  2996us) op_driver.cc:464] REPLICATION: finished
0709 13:01:27.636163 (+   447us) write_op.cc:301] APPLY: starting
0709 13:01:27.636241 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:27.636365 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:27.636469 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:27.636789 (+   320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:27.636977 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:27.637023 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:27.637229 (+   206us) log.cc:844] Serialized 28 byte log entry
0709 13:01:27.637394 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.637478 (+    84us) write_op.cc:454] Released schema lock
0709 13:01:27.637516 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:27.637824 (+   308us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:27.637873 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14566,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":263,"apply.run_cpu_time_us":1629,"apply.run_wall_time_us":1629,"num_ops":2,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":3323,"prepare.run_wall_time_us":89673,"replication_time_us":3489}]]}
I20260709 13:01:28.878527  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.867249  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:28.795022  2455 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.804217  2482 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.856523  2466 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.801458  2439 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.893517  2457 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.920522  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 638) took 1330 ms. Trace:
I20260709 13:01:28.902565  2468 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.880437  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.909492  2429 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:28.816272  1608 rpcz_store.cc:276] 0709 13:01:27.659419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.660368 (+   949us) service_pool.cc:224] Handling call
0709 13:01:28.776991 (+1116623us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003093d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:28.791270 (+ 14279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352407936}
I20260709 13:01:28.920188  2457 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.897783  2435 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.920905  1609 rpcz_store.cc:276] 0709 13:01:27.590089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.597725 (+  7636us) service_pool.cc:224] Handling call
0709 13:01:28.003591 (+405866us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:28.920308 (+916717us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003be7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:28.920467 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261738624}
I20260709 13:01:28.921715  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:28.933264  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:28.930615  1535 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:28.826668  2471 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.939225  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:28.940702  1535 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.946764  1605 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:28.930771  2455 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.929941  2466 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:28.939548  2453 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.007s
I20260709 13:01:28.962630  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 657) took 1008 ms. Trace:
I20260709 13:01:28.963112  2499 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.948523  2324 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:28.950634  1603 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:28.948624  2447 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.938261  2428 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.971542  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:28.968433  2324 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:28.976789  2434 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.003s
I20260709 13:01:28.965700  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:28.977483  2434 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.978155  1532 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.963442  1610 rpcz_store.cc:276] 0709 13:01:27.954242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.957483 (+  3241us) service_pool.cc:224] Handling call
0709 13:01:28.962199 (+1004716us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001c7fd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:28.962559 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899672320}
I20260709 13:01:28.938580  2435 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.934093  2451 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.998587  2468 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.992295  2324 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.000777  2361 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.020823  1498 leader_election.cc:400] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:29.004978  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:28.965741  1535 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:28.963820  2499 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.004460  2471 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:28.894582  2449 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.021330  1498 leader_election.cc:403] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.948582  2440 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:28.996835  2428 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:29.031199  2449 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.035858  1677 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.037469  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.038072  1526 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:29.038960  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:29.040803  2428 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.005496  2466 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:29.060710  2439 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.042217  2476 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.082839  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.035s	sys 0.097s
W20260709 13:01:29.083413  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.036s	sys 0.097s
I20260709 13:01:28.967510  2453 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.080123  2460 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.101922  1684 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:29.114208  2430 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.911s	user 0.005s	sys 0.009s
I20260709 13:01:29.130751  2451 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:29.124239  2457 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.110507  2444 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.134436  2430 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.132136  2317 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.017s
I20260709 13:01:29.144719  1684 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.133313  2498 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.140754  1528 raft_consensus.cc:2368] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.132774  2434 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:29.142217  2430 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.155728  1606 raft_consensus.cc:2368] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
W20260709 13:01:29.138500  2467 consensus_meta.cc:287] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.711s	user 0.014s	sys 0.000s
I20260709 13:01:29.179168  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:29.190305  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 423) took 1100 ms. Trace:
I20260709 13:01:29.192075  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:29.192850  1681 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:29.193125  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 33) took 1256 ms. Trace:
I20260709 13:01:29.193552  1431 rpcz_store.cc:276] 0709 13:01:27.936910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.937143 (+   233us) service_pool.cc:224] Handling call
0709 13:01:29.193070 (+1255927us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719242,"reported_tablets":1}
I20260709 13:01:29.194514  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:29.198210  2499 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.167431  2457 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.147657  2317 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.199240  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.233637  1605 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.200153  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:29.204481  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.148675  2441 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.207571  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:29.237723  1607 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:29.236486  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:29.222663  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:29.190768  1680 rpcz_store.cc:276] 0709 13:01:28.089706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.089895 (+   189us) service_pool.cc:224] Handling call
0709 13:01:29.190116 (+1100221us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400032ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:29.190239 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817002240}
I20260709 13:01:29.167714  2435 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.220798  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.242982  1648 leader_election.cc:400] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.243404  1648 leader_election.cc:403] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:29.190809  2361 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:29.151477  2490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.055s
I20260709 13:01:29.245872  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.250944  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:29.257000  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:29.258093  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:29.251473  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:29.259254  1533 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.230865  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:29.268603  1604 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:29.182133  2467 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.231805  2351 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.266459  2429 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.239758  2430 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.250487  2434 raft_consensus.cc:2764] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:29.256222  2370 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:29.251865  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.266047  2468 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:29.286726  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.003s	sys 0.023s
I20260709 13:01:29.173667  2498 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.384435  1534 raft_consensus.cc:2368] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.237293  2457 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.388145  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 454914us
I20260709 13:01:29.393512  1533 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.276515  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:29.274261  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:29.277011  1650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.047s	sys 0.060s
I20260709 13:01:29.293207  2453 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:29.400887  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.042s
I20260709 13:01:29.399366  2476 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.428371  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:29.283571  2430 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.429879  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.023s
I20260709 13:01:29.286954  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:29.439235  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.003s	sys 0.037s
W20260709 13:01:29.492492  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.023s
W20260709 13:01:29.492776  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 762370us
W20260709 13:01:29.428927  2397 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.011s
I20260709 13:01:29.447263  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.448369  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.441094  2370 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:29.449178  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.481035  1531 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.415874  2444 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.494411  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:29.445432  2468 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:29.477264  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:29.501411  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54240.1us
I20260709 13:01:29.502142  1682 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:29.503720  1501 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:29.504134  1501 leader_election.cc:403] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:01:29.441323  2450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.003s	sys 0.009s
I20260709 13:01:29.442757  2440 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.437304  2435 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.484234  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:29.481642  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.006s	sys 0.042s
I20260709 13:01:29.505823  1605 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:29.507110  1605 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:29.509228  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.493260  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:29.441756  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 183739us
I20260709 13:01:29.452284  2351 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:29.498559  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:29.525446  1648 leader_election.cc:400] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.525542  1681 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.525779  1648 leader_election.cc:403] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:29.456210  2478 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:29.486846  1650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.053s	sys 0.063s
I20260709 13:01:29.479974  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:29.511242  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:29.438417  2460 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.529404  2478 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.501596  2432 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.524784  2351 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:29.552115  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:29.571018  2428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.044s	sys 0.037s
I20260709 13:01:29.526973  1648 leader_election.cc:400] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.622438  1648 leader_election.cc:403] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:29.552981  2503 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:29.512286  2450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.003s	sys 0.009s
I20260709 13:01:29.497907  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:29.500907  2475 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.007s
W20260709 13:01:29.560771  2502 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:29.567324  1681 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:29.529474  1433 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:29.577355  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66236.3us
I20260709 13:01:29.577854  2513 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:29.670594  2497 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.670743  2430 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.670984  2513 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:29.671792  2467 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.672139  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:29.672780  1535 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:29.572520  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 67310.9us
I20260709 13:01:29.674245  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:29.531613  2453 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.676517  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:29.553565  2317 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.525839  2512 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.497115  2397 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.572384  2504 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:29.561568  2458 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:29.546729  1605 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:29.624550  2428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.044s	sys 0.037s
I20260709 13:01:29.707791  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.708214  2519 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.708437  1608 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.708967  2519 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:29.711227  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 708) took 1057 ms. Trace:
I20260709 13:01:29.711686  1683 rpcz_store.cc:276] 0709 13:01:28.654230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.880885 (+226655us) service_pool.cc:224] Handling call
0709 13:01:28.883744 (+  2859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.884147 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.884177 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.885109 (+   932us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.493190 (+608081us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:29.493233 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.493298 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.693595 (+200297us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:29.710822 (+ 17227us) raft_consensus.cc:1685] finished
0709 13:01:29.710844 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.711162 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4875,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":19313920,"thread_start_us":607707,"threads_started":1,"wal-append.queue_time_us":668918}
I20260709 13:01:29.713629  2457 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.661062  1647 leader_election.cc:400] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
W20260709 13:01:29.715512  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131167us
I20260709 13:01:29.716217  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:29.717373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:29.661537  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 134480us
I20260709 13:01:29.532615  2435 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.623761  2511 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:29.576545  2476 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.623997  2351 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.585029  2478 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.578862  2464 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.671173  2497 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.530539  2444 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:29.572911  2440 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:29.739696  1532 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.006s
I20260709 13:01:29.660791  2434 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:29.695120  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:29.759127  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:29.759511  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64562.2us
I20260709 13:01:29.760365  2435 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:29.760673  2516 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:29.757673  2397 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.768316  1608 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:29.666599  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 434) took 1113 ms. Trace:
I20260709 13:01:29.704933  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:29.707410  1530 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:29.660624  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 157086us
I20260709 13:01:29.724918  1605 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:29.623780  2432 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:29.674003  2475 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.583881  2460 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.797726  2427 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.836326  2427 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.673576  2513 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.725628  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.758530  1532 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.741456  1535 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.846698  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:29.847764  1535 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.697772  2481 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.753595  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 622) took 1388 ms. Trace:
W20260709 13:01:29.736980  2506 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:01:29.692453  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.725608  2519 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:29.661007  2370 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.734259  2511 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.770046  2497 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:29.748118  2470 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:29.771642  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 718) took 1110 ms. Trace:
W20260709 13:01:29.754482  2477 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.141s	user 0.011s	sys 0.003s
I20260709 13:01:29.719455  2468 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.772714  2498 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.700031  2512 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.772957  2397 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.665020  1602 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.760699  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:29.843314  2475 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.787520  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:29.794000  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 614) took 2430 ms (client timeout 1614 ms). Trace:
I20260709 13:01:29.795486  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.855693  2455 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:29.797482  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 420) took 1711 ms. Trace:
I20260709 13:01:29.798419  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 439) took 1090 ms. Trace:
I20260709 13:01:29.739076  2476 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.799682  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.760944  2435 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.753273  2464 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.757869  2444 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:29.832903  2508 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:29.833917  2324 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.834146  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.834905  2432 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:01:29.802156  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65431.6us
W20260709 13:01:29.843684  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 118144us
I20260709 13:01:29.697456  2467 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.853680  1605 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:29.837203  2460 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.851181  1534 rpcz_store.cc:276] 0709 13:01:28.355264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.355454 (+   190us) service_pool.cc:224] Handling call
0709 13:01:29.743721 (+1388267us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540031a454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:29.743853 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145886720}
I20260709 13:01:29.782182  1531 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:29.883219  1535 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:29.890446  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:29.779551  2440 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:29.861338  2453 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:29.796228  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:29.858628  2513 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.904953  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:29.865836  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 417) took 1034 ms. Trace:
I20260709 13:01:29.866919  2511 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.882228  2450 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.995983  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 303677us
I20260709 13:01:29.891297  2519 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:29.862283  2481 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.219826  1683 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:30.220091  1682 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:30.221804  1681 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:01:30.224579  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 463961us
I20260709 13:01:29.975232  1679 rpcz_store.cc:276] 0709 13:01:28.086431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.086672 (+   241us) service_pool.cc:224] Handling call
0709 13:01:29.797178 (+1710506us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003cb4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:29.797316 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407089408}
I20260709 13:01:30.225222  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:29.996295  1684 rpcz_store.cc:276] 0709 13:01:28.708432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.718071 (+  9639us) service_pool.cc:224] Handling call
0709 13:01:29.798252 (+1080181us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54000bead4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:29.798363 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880592640}
I20260709 13:01:30.228613  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:30.227715  1576 leader_election.cc:400] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:30.230593  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:30.230829  1576 leader_election.cc:403] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:30.232005  1534 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:29.906210  1677 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:30.234736  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 447325us
I20260709 13:01:30.235386  2469 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.902702  2397 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.889482  2477 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.077665  2498 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.075685  2487 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.120918  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 664) took 1399 ms. Trace:
I20260709 13:01:30.229665  2471 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:30.228370  2212 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:30.246881  1681 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:30.230473  2460 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.240224  2447 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:30.261633  1534 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:30.272181  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:30.274916  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 433) took 1009 ms. Trace:
I20260709 13:01:29.907235  2475 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.238701  2435 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.232183  2450 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.232414  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 427) took 1199 ms. Trace:
I20260709 13:01:30.275388  1534 rpcz_store.cc:276] 0709 13:01:29.265711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.230277 (+964566us) service_pool.cc:224] Handling call
0709 13:01:30.274857 (+ 44580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.223100  1532 rpcz_store.cc:276] 0709 13:01:28.828728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.942665 (+113937us) service_pool.cc:224] Handling call
0709 13:01:29.862910 (+920245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.241237  2434 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.280248  2528 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.902966  1529 rpcz_store.cc:269] 0709 13:01:27.363789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.366809 (+  3020us) service_pool.cc:224] Handling call
0709 13:01:27.437335 (+ 70526us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:29.793581 (+2356246us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400319a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:29.793758 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4563135104}
I20260709 13:01:30.250276  2457 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:30.280290  1535 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
W20260709 13:01:30.283759  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.614s (SENT) [suppressed 1 similar messages]
I20260709 13:01:30.230885  2513 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:30.242055  2432 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:30.244812  2453 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:30.230104  2519 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:30.292296  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:30.230562  2324 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.281288  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:30.268716  2427 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:30.297061  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59638.1us
I20260709 13:01:30.272959  2471 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:30.099140  2478 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:30.304397  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 83318.2us
I20260709 13:01:29.781543  1678 rpcz_store.cc:276] 0709 13:01:28.521806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.530327 (+  8521us) service_pool.cc:224] Handling call
0709 13:01:28.561540 (+ 31213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.581019 (+ 19479us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:29.110827 (+529808us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.564195 (+453368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.575692 (+ 11497us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:29.577564 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.584727 (+  7163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.634668 (+ 49941us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":682231,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1793,"raft.queue_time_us":32832,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":11290,"thread_start_us":864385,"threads_started":2,"wal-append.queue_time_us":514616}
I20260709 13:01:30.311930  1534 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 1.
I20260709 13:01:30.151829  2508 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.281564  2498 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:30.341692  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:30.285161  2487 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.321193  1647 leader_election.cc:400] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:30.346015  1647 leader_election.cc:403] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:30.339058  2471 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.262784  2444 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.340307  2475 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.341711  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:30.300446  1601 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:01:30.339483  2526 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:01:30.302506  2485 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.283346  2460 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.287639  1531 rpcz_store.cc:276] 0709 13:01:29.032894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.244875 (+211981us) service_pool.cc:224] Handling call
0709 13:01:30.230300 (+985425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.266724  1603 rpcz_store.cc:276] 0709 13:01:28.720997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.724056 (+  3059us) service_pool.cc:224] Handling call
0709 13:01:30.120642 (+1396586us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400247f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:30.120843 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343340800}
I20260709 13:01:30.320457  2492 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:30.374018  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53017.6us
I20260709 13:01:30.265964  2469 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.304445  2457 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:30.403556  2530 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:30.407620  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:30.347371  2439 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:30.348213  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:30.415418  2439 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:30.422768  1527 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:01:30.424438  1527 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:30.368556  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:30.367931  2476 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.420114  2496 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.422995  2439 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.423658  2527 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.423913  2397 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.314018  2432 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.371717  2478 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.430168  2457 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.433666  2460 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.405550  2479 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.375829  2428 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.381335  2485 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.440214  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:30.447101  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:30.416138  2477 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.405473  2512 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.405669  2464 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.463682  2439 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.474272  2535 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.426522  2492 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.478868  2445 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.444391  2476 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:30.463078  2511 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.489251  2485 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:30.492947  2524 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.461655  2496 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:30.494889  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:30.470119  2513 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.342341  2528 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:29.882310  1676 rpcz_store.cc:276] 0709 13:01:28.661007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.883873 (+222866us) service_pool.cc:224] Handling call
0709 13:01:28.884185 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.884884 (+   699us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:29.554710 (+669826us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.747681 (+192971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.751103 (+  3422us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:29.754215 (+  3112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.758020 (+  3805us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.771580 (+ 13560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":677,"prepare.queue_time_us":514331,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":13376,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":18391,"thread_start_us":775557,"threads_started":2,"wal-append.queue_time_us":214546}
I20260709 13:01:30.496595  2439 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:30.451728  2481 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:30.504185  1535 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.508388  1681 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:30.496675  2445 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:30.470342  2428 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.505195  1532 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:30.499482  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:30.493734  2535 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:30.528951  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 416) took 2427 ms (client timeout 3156 ms). Trace:
I20260709 13:01:30.456802  2453 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.502840  2450 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.458153  2527 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:30.491986  2498 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.540875  1678 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 2.
W20260709 13:01:30.552305  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 288702us
I20260709 13:01:30.541764  2469 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.548023  1535 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:30.550393  2511 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:30.531251  1675 rpcz_store.cc:269] 0709 13:01:28.083147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.087088 (+  3941us) service_pool.cc:224] Handling call
0709 13:01:30.503122 (+2416034us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400035054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:30.510106 (+  6984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355155840}
W20260709 13:01:30.553849  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 269974us
I20260709 13:01:30.554721  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 434) took 1278 ms. Trace:
I20260709 13:01:30.555279  1535 rpcz_store.cc:276] 0709 13:01:29.276280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.494627 (+1218347us) service_pool.cc:224] Handling call
0709 13:01:30.553498 (+ 58871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.555562  1499 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:30.557879  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:30.565858  2328 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:30.566327  2328 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.566720  2328 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.543148  2470 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.543533  2519 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:30.545676  2439 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.535887  2524 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:30.922065  1648 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.014s	sys 0.009s
I20260709 13:01:30.674753  2328 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.893612  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 426) took 1885 ms. Trace:
I20260709 13:01:30.570493  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:30.802387  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.002s	sys 0.017s
W20260709 13:01:31.084831  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.007s	sys 0.004s
I20260709 13:01:30.763806  2428 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:30.709896  2351 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.002s
W20260709 13:01:30.925498  2507 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.182s	user 0.005s	sys 0.000s
W20260709 13:01:31.085135  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.009s	sys 0.002s
W20260709 13:01:30.911657  2471 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.004s
W20260709 13:01:30.861215  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 628) took 2490 ms (client timeout 2140 ms). Trace:
W20260709 13:01:31.172204  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.011s	sys 0.002s
I20260709 13:01:30.905189  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 675) took 1330 ms. Trace:
W20260709 13:01:31.153219  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.008s	sys 0.004s
I20260709 13:01:31.173322  2328 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.907645  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 661) took 2189 ms. Trace:
W20260709 13:01:31.174669  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 604214us
I20260709 13:01:30.911126  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 416) took 2082 ms. Trace:
I20260709 13:01:30.893997  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.149667  1648 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.023s	sys 0.012s
W20260709 13:01:31.179271  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 895452us
I20260709 13:01:31.179308  1607 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
W20260709 13:01:31.000937  2517 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.428s	user 0.003s	sys 0.010s
I20260709 13:01:31.151562  1533 rpcz_store.cc:276] 0709 13:01:29.008651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.892557 (+1883906us) service_pool.cc:224] Handling call
0709 13:01:30.892977 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.893193 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.893229 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.893283 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:30.893325 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.893407 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.893541 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.148646  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 422) took 2318 ms. Trace:
I20260709 13:01:31.174940  1604 rpcz_store.cc:276] 0709 13:01:28.718414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.718746 (+   332us) service_pool.cc:224] Handling call
0709 13:01:28.719094 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.271921 (+552827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.907363 (+1635442us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54001c84d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:30.907548 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263107968}
I20260709 13:01:31.198650  1535 rpcz_store.cc:276] 0709 13:01:28.830044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.558936 (+1728892us) service_pool.cc:224] Handling call
0709 13:01:30.559318 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.148242 (+588924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.148271 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.148330 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:31.148361 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.148428 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.148586 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:31.173341  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 827142us
I20260709 13:01:31.029306  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:30.927675  1431 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.858804  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 430) took 1715 ms. Trace:
I20260709 13:01:30.895741  2479 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:30.545011  2487 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:30.558723  1602 consensus_meta.cc:287] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
W20260709 13:01:31.163517  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.013s	sys 0.017s
I20260709 13:01:31.163326  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:31.175436  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:31.179939  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 675) took 1939 ms (client timeout 1712 ms). Trace:
W20260709 13:01:30.862497  2435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.021s
W20260709 13:01:31.152594  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.002s	sys 0.035s
W20260709 13:01:31.108110  2526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.010s	sys 0.020s
W20260709 13:01:30.737442  2514 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.050s	user 0.000s	sys 0.004s
I20260709 13:01:30.556424  2450 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:30.757164  2492 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:30.559998  2512 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:31.204520  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.009326  2430 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.005s	sys 0.022s
I20260709 13:01:31.205071  1605 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:31.072463  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.010s
W20260709 13:01:30.953318  2505 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.381s	user 0.001s	sys 0.003s
I20260709 13:01:31.205349  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.169888  2444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.004s	sys 0.009s
I20260709 13:01:31.201499  1530 rpcz_store.cc:276] 0709 13:01:29.143571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.256701 (+113130us) service_pool.cc:224] Handling call
0709 13:01:30.858511 (+1601810us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54002201d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:30.858718 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033260416}
W20260709 13:01:30.915066  2434 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:01:31.062345  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 676) took 1791 ms. Trace:
I20260709 13:01:31.148309  2508 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:30.909792  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:30.567216  2528 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.175565  1606 rpcz_store.cc:276] 0709 13:01:29.574234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.743254 (+169020us) service_pool.cc:224] Handling call
0709 13:01:29.756910 (+ 13656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.078732 (+321822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.078779 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.078838 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:30.078892 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.904885 (+825993us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400100254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:30.904939 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.905095 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739479808}
I20260709 13:01:31.201462  1431 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 2, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.708884  2445 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:31.180163  2397 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:30.735273  2324 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:31.213838  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.017s
I20260709 13:01:30.646423  2432 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.172412  2470 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:30.611776  2496 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:31.214531  1607 rpcz_store.cc:269] 0709 13:01:29.241014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.245216 (+  4202us) service_pool.cc:224] Handling call
0709 13:01:30.893824 (+1648608us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:31.179864 (+286040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21157120}
W20260709 13:01:31.591686  2550 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:01:31.593050  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.003s	sys 0.024s
I20260709 13:01:31.593134  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.196238  2468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.005s	sys 0.009s
W20260709 13:01:31.594641  2468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.019s	sys 0.016s
I20260709 13:01:31.564253  2549 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.519078  2535 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.595582  2549 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.497028  2520 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.597121  2520 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.598189  2549 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.596203  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 436) took 2092 ms. Trace:
I20260709 13:01:31.197739  2351 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.599252  2520 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.598837  1533 rpcz_store.cc:276] 0709 13:01:29.503864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.206965 (+1703101us) service_pool.cc:224] Handling call
0709 13:01:31.299780 (+ 92815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.594777 (+294997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.594812 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.594857 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:31.594896 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.595948 (+  1052us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:31.595992 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.596143 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677948288}
I20260709 13:01:31.512247  2534 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.210282  2532 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:31.387804  2455 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:31.600196  1683 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.601559  2455 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:31.601430  2532 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.601267  2534 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.602669  2455 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.210927  1535 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:31.604568  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 429) took 2466 ms. Trace:
I20260709 13:01:31.604919  1535 rpcz_store.cc:276] 0709 13:01:29.138359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.210056 (+2071697us) service_pool.cc:224] Handling call
0709 13:01:31.210651 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.604315 (+393664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.604510 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.605340  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.606046  1609 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:31.370218  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 194861us
I20260709 13:01:31.607216  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.607475  2467 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:31.601225  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:31.608418  1533 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 1.
I20260709 13:01:31.608685  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:31.608759  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:31.610193  1530 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:31.609437  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:31.178365  2471 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.610608  2427 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:31.613116  1534 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:31.614251  2471 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.614715  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 437) took 1363 ms. Trace:
I20260709 13:01:31.615171  1534 rpcz_store.cc:276] 0709 13:01:30.250875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.341477 (+ 90602us) service_pool.cc:224] Handling call
0709 13:01:31.614520 (+1273043us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540027bfd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:31.614653 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897971584}
I20260709 13:01:31.593909  2450 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.206560  2486 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.616735  1601 rpcz_store.cc:276] 0709 13:01:29.270901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.413528 (+142627us) service_pool.cc:224] Handling call
0709 13:01:29.447743 (+ 34215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.372121 (+924378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.055728 (+683607us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540005cdd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:31.062224 (+  6496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917892864}
I20260709 13:01:31.616979  2486 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.618440  2434 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:31.619357  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59111us
W20260709 13:01:31.620163  2430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.010s	sys 0.035s
I20260709 13:01:31.367014  2466 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.172497  1528 rpcz_store.cc:269] 0709 13:01:28.371121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.480580 (+109459us) service_pool.cc:224] Handling call
0709 13:01:30.860907 (+2380327us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54000708d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:30.861120 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482231680}
I20260709 13:01:31.616461  1610 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:31.621280  2466 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.606105  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:31.612746  2427 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.623063  2512 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.623322  2427 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.623622  2512 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.624159  2466 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.595747  2524 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.501798  2539 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:31.370811  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 207569us
I20260709 13:01:31.334509  2533 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:31.622625  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 669) took 2425 ms (client timeout 2204 ms). Trace:
W20260709 13:01:31.592540  2435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.016s	sys 0.045s
I20260709 13:01:31.627067  1535 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:31.626638  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 143) took 3352 ms. Trace:
I20260709 13:01:31.364020  2527 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:31.614907  2444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.014s	sys 0.012s
I20260709 13:01:31.213894  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:31.608420  2467 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:31.617794  2450 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.630201  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 645) took 1886 ms. Trace:
I20260709 13:01:31.611639  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 643) took 1869 ms. Trace:
I20260709 13:01:31.631565  1683 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:31.517486  1499 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f5eb582ff4540bb9b59540cc56f458a. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.584456  2548 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:01:31.584722  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:31.370242  2475 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.034s	sys 0.063s
I20260709 13:01:31.637246  2489 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.537973  2440 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.594012  1606 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:31.300374  2519 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:31.637449  2446 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.593318  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.599298  2526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.013s	sys 0.043s
W20260709 13:01:31.220782  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 191571us
I20260709 13:01:31.696852  1528 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:31.864774  1610 rpcz_store.cc:269] 0709 13:01:29.197635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.206668 (+  9033us) service_pool.cc:224] Handling call
0709 13:01:30.909590 (+1702922us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:31.622525 (+712935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12310272}
I20260709 13:01:31.865628  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:31.866417  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.866968  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:31.867316  1528 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:31.811843  2466 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.680459  2549 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.638341  2397 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.868249  2533 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:31.868468  2466 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.868752  2549 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.746268  2427 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.871016  2533 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:31.213779  1602 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:31.871802  2427 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.871268  2549 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.872375  2449 raft_consensus.cc:2764] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:31.872584  2427 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:31.678985  2508 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.873299  2427 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:31.873399  2508 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.805245  2470 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.874508  2467 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:31.875087  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 683) took 2365 ms (client timeout 1709 ms). Trace:
I20260709 13:01:31.682953  2468 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.875550  2467 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.771587  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.876899  2467 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.686489  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:31.751058  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.878037  2449 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:31.878504  2449 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:31.878671  2519 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.878947  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.879313  2519 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.880209  1608 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:31.879560  2449 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.814971  2486 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.881127  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.680608  2478 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.814460  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 419) took 2985 ms. Trace:
W20260709 13:01:31.679298  2551 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 13:01:31.364604  2479 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:31.871549  2475 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.041s	sys 0.085s
I20260709 13:01:31.497583  2497 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.644308  2534 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.678570  1533 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:31.696805  2351 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.885119  2440 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.886068  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.886137  1530 rpcz_store.cc:276] 0709 13:01:29.742667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.610864 (+1868197us) service_pool.cc:224] Handling call
0709 13:01:31.611123 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.611274 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.611297 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.611334 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:31.611360 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.611407 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.611588 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.887035  1533 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:31.669076  2532 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.871760  2435 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:31.883397  2527 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:31.871548  2446 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.890358  2527 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.645748  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.890779  2435 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.891695  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 418) took 3062 ms. Trace:
I20260709 13:01:31.680250  2544 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:31.892369  2544 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.892122  1529 rpcz_store.cc:276] 0709 13:01:28.829005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.467365 (+1638360us) service_pool.cc:224] Handling call
0709 13:01:30.467777 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.468202 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.468240 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.468791 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.593794 (+1125003us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:31.593839 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.594022 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.891440 (+297418us) raft_consensus.cc:1685] finished
0709 13:01:31.891480 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.891633 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190,"raft.queue_time_us":1269,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8616,"thread_start_us":1124581,"threads_started":1,"wal-append.queue_time_us":699582}
W20260709 13:01:31.884294  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 366952us
I20260709 13:01:31.894640  2544 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.692830  2499 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.894829  2446 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.882134  2489 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.871194  2466 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.902837  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.814028  2512 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:31.869171  2397 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.883982  2478 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.877247  1605 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:31.876693  2468 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.179034  1527 rpcz_store.cc:276] 0709 13:01:28.828323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.971168 (+142845us) service_pool.cc:224] Handling call
0709 13:01:30.910948 (+1939780us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540032fad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:30.911064 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991140224}
I20260709 13:01:31.680150  2324 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.651719  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.889393  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70512.3us
I20260709 13:01:31.692931  2529 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.909581  2554 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:01:31.914223  2529 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.914999  2554 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:31.915385  2554 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:31.916072  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.916450  2554 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.917196  2529 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.692591  2361 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:31.917752  2554 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.917968  2361 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.918749  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.645009  2492 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.884651  2479 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.896330  2450 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.920451  2450 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.921906  2479 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.862123  1534 rpcz_store.cc:276] 0709 13:01:29.743559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.629592 (+1886033us) service_pool.cc:224] Handling call
0709 13:01:31.629868 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.629992 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.630007 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.630033 (+    26us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:31.630056 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.630089 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.630159 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.911760  2468 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.908115  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:31.897045  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.883837  1531 rpcz_store.cc:276] 0709 13:01:28.829237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.510991 (+1681754us) service_pool.cc:224] Handling call
0709 13:01:30.539780 (+ 28789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.560739 (+ 20959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.582402 (+ 21663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.198163 (+615761us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.784520 (+586357us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:31.785655 (+  1135us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.813961 (+ 28306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.814070 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.814127 (+    57us) raft_consensus.cc:1685] finished
0709 13:01:31.814151 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.814338 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27517,"prepare.queue_time_us":230,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":28879,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":20027,"thread_start_us":354362,"threads_started":1,"wal-append.queue_time_us":455987}
I20260709 13:01:31.909245  2478 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.924985  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.925545  2492 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.907344  2519 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:31.926627  1610 raft_consensus.cc:2410] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:31.927578  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.890817  2527 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.930133  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.875936  2508 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:31.911145  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 732) took 2111 ms (client timeout 1920 ms). Trace:
I20260709 13:01:31.933156  2361 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.922924  2450 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:31.901576  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.002s
W20260709 13:01:31.934412  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.002s
I20260709 13:01:31.912171  1608 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:31.888052  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 201638us
I20260709 13:01:31.937512  1679 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:31.937613  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:31.938858  1681 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:31.939564  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.937556  1682 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:31.939857  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:31.940315  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.941071  2508 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:31.901954  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 703828us
I20260709 13:01:31.905539  1526 raft_consensus.cc:1240] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:31.907395  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.024s
W20260709 13:01:31.942271  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.004s	sys 0.024s
I20260709 13:01:31.942322  2478 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:31.943079  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 423) took 2983 ms. Trace:
I20260709 13:01:31.943171  2508 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:31.943709  1526 rpcz_store.cc:276] 0709 13:01:28.960123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.706795 (+1746672us) service_pool.cc:224] Handling call
0709 13:01:30.707298 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.942213 (+1234915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.942846 (+   633us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540030af54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:31.943019 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755225472}
I20260709 13:01:31.945004  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:31.943113  2478 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:31.945115  2508 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.946743  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:31.909421  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.944236  2534 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.948704  2534 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.949218  2555 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.949817  2555 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.903932  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:31.904791  2489 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.951427  1609 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.952561  2556 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.953131  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.953305  2556 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.954661  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.955251  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:31.875582  1602 rpcz_store.cc:269] 0709 13:01:29.510059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.551769 (+ 41710us) service_pool.cc:224] Handling call
0709 13:01:31.875005 (+2323236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.931917  2519 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.936468  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.956542  2519 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.938699  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.957201  2519 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:31.957203  1678 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:31.957810  2519 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.958199  2519 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.946542  2478 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.960916  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.895390  2499 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.961735  1602 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:31.905267  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 263344us
I20260709 13:01:31.956964  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:31.906980  2512 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:31.887240  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:31.898183  1650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.021s
I20260709 13:01:31.449389  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 421) took 2619 ms. Trace:
I20260709 13:01:31.884961  2497 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.888628  2440 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.989802  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.986168  1684 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:31.984874  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:31.993667  1602 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:31.988512  1606 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:32.021688  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.022702  1606 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:31.964407  2499 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:31.994740  1650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.022s
W20260709 13:01:32.037521  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.040313  1606 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.042256  2527 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:31.951913  2534 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.969779  2455 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:31.996850  1607 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.044539  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:31.911984  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:31.910322  2324 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.050989  1604 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:31.999107  2449 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:31.998113  1532 rpcz_store.cc:276] 0709 13:01:28.829842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.558393 (+1728551us) service_pool.cc:224] Handling call
0709 13:01:31.206855 (+648462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.289879 (+ 83024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.301145 (+ 11266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.335302 (+ 34157us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:31.365565 (+ 30263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.387353 (+ 21788us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.437646 (+ 50293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.999140  2351 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:31.981243  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.052789  1681 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:32.053803  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.054791  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.055260  1681 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.055697  1603 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.056895  2422 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.057514  2422 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:32.058542  2422 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.000558  2497 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.059505  2422 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.051584  2324 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:31.876195  1535 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.004607  2555 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:32.061674  1648 connection.cc:256] RPC call timeout handler was delayed by -1.6485220819999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:01:32.063090  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.064770  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.067965  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:31.982903  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.006693  1608 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.069252  1530 raft_consensus.cc:2368] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.007012  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:31.932788  1683 rpcz_store.cc:269] 0709 13:01:29.799829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.241612 (+441783us) service_pool.cc:224] Handling call
0709 13:01:31.883930 (+1642318us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:31.911056 (+ 27126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3047166208}
I20260709 13:01:32.070531  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.071254  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.009243  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:31.927821  2492 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:31.862378  1433 rpcz_store.cc:276] 0709 13:01:28.308044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.319579 (+ 11535us) service_pool.cc:224] Handling call
0709 13:01:31.626134 (+3306555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:29.827313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:29.828182 (+   869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:29.828230 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:01:29.828262 (+    32us) tablet.cc:662] Decoding operations
0709 13:01:29.828749 (+   487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:29.829358 (+   609us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:29.829414 (+    56us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:29.829657 (+   243us) tablet.cc:701] Row locks acquired
0709 13:01:29.829683 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:01:29.829895 (+   212us) write_op.cc:270] Start()
0709 13:01:29.830040 (+   145us) write_op.cc:276] Timestamp: P: 1783602089829822 usec, L: 0
0709 13:01:29.830073 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:01:29.831070 (+   997us) log.cc:844] Serialized 540 byte log entry
0709 13:01:31.594857 (+1763787us) op_driver.cc:464] REPLICATION: finished
0709 13:01:31.620620 (+ 25763us) write_op.cc:301] APPLY: starting
0709 13:01:31.620712 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:31.620823 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:31.620961 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:31.621214 (+   253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:31.621392 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:31.621447 (+    55us) write_op.cc:312] APPLY: finished
0709 13:01:31.621872 (+   425us) log.cc:844] Serialized 22 byte log entry
0709 13:01:31.622041 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.622113 (+    72us) write_op.cc:454] Released schema lock
0709 13:01:31.622150 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:31.624708 (+  2558us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.624740 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":337314,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":25517,"apply.run_cpu_time_us":1992,"apply.run_wall_time_us":1997,"num_ops":1,"prepare.queue_time_us":134381,"prepare.run_cpu_time_us":48010,"prepare.run_wall_time_us":146363,"raft.queue_time_us":1153311,"raft.run_cpu_time_us":1111,"raft.run_wall_time_us":30417,"replication_time_us":1764618,"thread_start_us":1590859,"threads_started":4,"wal-append.queue_time_us":266455}]]}
I20260709 13:01:32.071767  1530 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:32.071831  1683 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:32.075793  2455 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.076442  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.077188  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:32.012137  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.013813  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.080329  2579 ts_tablet_manager.cc:933] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:01:32.011780  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.015511  1675 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.080411  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.016498  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.080621  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.081405  1676 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.081758  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.083562  1675 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.019616  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.084448  1527 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:32.017551  1528 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:31.985347  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.085664  2455 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.086026  1680 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:32.086614  1684 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.086846  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:32.025695  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79034.1us
I20260709 13:01:32.087518  1680 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.022948  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.026489  2397 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:31.993292  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:32.087777  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.088614  1533 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:32.050894  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.051724  2449 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:32.089856  1529 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:31.989130  2556 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.090457  2449 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.076017  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 153) took 1607 ms. Trace:
I20260709 13:01:32.093437  1684 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:32.094980  1681 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 3.
I20260709 13:01:32.078163  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.075151  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:32.080449  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.014818  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.097594  1679 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:32.016315  1682 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.086650  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:31.932106  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.098508  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 86790us
I20260709 13:01:32.018772  2519 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:32.035761  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
W20260709 13:01:32.089933  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 96767.4us
I20260709 13:01:31.968791  2475 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.100499  1604 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.100625  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:32.102496  1680 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:32.101830  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.105484  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.105324  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.111658  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.114914  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.115792  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:32.102478  2455 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.118707  2450 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.119136  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.133360  2574 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:32.103734  2556 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.121960  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.109287  2435 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.110143  2533 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.105737  1678 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 1.
I20260709 13:01:32.134322  2455 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.114746  2440 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:32.160606  2455 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.161263  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.106648  2475 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.162221  2567 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.162832  2567 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:32.163431  2567 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.126863  2512 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.164381  2475 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.138478  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:32.165493  1526 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.117985  2351 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:01:32.168627  2351 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.169117  2351 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:32.170029  2351 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.171222  2351 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.139161  2556 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.173451  2556 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.174435  1676 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:32.134110  2450 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.176697  2450 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.093044  1431 rpcz_store.cc:276] 0709 13:01:30.468630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.475166 (+  6536us) service_pool.cc:224] Handling call
0709 13:01:32.075959 (+1600793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:31.989643 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:31.990465 (+   822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:31.990524 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:01:31.990552 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:31.991070 (+   518us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:31.991173 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:31.991213 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:31.991627 (+   414us) tablet.cc:701] Row locks acquired
0709 13:01:31.991652 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:31.991823 (+   171us) write_op.cc:270] Start()
0709 13:01:31.991974 (+   151us) write_op.cc:276] Timestamp: P: 1783602091991767 usec, L: 0
0709 13:01:31.992004 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.047456 (+ 55452us) log.cc:844] Serialized 928 byte log entry
0709 13:01:32.049292 (+  1836us) op_driver.cc:464] REPLICATION: finished
0709 13:01:32.049716 (+   424us) write_op.cc:301] APPLY: starting
0709 13:01:32.049815 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:32.049950 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:32.050039 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:32.050327 (+   288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:32.050561 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:32.050603 (+    42us) write_op.cc:312] APPLY: finished
0709 13:01:32.050777 (+   174us) log.cc:844] Serialized 28 byte log entry
0709 13:01:32.050940 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:32.051031 (+    91us) write_op.cc:454] Released schema lock
0709 13:01:32.051067 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:32.051351 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:32.051388 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":1603,"apply.run_wall_time_us":1604,"num_ops":2,"prepare.queue_time_us":128490,"prepare.run_cpu_time_us":3447,"prepare.run_wall_time_us":58123,"replication_time_us":57175,"thread_start_us":144757,"threads_started":1}]]}
I20260709 13:01:32.107137  1531 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:32.144289  2496 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:32.152631  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.133898  2574 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:32.153784  2539 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.144868  2435 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.154175  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.156558  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:32.200011  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.110388  1532 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:32.213326  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:32.181582  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 85432.5us
I20260709 13:01:32.183244  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.195039  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:32.215236  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 152972us
I20260709 13:01:32.185595  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.215456  1610 raft_consensus.cc:2368] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.186455  1606 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.192571  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.193259  2496 consensus_queue.cc:1243] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:32.223537  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.115450  2467 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:01:32.147398  2533 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.231066  2533 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.231564  2574 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:32.232602  2567 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:32.234390  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.234555  2553 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.234994  2553 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:32.235549  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.193488  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.194178  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.201272  2539 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.196302  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.184262  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.217756  1648 connection.cc:256] RPC call timeout handler was delayed by -1.431992216000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:01:32.194003  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:32.220468  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.190624  2524 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:32.221848  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.212054  2435 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.228966  1647 leader_election.cc:400] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.254132  1647 leader_election.cc:403] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.229781  2467 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.256526  2467 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:32.257718  2467 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.259054  2467 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.260591  2579 tablet_copy_client.cc:323] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:01:32.260915  1526 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:32.235590  2397 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.264896  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.266220  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.267426  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.268826  2567 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:32.269210  2578 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:32.271188  2524 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.271669  2524 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:32.237725  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:32.273062  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44270.9us
I20260709 13:01:32.236701  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.196018  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.246486  1648 connection.cc:256] RPC call timeout handler was delayed by -1.4265922160000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:01:32.274575  1683 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:32.275482  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.276822  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.246592  1680 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:32.246609  1607 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:32.249752  1679 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:32.278383  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.203121  2527 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.220842  2475 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.217412  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.274374  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.195395  1675 raft_consensus.cc:2376] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3. Re-sending same reply.
I20260709 13:01:32.279727  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.271222  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 3f5eb582ff4540bb9b59540cc56f458a from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:01:32.285202  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.330857  2397 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:32.356630  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.357932  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.358568  1675 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.350598  2435 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.359457  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.352818  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.360394  2519 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:32.299602  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.361757  1681 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:32.362914  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88892.8us
I20260709 13:01:32.361789  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.365263  1684 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.365849  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.366051  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.368510  1684 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.363459  1648 leader_election.cc:400] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.370258  1648 leader_election.cc:403] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.372172  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:32.372743  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 98451.2us
I20260709 13:01:32.372851  1681 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.374465  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.374490  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:32.376262  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.377305  2430 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:32.379086  2430 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.376127  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 3f5eb582ff4540bb9b59540cc56f458a from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-3f5eb582ff4540bb9b59540cc56f458a
I20260709 13:01:32.385080  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.380725  2397 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.385793  2397 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.386153  2397 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.358273  2533 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.388624  2533 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.379781  2491 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.392656  2491 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.330371  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.380471  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.285588  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.249643  2440 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.178s
I20260709 13:01:32.392676  1683 raft_consensus.cc:2410] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:32.580528  1545 tablet_copy_source_session.cc:215] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:32.250985  2539 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.350930  2534 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.398624  1679 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.593341  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.594452  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:32.583243  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 219897us
I20260709 13:01:32.597373  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:32.598908  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.595822  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.482872  1431 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 2 to 3, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.423502  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.382560  1684 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 2.
I20260709 13:01:32.602319  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.424005  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.396790  1680 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:32.586628  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.587414  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.603811  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.588119  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:32.567425  2586 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.295s	user 0.004s	sys 0.000s
W20260709 13:01:32.589097  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 208743us
I20260709 13:01:32.610749  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.526764  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.591781  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.607319  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.608494  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.330964  2427 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.248996  2553 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.612814  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:32.624464  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.613507  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.614217  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.394790  2422 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.616216  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.644727  1682 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.593523  2479 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.369942  2475 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.627244  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.629488  1604 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:32.607257  2555 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.588251  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.640877  1679 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.510913  2491 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.607717  1677 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.433094  2435 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.273838  2556 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.461709  2429 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.646236  1682 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.682488  1682 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:32.476377  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54154.9us
I20260709 13:01:32.432821  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:32.650571  1607 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.607316  1676 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.331111  2512 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.301s
I20260709 13:01:32.460877  2492 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
I20260709 13:01:32.655555  1605 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:32.631753  1684 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:32.657543  2475 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.645766  2539 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.697309  2539 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.697439  1532 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.698922  2539 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:32.661759  2397 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.655118  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:01:32.701473  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 63081.1us
I20260709 13:01:32.664119  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.702368  2527 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.702952  2527 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:32.703498  1604 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.703842  2527 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:32.705629  2512 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.706138  2512 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.624068  2427 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:32.707139  2427 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.371990  2524 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.639894  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:32.657205  2479 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.657063  2351 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.501550  2455 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.675218  2553 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.693140  2435 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.717177  1608 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.719484  1682 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:32.748468  1682 pending_rounds.cc:85] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 1
I20260709 13:01:32.748869  1682 pending_rounds.cc:107] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:32.749228  1682 raft_consensus.cc:2889] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.751760  2556 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.651790  2422 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.734462  2579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5eb582ff4540bb9b59540cc56f458a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:32.716298  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.743301  2589 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:32.761533  1681 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:01:32.762730  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.714969  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.720865  2479 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.764465  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.769999  2324 consensus_queue.cc:1059] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:32.711335  2499 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:01:32.772605  1608 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:32.793699  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.763273  2524 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.781864  1678 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.758556  2435 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.804230  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:32.817615  2455 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.827911  2422 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:32.723255  2496 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:01:32.829200  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:32.833588  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70563.4us
I20260709 13:01:32.834318  1677 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.850667  2175 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.851603  2574 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.848502  1601 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:32.862716  1676 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:32.886161  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 292452us
I20260709 13:01:32.847803  2435 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.891070  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:32.897068  1679 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.857571  1602 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:32.910606  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.888487  2450 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.711s	user 0.002s	sys 0.010s
I20260709 13:01:32.910797  2422 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.911145  2397 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:32.889729  2475 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:32.932632  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 333842us
I20260709 13:01:32.960299  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.961674  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.964584  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.961992  1648 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.968194  1648 leader_election.cc:403] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.974012  1679 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:32.983500  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.954185  2422 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.953119  2435 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:32.995656  1681 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:32.993896  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.997502  1679 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:32.971612  2585 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.685s	user 0.004s	sys 0.005s
I20260709 13:01:32.931941  2450 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:32.999275  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:33.048090  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 74351.6us
I20260709 13:01:33.049400  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:33.050690  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.978156  2397 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:33.051950  1682 raft_consensus.cc:2410] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:32.976239  2534 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.024322  1679 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.063254  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:33.021942  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.029057  2555 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.061398  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:32.990918  2491 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:32.976799  2512 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.028988  2497 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:32.992251  2422 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:33.064903  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.072376  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:32.957320  2591 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:01:32.987638  2592 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.082568  1679 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:33.087323  1683 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.090401  1679 pending_rounds.cc:85] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 1
I20260709 13:01:33.090729  1679 pending_rounds.cc:107] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:33.091049  1679 raft_consensus.cc:2889] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.029510  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:33.076921  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 321082us
W20260709 13:01:33.073837  2430 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.035s	sys 0.055s
I20260709 13:01:33.036123  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:33.122139  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.020s	sys 0.002s
I20260709 13:01:33.063864  2397 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.062165  2455 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.125366  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.020s	sys 0.002s
I20260709 13:01:32.999652  2574 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 13:01:33.121327  2430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.035s	sys 0.055s
I20260709 13:01:33.093819  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.093290  2512 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:33.148502  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 441476us
I20260709 13:01:33.078775  2440 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.128139  2397 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.150599  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.154973  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.127111  1532 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 2.
W20260709 13:01:33.186476  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43668.6us
I20260709 13:01:33.158669  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.145529  2430 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:33.206252  2430 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.154209  2512 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.135670  2592 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:01:33.155354  2440 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.051961  2593 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
W20260709 13:01:33.220645  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62074us
I20260709 13:01:33.131394  2455 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.203476  2492 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:33.225966  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 90520.5us
I20260709 13:01:33.192255  2599 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:33.233397  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 142877us
I20260709 13:01:33.221777  2440 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.234311  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.214318  2435 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:33.240927  2574 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.227787  2212 raft_consensus.cc:1240] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.216446  2512 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.228523  2596 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.222675  2608 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.237685  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:33.231161  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:33.264621  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43852.8us
I20260709 13:01:33.226312  2592 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.271099  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.274165  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.272485  2608 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.230312  2475 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:33.263813  2582 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:01:33.264995  2427 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.002s
I20260709 13:01:33.279628  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.252054  2508 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.225629  2555 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:01:33.279697  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.254423  2450 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.263733  2211 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.238997  2606 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.287814  1648 leader_election.cc:400] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3.
I20260709 13:01:33.281998  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.272192  2435 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.252590  2455 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.248000  1608 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:33.254014  2596 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.289618  1534 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.262785  2512 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.290122  1533 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:33.296622  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.290043  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:33.308355  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 106098us
I20260709 13:01:33.327939  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.329167  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.329475  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.329913  1533 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:33.329761  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:33.331290  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:33.289095  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.263334  2479 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.280642  2592 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.377956  1534 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
W20260709 13:01:33.378404  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48998.3us
I20260709 13:01:33.379341  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.380718  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.380883  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.381799  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:33.355863  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:33.383664  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.289160  2470 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.389619  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.345762  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.296015  2555 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:33.294323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.294445  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:33.405908  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 153038us
I20260709 13:01:33.406246  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.294688  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:33.327847  2610 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:01:33.392246  1535 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.409480  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.289618  2608 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.388006  2574 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:33.391074  1534 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.418609  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.400671  1526 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.295169  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.294955  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.395835  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.291555  2508 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:33.436460  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.391603  2555 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:33.390547  2614 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:01:33.377324  2450 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:33.390295  2467 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.387436  2478 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.403092  2512 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.291939  2613 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.443655  2613 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.392088  1602 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:33.291857  2591 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.393738  2599 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:33.376945  2455 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.387472  2475 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.460364  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.410992  1607 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:33.466039  1535 raft_consensus.cc:2376] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3. Re-sending same reply.
I20260709 13:01:33.467135  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.467226  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.468912  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:33.468982  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.469990  1535 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:33.470503  1683 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:33.471314  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.472406  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.473855  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.474884  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:33.371364  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 82388.3us
I20260709 13:01:33.477957  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.392282  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.392243  2554 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.297312  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.292165  2427 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.297583  2435 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.296463  2397 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.423738  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.429265  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.392410  2466 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:33.405068  2600 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:33.425701  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:33.431109  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.434139  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.507360  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.507673  1530 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.405078  2361 raft_consensus.cc:3055] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.405023  2556 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:33.298010  2615 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:01:33.413555  2539 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:33.441620  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.441071  2555 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.376543  2618 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.444319  1529 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.444554  2450 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:33.444977  2574 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:33.421617  2553 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.446708  2467 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:33.447325  2478 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:33.479620  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:33.422139  2608 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:33.471746  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.440702  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.439183  2429 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.450592  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.449534  2613 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:33.502300  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78624.7us
I20260709 13:01:33.439553  1528 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:33.435199  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.462702  2455 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.570858  2455 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.570916  2489 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.571494  2489 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:33.460626  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:33.571928  2489 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.572353  1677 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:33.503568  1532 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:33.514547  1610 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:33.483632  2524 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:33.481554  2475 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.515594  1530 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.482179  2554 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.448518  2440 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.586015  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.586024  2554 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.587505  2475 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.593145  1532 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.594779  1532 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.560655  2608 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.596863  1529 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.597404  2440 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.580724  2596 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.599020  2435 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.540366  1605 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.601159  1530 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.506528  2449 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.506031  2430 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.606465  2449 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:33.606295  2430 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.606925  2449 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.514971  2361 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:33.458551  2591 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.525520  2556 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.527693  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.524562  2466 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:33.560871  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53597.9us
W20260709 13:01:33.604235  2422 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.008s
I20260709 13:01:33.547304  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:33.564893  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 85365.8us
I20260709 13:01:33.578632  2623 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.629330  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.505918  2508 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.552163  2606 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.569401  1683 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:33.570225  2479 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:33.574019  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 138862us
I20260709 13:01:33.576072  1527 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.607544  2524 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:33.554566  2553 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.558106  2555 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.561057  2478 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.490091  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.583029  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.562098  2534 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.609483  1530 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.566959  2512 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:33.621598  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:33.666749  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45225.7us
I20260709 13:01:33.668138  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.669544  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.670979  1530 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.584564  2351 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.676605  1529 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.632438  2324 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.619791  2556 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.632969  2422 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.682116  2422 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:33.633699  2592 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.683348  1684 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [1.2-3.3]
W20260709 13:01:33.615823  2616 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:01:33.602876  2579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41286 (request call id 25) took 1557 ms. Trace:
I20260709 13:01:33.639073  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.640822  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.562192  1526 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:33.645098  1683 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:01:33.687721  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46995.7us
I20260709 13:01:33.650218  2593 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:33.684342  2579 rpcz_store.cc:276] 0709 13:01:32.038735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.038912 (+   177us) service_pool.cc:224] Handling call
0709 13:01:32.080714 (+ 41802us) ts_tablet_manager.cc:934] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
0709 13:01:32.732833 (+652119us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:33.404616 (+671783us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:33.404767 (+   151us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:33.595186 (+190419us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:33.595507 (+   321us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:33.595910 (+   403us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:33.595980 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25755,"tablet-copy.queue_time_us":10920,"thread_start_us":151203,"threads_started":2}
I20260709 13:01:33.652244  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:33.583401  2450 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.653155  2508 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.654125  2524 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:33.655176  2626 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:33.694562  2602 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.704577  2602 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:33.704978  2602 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.705915  2211 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.699534  2592 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.663532  2435 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:33.707358  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:33.697851  2427 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.655331  2466 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.656426  2397 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.674153  2614 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.672933  2440 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.675597  2512 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.673125  2534 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.688446  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.689507  2593 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.651292  2361 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:33.660498  2553 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:33.695933  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43751.5us
I20260709 13:01:33.665164  2596 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.696832  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:33.700989  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62007.1us
I20260709 13:01:33.732298  1605 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.733269  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.701988  2630 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.703286  2430 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.712980  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.698457  2422 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.699321  1532 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:33.714919  2579 tablet_copy_client.cc:806] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:33.742806  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.743227  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.663688  2467 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.709347  2574 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:33.751727  2324 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:33.755897  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.748776  2468 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:33.728217  2606 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.740828  2630 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.756318  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:33.753345  2614 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:33.732270  2497 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.748911  2617 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.752205  2629 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:33.753454  2591 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.752367  2435 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.759600  2579 tablet_copy_client.cc:670] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:33.741292  2422 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.770190  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.759341  2361 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.749720  2596 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.775339  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:33.761956  2430 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.740374  2499 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:33.765580  2630 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.771135  2617 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.771552  2429 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:33.787405  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.777427  2606 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.778750  2422 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.776235  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.772186  1531 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:33.888823  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 78251.2us
W20260709 13:01:33.804811  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.802176  2534 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:33.774008  2497 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.803015  2606 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.788684  2615 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.897132  1605 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:33.791340  2397 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:33.890286  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.800252  2617 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.903347  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.781663  2440 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:33.912541  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:33.912935  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 120992us
I20260709 13:01:33.917757  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:33.888970  2430 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.889293  2479 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.888646  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:33.900600  2638 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.134s	user 0.007s	sys 0.003s
W20260709 13:01:33.915776  2627 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.165s	user 0.010s	sys 0.001s
I20260709 13:01:33.901247  2615 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.931530  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:33.910684  2539 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.900406  2606 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.778677  2629 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.929018  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:33.933359  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:33.807881  2429 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.805158  2489 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.777954  2635 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 13:01:33.931042  2491 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.926879  2492 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.925392  2622 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.951676  1683 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:33.942808  2614 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.916684  2599 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:33.901988  2554 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.916245  2556 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.929001  2624 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:33.973726  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:33.952785  2615 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.975126  1683 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.968321  2512 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:33.987958  1527 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.970732  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:33.989609  2624 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:33.992928  2479 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:33.972339  2491 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.971951  2492 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:33.999032  2475 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.012379  2593 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.121826  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:34.122613  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:34.011160  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:34.123140  1683 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:34.125672  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:34.126636  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:34.108767  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:34.128242  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:34.134290  1683 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:34.116519  2479 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:34.136291  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:34.144960  1530 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:34.149420  1683 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:34.152415  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:34.153477  1683 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:34.130517  2491 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:34.141351  2449 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.006s
I20260709 13:01:34.128798  2429 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.130517  2489 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:34.142103  2613 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.001s
W20260709 13:01:34.151086  2455 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.580s	user 0.014s	sys 0.006s
I20260709 13:01:34.039778  2643 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:01:34.152002  2614 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:34.185214  2645 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:01:34.195067  2475 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.165571  2497 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:34.209022  1574 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.873s (SENT)
I20260709 13:01:34.201076  2643 consensus_queue.cc:1243] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer e3ab72f324d545a6b4ecb1025df1f7c0 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:34.218827  2615 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.222271  2615 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.223726  2607 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.224382  2607 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:34.176720  2455 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.229192  2455 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:34.234691  2478 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.001s
I20260709 13:01:34.215041  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:34.240481  2492 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.241775  2591 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.242197  2591 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:34.246140  2591 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.249796  2591 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.193046  2614 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:34.164939  2449 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:34.254172  2602 consensus_meta.cc:287] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
W20260709 13:01:34.256773  2637 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.358s	user 0.003s	sys 0.000s
I20260709 13:01:34.171403  2613 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.259845  2554 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.235347  2478 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.262678  2479 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.273466  2602 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.400430  2579 tablet_copy_client.cc:538] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:34.307657  2613 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.352254  1534 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:34.357295  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 148172us
I20260709 13:01:34.358883  1610 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.387708  2361 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.389276  2449 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.413543  1681 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:34.415987  2607 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.418087  2607 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.390364  2422 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.262123  2556 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.443601  2574 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.444763  2574 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:34.446146  2608 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.000s
I20260709 13:01:34.446777  2608 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.282696  2629 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.293895  2614 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.448993  1609 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:34.162542  2624 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:34.308715  2652 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:34.350446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:34.350225  1533 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:34.451160  2614 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:34.417734  2630 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.000s
I20260709 13:01:34.457901  2422 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.460148  2478 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.501430  2608 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.522424  2579 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:01:34.479038  2630 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.515295  2574 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:34.477927  1678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.005s	sys 0.014s
W20260709 13:01:34.562381  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.018s	sys 0.021s
W20260709 13:01:34.563793  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.019s	sys 0.021s
W20260709 13:01:34.579655  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66083.7us
W20260709 13:01:34.595966  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.006s	sys 0.012s
W20260709 13:01:34.575399  1678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.006s	sys 0.014s
W20260709 13:01:34.595831  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.013s	sys 0.012s
W20260709 13:01:34.598676  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.012s
W20260709 13:01:34.599956  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.017s
W20260709 13:01:34.600603  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.008s	sys 0.018s
W20260709 13:01:34.601336  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 669815us
I20260709 13:01:34.603940  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 780) took 1178 ms. Trace:
I20260709 13:01:34.604655  1675 rpcz_store.cc:276] 0709 13:01:33.425145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.429523 (+  4378us) service_pool.cc:224] Handling call
0709 13:01:33.783649 (+354126us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:33.806197 (+ 22548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.936092 (+129895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.938092 (+  2000us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.992853 (+ 54761us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.360111 (+367258us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:34.360827 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.361218 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.361368 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.603231 (+241863us) raft_consensus.cc:1685] finished
0709 13:01:34.603412 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.603687 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4398,"prepare.queue_time_us":33795,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":81557,"raft.run_cpu_time_us":549,"raft.run_wall_time_us":29666,"spinlock_wait_cycles":2035072,"thread_start_us":248644,"threads_started":1,"wal-append.queue_time_us":529160}
W20260709 13:01:34.608137  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.007s	sys 0.012s
W20260709 13:01:34.610790  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 867540us
I20260709 13:01:34.612736  2602 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:34.655366  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52367us
W20260709 13:01:34.673803  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.005s	sys 0.006s
W20260709 13:01:34.674409  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.006s	sys 0.006s
W20260709 13:01:34.721525  2508 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.009s
I20260709 13:01:34.742774  2632 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.751916  2632 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:34.758701  2553 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.008s
I20260709 13:01:34.759433  2553 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:34.733791  2619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.020s	sys 0.073s
I20260709 13:01:34.769411  1529 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:34.769800  2619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.020s	sys 0.074s
I20260709 13:01:34.769930  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 476) took 1382 ms. Trace:
I20260709 13:01:34.770365  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 685) took 1027 ms. Trace:
I20260709 13:01:34.770915  1529 rpcz_store.cc:276] 0709 13:01:33.742525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.761433 (+1018908us) service_pool.cc:224] Handling call
0709 13:01:34.768480 (+  7047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.770023 (+  1543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.770267 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.772260  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51046.5us
I20260709 13:01:34.790589  2553 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.803759  2427 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.804332  2427 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:34.805743  2427 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.770394  1527 rpcz_store.cc:276] 0709 13:01:33.387159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.650768 (+263609us) service_pool.cc:224] Handling call
0709 13:01:33.651136 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.012589 (+361453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.769352 (+756763us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540032f0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.769725 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734733056}
I20260709 13:01:34.812844  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:34.801528  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 475) took 1416 ms. Trace:
W20260709 13:01:34.852344  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 243891us
I20260709 13:01:34.854875  1535 rpcz_store.cc:276] 0709 13:01:33.385261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.471030 (+ 85769us) service_pool.cc:224] Handling call
0709 13:01:34.801031 (+1330001us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002201d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:34.801303 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599735168}
I20260709 13:01:34.861474  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:34.862844  1529 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 2.
I20260709 13:01:34.865058  1527 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.865808  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 695) took 1111 ms. Trace:
I20260709 13:01:34.866155  1527 rpcz_store.cc:276] 0709 13:01:33.754844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.864185 (+1109341us) service_pool.cc:224] Handling call
0709 13:01:34.864748 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.865547 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.865745 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.869954  2617 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.010s
I20260709 13:01:34.870762  2632 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:34.882905  2654 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.606s	user 0.000s	sys 0.001s
I20260709 13:01:34.883335  2617 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.884608  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:34.885471  1606 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:34.885982  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 454) took 1602 ms. Trace:
I20260709 13:01:34.886804  2617 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:34.887576  1535 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.887976  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 747) took 1429 ms. Trace:
I20260709 13:01:34.888283  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 697) took 1125 ms. Trace:
W20260709 13:01:34.887974  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 275727us
I20260709 13:01:34.888846  1535 rpcz_store.cc:276] 0709 13:01:33.762782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.886711 (+1123929us) service_pool.cc:224] Handling call
0709 13:01:34.887204 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.888059 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.888235 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.892216  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 478) took 1485 ms. Trace:
I20260709 13:01:34.892753  1530 rpcz_store.cc:276] 0709 13:01:33.406850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.671640 (+264790us) service_pool.cc:224] Handling call
0709 13:01:33.671860 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.148782 (+476922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.891558 (+742776us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000fbc54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.891960 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087463168}
I20260709 13:01:34.895041  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 700) took 1122 ms. Trace:
I20260709 13:01:34.895428  1530 rpcz_store.cc:276] 0709 13:01:33.773088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.893893 (+1120805us) service_pool.cc:224] Handling call
0709 13:01:34.894357 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.894688 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.894731 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.894771 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:34.894800 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.894865 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.894988 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.867875  1527 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:34.871332  2606 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.017s
I20260709 13:01:34.886377  1534 rpcz_store.cc:276] 0709 13:01:33.283760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.555072 (+271312us) service_pool.cc:224] Handling call
0709 13:01:33.555355 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.410449 (+855094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.885653 (+475204us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54000dcd54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.885913 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830772608}
I20260709 13:01:34.859241  2427 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:34.882092  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 1.1118e+06us
I20260709 13:01:34.888403  1610 rpcz_store.cc:276] 0709 13:01:33.458957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.587015 (+128058us) service_pool.cc:224] Handling call
0709 13:01:33.587309 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.412395 (+825086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.887608 (+475213us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400248954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.887901 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772722560}
I20260709 13:01:34.852684  2630 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.913643  1535 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.916320  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 699) took 1145 ms. Trace:
I20260709 13:01:34.916831  1535 rpcz_store.cc:276] 0709 13:01:33.769403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.889616 (+1120213us) service_pool.cc:224] Handling call
0709 13:01:34.897164 (+  7548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.914431 (+ 17267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.914615 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.918274  2596 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:34.916440  1526 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:34.918967  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 703) took 1129 ms. Trace:
I20260709 13:01:34.919332  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 684) took 1180 ms. Trace:
I20260709 13:01:34.919327  1535 rpcz_store.cc:276] 0709 13:01:33.789359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.917799 (+1128440us) service_pool.cc:224] Handling call
0709 13:01:34.918269 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.918577 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.918603 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.918639 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:34.918664 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.918722 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.918911 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.919898  1526 rpcz_store.cc:276] 0709 13:01:33.738497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.348980 (+610483us) service_pool.cc:224] Handling call
0709 13:01:34.915675 (+566695us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:34.915997 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.919067 (+  3070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.919257 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5164800}
I20260709 13:01:34.912125  2211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41274 (request call id 61) took 1422 ms. Trace:
I20260709 13:01:34.911901  2508 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:34.922843  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 696) took 1153 ms. Trace:
W20260709 13:01:34.933121  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.01535e+06us
I20260709 13:01:34.941756  2602 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.943953  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 796) took 1193 ms. Trace:
I20260709 13:01:34.944314  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 783) took 1480 ms. Trace:
I20260709 13:01:34.944765  1681 rpcz_store.cc:276] 0709 13:01:33.464117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.464231 (+   114us) service_pool.cc:224] Handling call
0709 13:01:33.464534 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.414239 (+949705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.943989 (+529750us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54002e9ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.944261 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156897664}
I20260709 13:01:34.944419  1683 rpcz_store.cc:276] 0709 13:01:33.750065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.157124 (+407059us) service_pool.cc:224] Handling call
0709 13:01:34.157603 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.159737 (+  2134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.159774 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.170499 (+ 10725us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.913632 (+743133us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:34.926971 (+ 13339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.930459 (+  3488us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.943629 (+ 13170us) raft_consensus.cc:1685] finished
0709 13:01:34.943658 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.943787 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1226,"raft.queue_time_us":1340,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":13099,"thread_start_us":387300,"threads_started":1,"wal-append.queue_time_us":728398}
I20260709 13:01:34.945511  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:34.949446  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:34.949694  1526 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:34.951308  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 790) took 1214 ms. Trace:
I20260709 13:01:34.951651  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 734) took 1536 ms. Trace:
I20260709 13:01:34.952057  1609 rpcz_store.cc:276] 0709 13:01:33.415528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.417692 (+  2164us) service_pool.cc:224] Handling call
0709 13:01:33.418113 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.469204 (+1051091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.951346 (+482142us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400248e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.951592 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263189888}
I20260709 13:01:34.925045  2211 rpcz_store.cc:276] 0709 13:01:33.506466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.535827 (+ 29361us) service_pool.cc:224] Handling call
0709 13:01:33.557609 (+ 21782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.706361 (+148752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.910459 (+1204098us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400690d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.911928 (+  1469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297069440}
I20260709 13:01:34.955444  2574 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.955942  2574 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.909763  2606 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:34.957722  2574 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.965519  1534 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:34.967342  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 694) took 1221 ms. Trace:
I20260709 13:01:34.969889  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 702) took 1189 ms. Trace:
I20260709 13:01:34.972762  1534 rpcz_store.cc:276] 0709 13:01:33.780176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.909549 (+1129373us) service_pool.cc:224] Handling call
0709 13:01:34.948593 (+ 39044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.968936 (+ 20343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.969834 (+   898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.937268  1527 rpcz_store.cc:276] 0709 13:01:33.761265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.867116 (+1105851us) service_pool.cc:224] Handling call
0709 13:01:34.867601 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.904745 (+ 37144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.912911 (+  8166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.971623  2607 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.005s
I20260709 13:01:34.984123  2478 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.989916  2489 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.990628  2489 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:34.993819  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 35) took 2599 ms. Trace:
I20260709 13:01:34.994397  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:34.996496  1535 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:34.983134  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 16) took 1278 ms. Trace:
I20260709 13:01:35.000316  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 705) took 1201 ms. Trace:
I20260709 13:01:35.004077  1535 rpcz_store.cc:276] 0709 13:01:33.798519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.925811 (+1127292us) service_pool.cc:224] Handling call
0709 13:01:34.970798 (+ 44987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.997929 (+ 27131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.000250 (+  2321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.002717  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.005612  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:35.002004  2595 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.009716  1530 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.010613  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 701) took 1236 ms. Trace:
I20260709 13:01:34.996773  2489 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:35.011274  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:34.951800  1677 rpcz_store.cc:276] 0709 13:01:33.736602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.741679 (+  5077us) service_pool.cc:224] Handling call
0709 13:01:33.756476 (+ 14797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.991769 (+235293us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:34.046529 (+ 54760us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.259516 (+212987us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b18000c0d60. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:01:34.562395 (+302879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.563430 (+  1035us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:34.563737 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.950342 (+386605us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b18000c0d60. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419
0709 13:01:34.950899 (+   557us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002e95d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:34.950945 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.951131 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45120,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":540,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":31987,"spinlock_wait_cycles":531070080,"thread_start_us":301744,"threads_started":1,"wal-append.queue_time_us":821663}
I20260709 13:01:35.011641  2489 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.011020  1530 rpcz_store.cc:276] 0709 13:01:33.774322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.900139 (+1125817us) service_pool.cc:224] Handling call
0709 13:01:35.009135 (+108996us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:35.009429 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.010245 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.010547 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964736}
I20260709 13:01:35.014959  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:34.969877  1529 rpcz_store.cc:276] 0709 13:01:33.745918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.864013 (+1118095us) service_pool.cc:224] Handling call
0709 13:01:34.935782 (+ 71769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.966691 (+ 30909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.966752 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.966830 (+    78us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:34.966885 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.966974 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.967159 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.019169  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:35.002236  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:35.020022  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.018604  2619 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.024223  2607 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:35.024989  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.027348  2606 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.026480  2602 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.027886  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.028451  2603 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.028961  2603 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:35.030287  2508 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.030570  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:35.032850  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.033113  2478 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.032919  2508 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.035112  2608 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.029131  1532 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.043087  2632 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.037173  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.032971  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 448) took 1750 ms. Trace:
I20260709 13:01:35.045991  1533 rpcz_store.cc:276] 0709 13:01:33.282484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.482101 (+199617us) service_pool.cc:224] Handling call
0709 13:01:33.482383 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.460577 (+978194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.032630 (+572053us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54000ddc54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:35.032900 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993743232}
I20260709 13:01:35.046518  2608 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.058244  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.003979  1678 rpcz_store.cc:276] 0709 13:01:33.703248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.715813 (+ 12565us) service_pool.cc:224] Handling call
0709 13:01:33.753865 (+ 38052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.757206 (+  3341us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:34.801687 (+1044481us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.912812 (+111125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.927592 (+ 14780us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:34.957400 (+ 29808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.964341 (+  6941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.981965 (+ 17624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23393,"prepare.queue_time_us":32950,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":123,"raft.queue_time_us":29164,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":21860,"thread_start_us":937782,"threads_started":2,"wal-append.queue_time_us":150798}
I20260709 13:01:35.030529  2603 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:35.062348  2603 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.045738  2632 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.057816  2595 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.060647  2608 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.064612  2470 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:35.065651  2617 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:35.069088  2470 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.069228  2617 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:35.069875  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88456us
I20260709 13:01:35.070984  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.067052  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.065249  2632 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.075502  2211 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:35.075158  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.075397  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 17) took 1087 ms. Trace:
I20260709 13:01:35.071918  2435 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.076748  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.065991  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 687) took 1319 ms. Trace:
I20260709 13:01:34.994310  1431 rpcz_store.cc:276] 0709 13:01:32.394378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.394539 (+   161us) service_pool.cc:224] Handling call
0709 13:01:34.993553 (+2599014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:33.096309 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:33.229958 (+133649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:33.236212 (+  6254us) write_op.cc:435] Acquired schema lock
0709 13:01:33.237896 (+  1684us) tablet.cc:662] Decoding operations
0709 13:01:33.246476 (+  8580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:33.246552 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:33.246584 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:33.246807 (+   223us) tablet.cc:701] Row locks acquired
0709 13:01:33.246823 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:01:33.246990 (+   167us) write_op.cc:270] Start()
0709 13:01:33.247114 (+   124us) write_op.cc:276] Timestamp: P: 1783602093246926 usec, L: 0
0709 13:01:33.247138 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:33.247816 (+   678us) log.cc:844] Serialized 535 byte log entry
0709 13:01:33.924716 (+676900us) op_driver.cc:464] REPLICATION: finished
0709 13:01:34.186665 (+261949us) write_op.cc:301] APPLY: starting
0709 13:01:34.186762 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:34.186864 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:34.187047 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:34.187276 (+   229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:34.187448 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:34.187495 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:34.187682 (+   187us) log.cc:844] Serialized 22 byte log entry
0709 13:01:34.187851 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.187932 (+    81us) write_op.cc:454] Released schema lock
0709 13:01:34.187970 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.188313 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.188340 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":258388,"apply.run_cpu_time_us":1658,"apply.run_wall_time_us":1659,"num_ops":1,"prepare.queue_time_us":441720,"prepare.run_cpu_time_us":78029,"prepare.run_wall_time_us":396066,"raft.queue_time_us":173282,"raft.run_cpu_time_us":24467,"raft.run_wall_time_us":323758,"replication_time_us":563631,"thread_start_us":703725,"threads_started":4,"wal-append.queue_time_us":295949}]]}
I20260709 13:01:35.071961  2470 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.083596  1533 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.073491  2617 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:35.084409  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.088382  1610 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.082201  2666 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.089119  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.076184  1676 rpcz_store.cc:276] 0709 13:01:33.988250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.187844 (+199594us) service_pool.cc:224] Handling call
0709 13:01:34.188244 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.188719 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.188752 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.195938 (+  7186us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.761798 (+565860us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:34.855152 (+ 93354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.869673 (+ 14521us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.074696 (+205023us) raft_consensus.cc:1685] finished
0709 13:01:35.075055 (+   359us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.075224 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1830,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":145,"thread_start_us":387425,"threads_started":1,"wal-append.queue_time_us":785599}
I20260709 13:01:35.089749  2496 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.087801  2553 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:35.106901  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.087230  2608 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.080598  1532 rpcz_store.cc:276] 0709 13:01:33.744232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.152637 (+408405us) service_pool.cc:224] Handling call
0709 13:01:35.027631 (+874994us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54eee 0000000000375939 00007f469cfc81e0 00007f469d0910c4 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:35.062973 (+ 35342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341346048}
I20260709 13:01:35.108156  2617 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.107652  1530 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:35.112341  2613 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.119872  1609 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.106377  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.121606  2606 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.122085  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.122738  2606 consensus_queue.cc:1243] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer e3ab72f324d545a6b4ecb1025df1f7c0 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:35.123221  1530 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:35.123371  2606 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.126058  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.107899  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.126837  1681 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.123773  2606 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:35.133836  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.134016  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.117370  2496 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:35.133607  1527 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:35.136245  1535 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.135281  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.138459  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.138870  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.139501  1684 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:35.137090  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.138669  1680 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:35.140897  2669 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:01:35.141191  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.127408  2608 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.144577  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.135404  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.154592  1683 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:35.157548  1682 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.140913  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.159160  1675 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.163727  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.142597  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.164867  1679 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:35.165331  1682 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:35.167898  1681 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:35.154373  2617 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.169557  2435 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.170112  2435 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:35.171557  2617 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.140146  2553 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.145709  2427 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:35.135753  2574 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:35.180564  1680 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:35.135700  2666 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.189260  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.184859  2613 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.182350  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.196101  1682 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.181988  2662 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.189337  1529 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.197707  1680 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:35.211366  2435 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:35.199926  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.212495  1533 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.212280  2606 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:35.212815  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:35.213763  2606 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.214521  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.201689  2602 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.202308  1530 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.219025  1682 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:35.220544  1676 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:35.221083  1676 pending_rounds.cc:85] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 1
I20260709 13:01:35.221372  1676 pending_rounds.cc:107] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:01:35.202566  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.523s (SENT)
I20260709 13:01:35.221506  2666 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.222028  1676 raft_consensus.cc:2889] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.222277  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:35.215258  1606 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 2.
I20260709 13:01:35.224642  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.224948  2478 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.215705  2662 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:35.215794  2602 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.226047  2662 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.227990  2602 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.209731  1683 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.228487  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.229300  1608 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:35.228601  2662 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.230522  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:35.195292  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59534.7us
I20260709 13:01:35.231459  1677 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:35.236222  2496 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:35.229321  1574 leader_election.cc:336] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.535s (SENT)
I20260709 13:01:35.240432  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:35.243006  2602 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.233093  1535 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:35.247979  1535 pending_rounds.cc:85] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:35.240513  2607 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.248996  1535 pending_rounds.cc:107] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:01:35.248771  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 112760us
I20260709 13:01:35.251226  1535 raft_consensus.cc:2889] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.254325  1530 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.250531  2608 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.263625  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.271698  1533 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.278698  1609 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:35.264892  2496 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.286010  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.295416  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.251183  2427 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.295351  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.298938  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.299185  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.299310  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.301424  2613 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:35.302106  2435 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.302182  2619 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.302814  2435 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.302964  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.303272  2435 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.303587  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.303969  2666 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.304442  2666 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.304821  2666 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.305226  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.306945  2614 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.307699  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.307957  2661 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.307695  2614 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.309051  2613 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:35.308346  1683 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.310236  2613 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.306972  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.312588  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.287179  2553 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.308228  1610 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:35.313519  1530 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.289839  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.303093  2427 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:35.321592  2624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.018s	sys 0.026s
I20260709 13:01:35.332134  2430 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.317607  2450 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:35.334717  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.341886  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:35.343879  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.828s (SENT) [suppressed 20 similar messages]
I20260709 13:01:35.344002  2661 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.344707  2661 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:35.345072  1574 leader_election.cc:336] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.878s (SENT)
I20260709 13:01:35.345219  2661 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.348081  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:35.333686  2624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.019s	sys 0.027s
I20260709 13:01:35.352246  2617 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.352360  1678 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.352458  1684 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:35.336376  2430 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.353752  2430 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.354657  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:35.355811  2662 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:35.359671  1574 leader_election.cc:336] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.794s (SENT)
I20260709 13:01:35.360181  1602 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:35.360584  2430 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.360212  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:35.364651  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.368131  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.370183  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.376910  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.378057  2574 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.380198  1432 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.362037  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.393055  1530 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.383642  2427 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:35.394769  2427 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:35.395164  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.396463  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:35.396992  2675 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:35.397156  1602 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.395936  2427 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.398489  2427 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.390398  2553 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.400997  2632 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.401221  1432 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.401986  2619 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.400620  2553 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:35.403425  1574 leader_election.cc:336] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.813s (SENT)
I20260709 13:01:35.411996  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:35.374382  2614 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.408651  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.416193  1530 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.372186  1675 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:35.388656  2595 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.424360  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.436817  1681 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.391024  2606 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.455740  1683 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:35.414981  2553 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.417474  2614 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.411228  2430 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.468106  1683 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.424196  2595 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:35.469211  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65817.7us
I20260709 13:01:35.415129  2574 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:35.457552  1678 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.415313  2470 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:01:35.488144  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.464282  1603 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:35.416958  2662 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
W20260709 13:01:35.471458  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86685.5us
I20260709 13:01:35.489946  1530 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 3.
I20260709 13:01:35.462787  2603 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.464838  2614 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.493690  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.495250  1683 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.505298  1684 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.491482  1432 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.489537  2595 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.489758  2489 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:35.512532  2677 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:01:35.497475  2450 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.509627  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:01:35.510092  1574 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.814s (SENT)
I20260709 13:01:35.523586  1432 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.548274  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.548144  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:35.546271  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48335.9us
I20260709 13:01:35.524708  2617 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:35.550190  2632 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.550278  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.550961  2632 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.551391  2632 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:35.557013  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 693) took 1811 ms. Trace:
I20260709 13:01:35.557448  1531 rpcz_store.cc:276] 0709 13:01:33.745712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.459454 (+713742us) service_pool.cc:224] Handling call
0709 13:01:34.460019 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.564498 (+104479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.573744 (+  9246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.926881 (+353137us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.253834 (+326953us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:35.269685 (+ 15851us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.272981 (+  3296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.273062 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.556803 (+283741us) raft_consensus.cc:1685] finished
0709 13:01:35.556827 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.556959 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20575,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":31469,"raft.run_cpu_time_us":554,"raft.run_wall_time_us":1306,"thread_start_us":271925,"threads_started":1,"wal-append.queue_time_us":361260}
I20260709 13:01:35.532778  2450 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.560179  2450 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.548636  1602 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 3.
I20260709 13:01:35.565649  2619 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.565412  2666 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.566263  2619 raft_consensus.cc:697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:35.572540  1679 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.567348  2619 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:35.578655  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 155341us
I20260709 13:01:35.567859  2666 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.581884  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.584908  1602 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:35.585669  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.546495  2662 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:35.555683  2553 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.599674  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.600353  2591 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.601586  2591 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:35.601977  2591 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:35.555248  2661 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.589197  1432 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.608419  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.546924  2489 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.563874  2614 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.597491  2662 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:35.631803  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.629745  2613 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.633661  2613 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.601995  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.636919  2553 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.645753  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.646411  1610 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.638590  2489 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.606637  2435 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.639693  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:35.639916  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 135625us
I20260709 13:01:35.652825  2602 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:35.640551  2603 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:35.641606  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.654197  1605 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.606956  2632 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.642910  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.660408  1609 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:35.660171  2435 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.602937  2591 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:35.635847  2613 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.662146  2662 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.670413  1610 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.671238  1605 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.629235  1432 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.632115  2666 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.685256  2478 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:35.686039  2595 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.686167  2450 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.695696  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.700911  1609 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:35.687690  2689 consensus_queue.cc:1175] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:35.709755  1681 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.710151  2614 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.688480  2666 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.711421  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.712299  1607 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:35.712190  1432 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.714285  1432 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.715057  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.711557  2666 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.716486  2496 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:35.717051  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.690186  2595 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.691407  2662 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.715982  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.739414  1432 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.740257  2450 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:35.690441  2478 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:35.684005  2692 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:35.683267  1677 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:35.742455  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.744174  1610 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.744958  1679 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.745035  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.746042  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.746639  1604 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:35.747726  1606 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.777972  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.748201  2602 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:35.748700  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:35.779661  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 63755.5us
I20260709 13:01:35.779851  1681 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:35.691219  2607 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:35.692652  2603 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:01:35.759132  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 293689us
I20260709 13:01:35.741528  2661 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:35.767231  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102970us
I20260709 13:01:35.750484  2489 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:35.766770  2691 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:35.759016  2606 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:01:35.785666  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.773896  1432 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.756079  2496 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:35.790709  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:35.789551  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 115762us
W20260709 13:01:35.793782  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.797958  2608 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:35.798481  2608 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:35.799189  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.800004  1601 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.804646  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.806070  1610 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.784739  2595 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.808490  1432 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.812737  1610 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 13:01:35.803926  2692 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.827463  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.829187  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.829988  1603 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:35.832852  2695 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:35.835287  2666 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.814685  2661 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:35.839599  1609 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:35.844164  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:35.845865  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.847491  2470 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.847666  2496 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.849419  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.851569  1604 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:35.792495  2691 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.853300  2470 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:35.818868  2606 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:35.859834  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.870813  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.872328  1533 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:35.860569  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 78089.6us
I20260709 13:01:35.873371  1432 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.817099  2603 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:35.879760  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.880816  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.885129  1531 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:01:35.886638  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.887413  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.851804  2661 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.889235  2697 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:35.891546  2351 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:35.892409  1608 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.892951  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.893062  2701 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.893493  2614 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:35.893816  1535 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:35.894374  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.895054  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.896497  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.897444  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.897740  2608 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.898486  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.899020  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.899926  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.899205  1432 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.901355  2691 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.841595  2692 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.912539  2666 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.888231  1533 raft_consensus.cc:2376] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3. Re-sending same reply.
W20260709 13:01:35.912302  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:01:35.873356  2595 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:35.924304  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:35.930589  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56463.2us
I20260709 13:01:35.883040  2430 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:35.934994  2478 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:35.943903  1529 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.921334  2697 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.945202  2697 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.945096  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.947790  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.948683  2591 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.948793  2692 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:35.949373  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.950313  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:35.950518  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.951514  1527 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.952657  2608 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.953172  2613 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.953760  2613 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:35.954826  2613 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.929692  2624 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.956213  2427 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:35.941753  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.951632  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.963639  1533 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:35.963153  1534 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:35.965639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:35.966735  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.946754  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.969874  1432 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.971938  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.975437  1681 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.974575  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.978638  1608 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:35.974906  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.956543  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.988500  1533 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:35.959367  2691 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.992376  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:35.988879  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:35.994902  1609 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:35.988358  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:35.988517  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:35.977021  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:35.995904  1604 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.991142  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:36.002381  1531 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:36.008993  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.023896  1681 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:35.990576  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.016381  1432 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:36.005124  2632 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.042821  1605 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.935284  2701 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:35.990653  2666 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:36.052995  1432 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:35.966148  2470 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.059689  1681 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.013145  2691 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.054136  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:36.031528  2624 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:36.064200  1530 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:36.093165  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:36.057034  2603 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:36.029385  2711 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:36.054333  1527 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:36.053318  2595 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.044214  1601 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:36.138749  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 93153.6us
I20260709 13:01:36.050767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:36.137552  1605 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:36.142123  1604 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
W20260709 13:01:36.148514  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 96202.9us
I20260709 13:01:36.054576  2614 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:36.184855  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 123500us
I20260709 13:01:36.094551  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:36.183851  1432 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.189568  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:36.048069  2478 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 13:01:36.206899  1532 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:36.208102  1602 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:36.209977  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:36.198005  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 150485us
I20260709 13:01:36.181214  2427 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:36.051448  2712 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.272s
I20260709 13:01:36.138767  2692 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:01:36.076802  2705 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.227s
I20260709 13:01:36.210834  2591 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.191877  2717 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.189815  2435 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:01:36.247308  2579 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 13:01:36.247066  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:36.248356  1678 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.248482  2579 tablet_bootstrap.cc:492] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:01:36.249343  2579 ts_tablet_manager.cc:1403] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.727s	user 0.054s	sys 0.064s
I20260709 13:01:36.187330  2553 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:36.250315  2710 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.231962  2661 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:36.259624  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.218019  2713 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.274068  1609 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.260552  2489 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:36.276278  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75025.3us
W20260709 13:01:36.278695  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.281335  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:36.281472  2719 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:36.282272  2603 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:36.261907  2710 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.260893  2662 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:36.283492  2603 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.258905  2591 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.261698  2450 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:36.278592  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:36.277663  2489 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:36.289923  2715 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:01:36.329305  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 104078us
I20260709 13:01:36.288268  2717 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:01:36.273094  2708 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:01:36.334355  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46384.2us
I20260709 13:01:36.337124  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.274712  2713 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.292698  2603 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.283809  2579 raft_consensus.cc:359] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.338034  1609 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
W20260709 13:01:36.339310  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 459608us
I20260709 13:01:36.262485  2624 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:36.340907  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 325620us
I20260709 13:01:36.329790  1676 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.331349  2691 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:36.355911  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.346189  1677 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:36.384188  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 124636us
I20260709 13:01:36.352631  2613 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.389781  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:36.320394  2697 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.299011  2427 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.392815  2708 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.358788  2701 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.394078  2591 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.397076  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.436296  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:36.356899  2724 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:36.447782  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.451642  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54663.9us
I20260709 13:01:36.466146  2727 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:36.448350  2624 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.449594  2701 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.458592  2553 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.473073  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.471290  2723 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.462863  2661 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.464268  2579 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
W20260709 13:01:36.524411  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48773.1us
I20260709 13:01:36.398730  2603 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.502764  2701 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.505684  2723 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:36.499045  2450 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:01:36.528867  2723 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.530041  2723 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.532387  2701 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.470809  2730 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:01:36.537886  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.538728  1680 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:36.529157  2579 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:36.439318  2710 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.472517  2732 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.470769  2727 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:36.468604  2718 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.398963  2489 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:36.577123  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.584863  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 195317us
I20260709 13:01:36.467010  2613 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:01:36.600912  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.604267  1680 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:36.591490  2718 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:36.610687  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.551673  2579 ts_tablet_manager.cc:1434] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.302s	user 0.006s	sys 0.016s
I20260709 13:01:36.615796  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.616446  2747 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.615572  2752 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.618639  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:36.593763  2728 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:01:36.502938  2624 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.556457  2727 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:36.621658  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 240033us
I20260709 13:01:36.594022  2710 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.619237  2753 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:36.621209  2708 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.612726  2691 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.612314  2603 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.623896  2489 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:36.681456  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.681720  1678 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:36.639665  2713 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:36.684365  2726 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:01:36.685590  2701 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.688014  2602 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.688592  2602 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.689824  2602 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.691435  2602 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.692732  2666 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:36.693262  2666 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:36.694396  2666 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:36.696938  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.640296  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:36.659433  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 189014us
W20260709 13:01:36.662314  2737 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:01:36.662480  2608 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.004s
I20260709 13:01:36.555521  2732 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.663874  2553 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.665206  2450 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.666149  2742 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:36.667395  2708 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.668375  2735 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:36.669188  2729 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:01:36.672672  2624 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.699321  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.699354  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.716101  1680 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
W20260709 13:01:36.701946  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 307633us
I20260709 13:01:36.636632  2591 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:36.704214  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.664783  2734 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:36.705469  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:36.698560  2666 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.710348  2750 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:36.725363  2750 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.725539  2591 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.726385  2751 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.723364  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:36.728821  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.730697  2732 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.627451  2752 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.733644  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:36.734674  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98248.1us
I20260709 13:01:36.727787  2750 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.736984  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:36.727840  2591 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.747251  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.732896  1678 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:36.732676  2553 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:36.759490  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.762764  2661 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.736162  2595 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.747093  2735 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:36.749936  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:36.750633  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:36.641558  2753 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.735880  2632 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:36.736377  2751 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.758169  2750 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.763360  2661 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:36.758083  2553 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:36.767028  2735 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.793278  2756 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:36.794710  2756 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.795158  2744 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:36.795619  2744 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.795967  2744 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.798347  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.755578  2608 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:36.801250  2607 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.801741  2607 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.802687  2607 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.803534  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:36.804085  2752 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.804365  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:36.805061  2470 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.805897  1603 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:36.795183  2756 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.806900  2607 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.806722  2727 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.807484  2756 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.808843  2756 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:36.810103  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61953.4us
I20260709 13:01:36.814689  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:36.812856  2753 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.818135  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.820048  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.820294  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:36.821492  2708 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:36.772578  2632 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.821966  2708 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:36.822394  2708 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.823169  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.772921  2723 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:36.824344  2723 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.824693  2723 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.810012  2553 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.819017  2691 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:36.830797  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.776171  2489 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.836876  2661 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.809871  2750 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:36.842916  2750 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.793355  2735 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.834218  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:36.828537  2591 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.852355  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 234033us
I20260709 13:01:36.854130  2602 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.828644  1676 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:36.860821  1681 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:36.859076  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:36.859330  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.864682  1684 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.865844  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:36.866997  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:36.867267  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.868122  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.868320  1684 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:36.869714  1603 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:36.871367  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.848635  2427 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:36.850814  2691 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:36.852707  2351 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:36.862443  2602 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:36.873715  2662 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.895912  2738 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.860059  2591 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.901369  2745 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:36.903784  2764 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:36.904394  2764 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.906808  2764 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:36.884716  2427 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:36.907788  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:36.903110  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.886587  2351 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:36.886281  2614 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:01:36.884514  2752 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:01:36.936702  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.909127  2624 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.920046  2351 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:36.965461  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68791.5us
I20260709 13:01:36.968410  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:36.971444  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:36.936537  2727 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:36.938431  2430 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.999509  1680 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:36.965225  2750 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.005951  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:37.034173  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70978.4us
I20260709 13:01:36.978639  2691 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.034824  2479 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.035327  2707 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.018754  2430 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:01:37.044704  2749 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.430s	user 0.004s	sys 0.002s
I20260709 13:01:37.049213  2768 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:37.024904  2727 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:37.029419  2470 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.032266  2666 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:37.026261  2742 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:37.072660  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.036387  2606 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.040904  2617 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.046154  2479 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:37.006352  2602 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.057139  2707 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:37.026530  2750 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.075357  2747 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.038686  2708 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:37.117722  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 138204us
I20260709 13:01:37.059811  2723 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.119699  2614 consensus_queue.cc:1243] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:37.085366  2606 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:37.086406  2666 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:37.077041  2727 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.081902  2470 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.112315  2747 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:37.132787  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 164498us
I20260709 13:01:37.135934  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:37.123034  2634 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.138947  2614 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.113065  2617 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.146301  2430 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:37.117214  2662 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:37.144490  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.147338  2430 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.147662  2742 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:37.158565  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 812) took 1201 ms. Trace:
W20260709 13:01:37.165668  1574 leader_election.cc:336] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.037s (SENT)
I20260709 13:01:37.161998  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:37.137036  2427 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.145264  2607 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:37.174294  2719 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.174579  2607 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:37.174892  2719 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.140069  2479 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.177330  2719 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.177100  2735 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.147678  2634 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.166812  1677 rpcz_store.cc:276] 0709 13:01:35.957491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.958393 (+   902us) service_pool.cc:224] Handling call
0709 13:01:36.020727 (+ 62334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.386973 (+366246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.158222 (+771249us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54003cc8d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:37.158491 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710415744}
I20260709 13:01:37.177968  2553 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.140386  2707 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.179090  1684 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:37.171854  2702 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.166864  2614 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:37.180176  2634 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.180372  2614 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.180819  2614 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.172264  2666 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.181495  2607 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:37.177894  2479 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.182888  2740 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.651s	user 0.002s	sys 0.000s
I20260709 13:01:37.180212  2702 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:37.185478  2702 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.184505  2724 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.173976  2764 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.173653  2708 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.163060  2430 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:37.185473  2727 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:37.179900  2707 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.220919  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.216594  2735 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.215967  2724 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:37.229699  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66851.4us
I20260709 13:01:37.168679  2744 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.232264  2723 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.160386  2777 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:01:37.228426  2702 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.261606  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.225911  2742 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:37.258250  2553 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:37.218896  2606 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.274503  2723 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.274736  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:37.275267  2708 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.284600  1683 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:37.275458  2742 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.283787  2750 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.290223  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 821) took 1314 ms. Trace:
I20260709 13:01:37.290781  1683 rpcz_store.cc:276] 0709 13:01:35.973694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.973823 (+   129us) service_pool.cc:224] Handling call
0709 13:01:37.274562 (+1300739us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:37.288280 (+ 13718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26937600}
W20260709 13:01:37.287825  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 467835us
I20260709 13:01:37.287142  2742 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:37.256420  2430 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.290098  2634 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.259073  2662 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.251809  2351 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.292349  2606 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.290858  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:37.285699  2723 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.226912  2747 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.318934  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.298771  2750 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.345218  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.347160  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:37.306907  2711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.003s	sys 0.009s
W20260709 13:01:37.331610  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.354446  2351 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:37.324939  2470 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:37.324743  2430 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.390722  2766 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.356812  2603 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:01:37.344337  2607 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:01:37.420526  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:01:37.413441  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.323123  2744 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.343411  2717 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:37.349927  2711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.003s	sys 0.011s
I20260709 13:01:37.348869  2719 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:37.367233  2489 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.000s
I20260709 13:01:37.342689  2723 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.323735  2634 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.435698  2746 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.331140  2783 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.356776  2747 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.331367  2701 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:37.434722  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 87699.2us
I20260709 13:01:37.359241  2756 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.286124  2724 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.449375  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.360925  2750 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:37.460306  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.440686  2489 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.440219  2746 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:37.475919  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:37.480679  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.453743  2701 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.464665  2719 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:37.418322  2766 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.446435  2783 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:37.496799  2720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.290s	user 0.018s	sys 0.026s
I20260709 13:01:37.629953  1533 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:01:37.631654  2720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.023s	sys 0.044s
I20260709 13:01:37.541167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.509512  2744 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.552282  1534 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.502043  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.489475  2602 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:37.541858  1535 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:37.636404  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:37.612798  2753 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.540252  2746 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.541903  1531 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:37.637635  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:37.633170  2744 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:37.427544  2742 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.502213  2613 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.642364  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.551237  2489 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.554778  2689 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:37.643033  2720 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.659596  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.643616  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.683642  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.661310  2634 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.685345  2661 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:37.653451  2613 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:37.697214  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.695832  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:37.684489  2746 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:37.703401  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.661307  2720 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:37.707981  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.654886  2753 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.708842  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.710309  2701 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.728658  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.729544  1606 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:37.729929  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:37.730625  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.731396  1606 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:37.731442  2746 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:37.732725  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.732398  2746 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:37.733623  1601 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:37.735335  1601 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:37.736336  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.737102  1605 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:37.711066  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.712211  2744 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.712754  2613 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.713527  2693 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:37.700256  2661 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.716015  2705 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.716408  2607 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.719043  2783 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.671698  2489 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.765111  1606 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:37.708164  2720 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.723670  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.767827  1607 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:37.746686  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.672592  2689 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.739332  1535 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:37.737336  2602 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:37.721346  2787 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:37.782747  2795 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:37.785933  2787 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.758890  2693 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:37.720353  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.772781  2789 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:37.758406  1602 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
W20260709 13:01:37.788914  2707 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:01:37.773857  2489 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.789533  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.774240  2753 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:37.775125  2790 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:01:37.791690  1609 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:37.775446  2720 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:37.777029  2797 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:01:37.777690  2788 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:01:37.764618  2691 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.781486  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.762332  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.769740  1610 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:37.779901  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:37.791170  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:37.802392  1535 raft_consensus.cc:2376] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4. Re-sending same reply.
I20260709 13:01:37.805119  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.808295  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.811062  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.766841  2607 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:37.813616  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.811846  1605 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:37.812640  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.816908  1535 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:37.818194  2689 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:37.818867  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:37.847441  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:37.812353  2783 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:37.809716  2744 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:37.813588  2738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.013s	sys 0.002s
W20260709 13:01:37.826227  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 166666us
I20260709 13:01:37.823098  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:37.854826  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:37.808451  2803 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.867734  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.892495  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.849098  2754 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:37.894547  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:37.894727  2607 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:37.853137  2783 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:37.912247  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.809455  2691 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:37.851387  2738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.014s	sys 0.002s
I20260709 13:01:37.817453  2746 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:37.819996  2779 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:37.856547  2708 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.002s
I20260709 13:01:37.814842  2701 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:01:37.853951  2744 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.912300  2754 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.961737  2783 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:38.010520  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.990324  2614 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.002s
I20260709 13:01:37.972328  2779 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:37.975556  2708 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:37.813408  2613 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.192s
I20260709 13:01:38.015470  2634 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.972594  2738 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:38.007370  2719 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.005s
I20260709 13:01:38.008601  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:37.973875  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50050.5us
I20260709 13:01:37.988355  2744 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.023173  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.009059  2754 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.029831  1529 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:38.034164  2613 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.030040  2725 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.037061  2617 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.021610  2614 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.045394  2787 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.048108  2748 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.048915  2632 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.009541  2746 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.925416  2803 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.019896  2779 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.055064  1601 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.049975  2719 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:38.075318  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.054788  2613 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:38.047724  2747 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.003s
I20260709 13:01:37.922932  2602 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.061769  2430 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
W20260709 13:01:38.059506  2702 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.003s
I20260709 13:01:38.068285  2748 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.057629  2725 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:38.076773  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.078347  1605 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:38.050201  2634 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.068585  2661 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.083213  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:38.073607  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.087002  1608 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.086283  1532 raft_consensus.cc:2368] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:01:38.099550  2712 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.083865  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.075112  2746 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.084375  2489 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:38.084733  2748 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.088652  2738 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.125504  1526 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:38.120961  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.116402  2712 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:38.131558  1529 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:38.099273  2613 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.133505  2717 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.686s	user 0.013s	sys 0.000s
I20260709 13:01:38.146692  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.151230  2614 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.130755  2489 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:38.151558  2803 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.153455  2634 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.146864  2717 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:38.154670  2606 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.830s	user 0.006s	sys 0.006s
I20260709 13:01:38.158051  2716 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:38.158501  2716 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:38.159245  1527 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.148792  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.149713  2746 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.154853  2613 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.155620  2766 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.169540  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.169824  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.162539  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.171325  2693 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.175350  2693 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.159351  2716 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.176230  2716 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.114344  2725 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.173128  2717 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.179885  1526 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.180107  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.188082  1603 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.191000  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.192173  1609 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:38.196199  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.190968  2634 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:38.206444  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.207532  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.184645  2725 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.207727  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.209563  1609 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.210774  1531 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:38.207834  2783 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.212208  1535 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.213169  2783 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.214090  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.214533  2697 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.214932  1526 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.215250  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.211843  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.217101  1531 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.188525  1601 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:38.217451  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.215806  1535 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:38.223465  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.224438  1531 raft_consensus.cc:2410] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:38.166198  2712 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.187115  2717 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.226337  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.227579  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.230991  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.230199  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.235164  2591 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:38.236361  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.241583  1530 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:38.243120  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.244222  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.245721  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:38.245824  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.246323  1535 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.247962  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.243785  1609 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.250649  1531 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.251845  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.252302  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.240507  2697 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.247205  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.247797  1603 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.251433  2764 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.257436  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.250846  2712 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.260169  1609 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:38.262919  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.257092  2697 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:38.261574  2764 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.254685  2591 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.257266  1526 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.263975  2691 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.267947  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.268836  1607 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:38.269199  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.256829  2614 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.270418  1531 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.265723  2591 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.273168  2478 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.273823  2478 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:38.274387  2591 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.274669  2478 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.275731  2478 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.282225  2751 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.282902  2751 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:38.283421  1610 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:38.283857  2751 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.285046  2751 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:38.285732  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.266115  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.276300  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.276855  2783 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:38.277096  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.277490  2614 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:38.265462  2697 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.279498  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.280786  1528 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.281010  2779 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.289122  1535 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:38.288262  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.292227  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.267073  2764 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:38.300499  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.293651  1602 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:01:38.302211  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.302325  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:38.312022  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.298870  2634 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.313341  2634 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.299217  2430 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:38.314807  2614 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.297624  2591 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:38.316121  2591 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.316511  2591 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.319108  2746 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.319962  2746 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.320567  2750 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.310878  2624 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.321327  2624 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:38.310364  2796 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.308312  2766 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:01:38.323246  2766 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:38.323380  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.328504  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.329514  2427 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.330657  1532 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.323899  2766 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:38.332276  2766 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.325933  2803 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.333186  2634 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.328013  2796 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:38.325466  2606 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.325310  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.335321  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.337545  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.338990  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.341836  1681 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.350694  1679 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:38.342136  1535 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:38.349010  1684 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.351795  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.352828  1531 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.333537  2803 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.360193  1682 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.361581  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.362177  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.362660  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.363054  1675 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.366297  1679 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:38.368784  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.370667  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.371512  1607 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.377103  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.329631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.376390  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.377825  1684 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:38.407552  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.427507  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:38.428402  1534 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.428550  1533 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:38.413836  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.355648  2479 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.433487  1533 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.378298  1531 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.355978  2709 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.435890  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.436100  1684 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.354071  2602 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.441125  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.442691  2764 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.443248  2803 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.450076  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:38.450855  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.443542  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.444077  2709 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.446983  1604 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:38.447244  1531 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:38.424424  2766 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:38.453585  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.381880  2606 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.478278  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.445061  2748 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.432497  2754 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.345731  2744 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.454835  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 128313us
I20260709 13:01:38.488346  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.488412  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.438071  2479 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.491964  1682 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.484153  1528 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.482800  1676 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.479753  2553 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.502615  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:38.474205  1603 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.497598  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.494305  2803 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.492203  2717 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.455561  2602 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.504070  2819 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:01:38.504243  2818 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:01:38.528083  1604 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.505712  1529 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.464449  2764 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.505667  2754 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.505354  2624 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.510288  1533 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:38.488215  2808 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.543620  2624 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.482558  2435 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.494560  2595 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.521591  2496 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.516417  2553 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.516600  2803 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.516477  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.527257  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.528982  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.530838  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.507403  1531 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:38.531800  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.533382  2606 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.534041  2602 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:38.587167  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58279.1us
I20260709 13:01:38.535581  2709 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.539881  1681 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:38.604946  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.514492  2661 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:38.614022  2764 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.521883  2603 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.514778  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.583165  2803 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.614836  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.615796  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.581126  1684 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.582870  1526 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:38.531685  2614 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.489394  2796 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.582150  2756 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.583777  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.587152  1609 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:38.587059  1683 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.589035  1531 pending_rounds.cc:85] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:38.591930  2720 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:38.593988  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.612790  1602 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:38.659207  1601 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:38.613569  2661 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.660173  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.661422  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.662075  2661 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.662540  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.546598  2435 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.663213  1529 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:38.663436  2435 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:38.665911  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.666743  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.667989  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.669853  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.587440  2595 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.630848  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.616482  1681 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:38.617666  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:38.682024  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.683068  1608 raft_consensus.cc:2410] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.601491  2755 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:38.616875  2824 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:01:38.620680  2820 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:38.585897  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.641559  2489 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:38.642189  2602 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.659641  1601 pending_rounds.cc:85] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:38.672322  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.603070  2779 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.699029  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.699622  2479 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.678184  2756 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.701596  2746 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.702598  2756 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.544083  2808 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.676720  1676 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.657740  1531 pending_rounds.cc:107] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:01:38.678418  1683 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:38.683784  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.666798  2720 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:38.708904  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.691888  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.671530  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.615363  2496 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.695582  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.639359  2606 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:01:38.640213  2717 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:38.694362  2602 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.698480  1601 pending_rounds.cc:107] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:38.716912  2602 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.719722  2808 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.721171  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-3f5eb582ff4540bb9b59540cc56f458a received from {username='slave'} at 127.0.0.1:37256
I20260709 13:01:38.721056  2720 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.721982  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-3f5eb582ff4540bb9b59540cc56f458a on tablet 3f5eb582ff4540bb9b59540cc56f458a with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:38.715076  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.706347  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.723282  1683 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:38.723695  1610 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.723857  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.687438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.711261  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.711391  1531 raft_consensus.cc:2917] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:01:38.703853  1603 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.693388  1532 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.690963  2755 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.734302  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:38.715076  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.697161  2716 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:01:38.716965  1601 raft_consensus.cc:2889] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.736613  1607 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:38.736976  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.714025  2744 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.739466  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.739728  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.699913  1609 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:38.741571  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.742202  1609 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.713867  1606 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:38.745630  2724 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.746194  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.746824  2709 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.746999  1606 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.747611  2748 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.749290  2595 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.752431  2742 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:38.753297  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.756016  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 138412us
I20260709 13:01:38.757325  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.760246  1684 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:38.726437  1681 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.727900  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.657811  2614 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.722957  2603 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.744804  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.761521  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:38.761708  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.715989  2479 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.762140  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.763818  1609 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.740154  1607 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:38.715484  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.726060  2808 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.733834  2661 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:38.769456  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 254738us
I20260709 13:01:38.777287  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.773355  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.777931  1609 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
W20260709 13:01:38.766227  2613 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
I20260709 13:01:38.776175  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.738503  2755 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.777668  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:38.765581  2720 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.779008  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.767635  2603 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.779594  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.773137  2595 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.782621  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.784749  1530 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.767904  2478 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.766368  2717 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.786070  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.790465  1684 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:38.770123  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.772548  2716 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.798846  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.772553  2479 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.799808  1609 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.798902  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.800748  1684 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.798975  2496 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.802342  2479 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.804677  2746 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.805315  2746 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:38.806401  2746 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:38.809051  2725 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.008s
I20260709 13:01:38.809824  1680 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:38.810956  2735 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.811478  2735 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:38.776914  2744 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:38.813488  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.813782  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.814287  1678 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:38.815274  2735 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:38.815459  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:38.787539  2766 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:38.818827  2553 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:38.819235  2766 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.819715  2766 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.821149  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.821918  1530 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.792891  2603 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.793922  2478 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.795730  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.797475  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:38.831611  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.798108  1607 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.781540  1529 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:38.793614  2712 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.777245  2661 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:38.802012  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.775600  1610 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.822799  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.827896  2478 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.774392  2591 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.846015  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:38.825101  2830 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:38.774513  2435 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.777664  2748 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:38.787708  2756 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.799952  2613 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.833194  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:38.834017  1684 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.835088  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:38.836373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.840122  1530 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:38.840454  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.822010  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.843604  2553 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.847798  2779 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.853343  2756 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:38.846065  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:38.837888  2738 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.843217  2661 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.849925  2717 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.855906  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 792) took 1083 ms. Trace:
I20260709 13:01:38.843359  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.865036  1528 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:38.865163  2756 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:38.867915  2751 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
I20260709 13:01:38.875023  1609 raft_consensus.cc:2410] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:38.871368  1601 rpcz_store.cc:276] 0709 13:01:37.772871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.248431 (+475560us) service_pool.cc:224] Handling call
0709 13:01:38.260518 (+ 12087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.744574 (+484056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.855640 (+111066us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400003054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:38.855849 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908095872}
I20260709 13:01:38.876703  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:38.876992  2591 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.877509  1601 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:38.877682  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 34) took 1075 ms. Trace:
I20260709 13:01:38.858515  1610 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:38.879287  2489 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.878098  1609 rpcz_store.cc:276] 0709 13:01:37.802395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.876850 (+1074455us) service_pool.cc:224] Handling call
0709 13:01:38.877155 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.877335 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.877364 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.877418 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:38.877465 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.877520 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.877628 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.859207  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.860594  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.864265  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.879796  2489 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.884909  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.886093  2489 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.886502  1531 raft_consensus.cc:2889] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.886673  2489 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.887291  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37252 (request call id 1) took 12967 ms. Trace:
I20260709 13:01:38.865463  2553 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.888114  2553 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.888233  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.887692  1531 rpcz_store.cc:276] 0709 13:01:25.919947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.931779 (+ 11832us) service_pool.cc:224] Handling call
0709 13:01:25.978850 (+ 47071us) log.cc:844] Serialized 506 byte log entry
0709 13:01:26.080770 (+101920us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b180027d600. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4697fd2b0b 00007f4698057b63 00007f469807f752 00007f469d03fd29
0709 13:01:38.887152 (+12806382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38698,"raft.queue_time_us":56373,"raft.run_cpu_time_us":2217,"raft.run_wall_time_us":38171,"spinlock_wait_cycles":19231104,"thread_start_us":49886,"threads_started":1,"wal-append.queue_time_us":65247,"wal-append.run_cpu_time_us":2135,"wal-append.run_wall_time_us":1013305}
I20260709 13:01:38.889456  1531 pending_rounds.cc:107] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:38.889681  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.890772  1609 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:38.869638  1530 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:38.865111  2803 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:38.856200  2435 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.889777  1531 raft_consensus.cc:2889] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.890857  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.891945  2738 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.886493  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.890962  2478 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.891840  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:38.908947  1605 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.842998  2712 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.893560  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.910279  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:38.892885  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 534) took 1037 ms. Trace:
I20260709 13:01:38.911391  1533 rpcz_store.cc:276] 0709 13:01:37.855554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.434406 (+578852us) service_pool.cc:224] Handling call
0709 13:01:38.509847 (+ 75441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.541672 (+ 31825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.892700 (+351028us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54000dd750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:38.892829 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172598656}
I20260709 13:01:38.892786  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:38.915853  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.916615  1530 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.919220  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.919595  1531 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:38.919978  1531 pending_rounds.cc:85] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:01:38.866775  1606 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.920222  1531 pending_rounds.cc:107] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:38.920524  1531 raft_consensus.cc:2889] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.894502  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.923187  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.867756  2716 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:38.905910  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.895164  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:38.892112  2764 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.937271  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.895370  2613 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:38.878823  1601 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.928295  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.942830  1533 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:38.918114  2725 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:38.928933  1531 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:38.934985  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.935205  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:38.935205  1605 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.926025  1682 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:38.938477  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.939754  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 518) took 1433 ms. Trace:
I20260709 13:01:38.897866  2803 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:38.947778  1605 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.947067  1535 rpcz_store.cc:276] 0709 13:01:37.506042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.351663 (+845621us) service_pool.cc:224] Handling call
0709 13:01:38.380979 (+ 29316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.405770 (+ 24791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.405814 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.437313 (+ 31499us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.546388 (+109075us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:38.546438 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.546516 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.939552 (+393036us) raft_consensus.cc:1685] finished
0709 13:01:38.939571 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.939698 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4696,"raft.queue_time_us":119,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6875,"thread_start_us":70741,"threads_started":1,"wal-append.queue_time_us":243915}
I20260709 13:01:38.943470  1684 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.928908  1606 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:38.935848  2691 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.941354  1530 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.954015  1530 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:38.938649  2496 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.948952  1606 pending_rounds.cc:85] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:38.871543  2479 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.951128  1533 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 4. Ops: []
I20260709 13:01:38.893697  2717 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.927923  2738 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.956652  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.952502  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.964497  1533 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.964859  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.954692  1531 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.965962  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.966675  1531 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.955947  1606 pending_rounds.cc:107] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:38.967293  1606 raft_consensus.cc:2889] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.957439  2808 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.936777  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:38.940232  2613 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.989117  1530 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:38.971692  1533 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:01:38.989816  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.990096  1533 pending_rounds.cc:85] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:38.973048  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:38.974633  2784 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.991943  2478 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.986451  2741 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.989154  2693 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:38.995277  1675 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.005s
I20260709 13:01:38.994903  2602 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.996896  2614 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:38.997520  1530 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:39.000161  1677 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:39.001327  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.001552  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.002092  1680 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.002575  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:38.943624  2764 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.952668  2725 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.978303  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.939091  2435 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:38.980746  2832 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:38.981850  1605 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.971258  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.010787  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:38.982864  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98034.8us
I20260709 13:01:38.983963  1684 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:38.985443  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:38.986866  1535 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.971568  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.012423  1529 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:39.013890  1682 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:39.014074  1527 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:39.014415  1606 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.014813  2712 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.015255  1682 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.016234  2741 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.016469  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.017493  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.013831  1601 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 4. Ops: []
I20260709 13:01:38.955353  2496 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:39.018747  2435 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.018631  2766 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.956283  2803 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.004851  2613 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.019892  2435 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:38.990718  1533 pending_rounds.cc:107] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:39.022835  1533 raft_consensus.cc:2889] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.007426  1683 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:39.023904  2796 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.025226  2796 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.025339  2779 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.025729  2779 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.026043  1676 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:39.007414  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.026127  2796 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.027318  2768 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.027802  2768 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.018232  2479 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.028726  2768 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.018651  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.026090  2779 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.019073  2496 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.030894  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.031582  2614 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:39.008901  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.043303  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.032577  2697 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.023644  2748 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:39.048527  2748 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.033545  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 517) took 1527 ms. Trace:
I20260709 13:01:39.000216  2786 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:01:38.976476  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 3f5eb582ff4540bb9b59540cc56f458a: Aborted: Op aborted by new leader
I20260709 13:01:39.035998  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:39.050777  2709 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.052379  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.052860  2717 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.049383  2748 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.045186  2712 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.053496  2717 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:39.054037  2717 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:39.053969  2712 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.054553  2717 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.036571  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.056224  2478 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.056679  2478 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.057024  2478 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.057554  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:39.058279  2720 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.058895  2720 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.059345  2720 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.059949  2716 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.060783  2720 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.062445  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.038401  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.066778  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.041824  1574 leader_election.cc:400] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:01:39.075188  1574 leader_election.cc:403] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:38.970811  2624 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.995967  1675 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:39.036638  1603 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:39.047695  1526 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:39.049391  1532 rpcz_store.cc:276] 0709 13:01:37.505756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.331555 (+825799us) service_pool.cc:224] Handling call
0709 13:01:38.642826 (+311271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.738293 (+ 95467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.033304 (+295011us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54000fb750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:39.033487 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712042880}
I20260709 13:01:39.059247  2595 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.012197  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.039579  1680 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:39.082695  1684 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:39.009617  2725 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.083837  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.059510  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.071956  1607 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:39.071812  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.082051  1609 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:39.085924  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet c4443c0ffc3140788a1384ff8bc1b047: Illegal state: Replica 36f53e9bfce749bbba4a4b34829f563d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:39.086964  1679 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:39.089833  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.071566  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.050127  2661 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.092758  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80950.3us
I20260709 13:01:39.101176  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 837) took 1043 ms. Trace:
I20260709 13:01:39.101264  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.102246  1680 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.103159  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.095001  1682 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.069239  2691 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:39.081489  2697 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.032584  2756 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:39.061456  2716 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:39.098563  2591 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.080648  2624 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.116844  2624 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.117131  2756 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:39.117540  1677 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.119184  1677 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:39.120004  1531 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:39.120456  1531 pending_rounds.cc:85] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:39.120734  1531 pending_rounds.cc:107] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:39.120975  1531 raft_consensus.cc:2889] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.120311  2553 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.065891  2755 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.122889  2553 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.110574  2746 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:01:39.101894  1605 rpcz_store.cc:276] 0709 13:01:38.057986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.948879 (+890893us) service_pool.cc:224] Handling call
0709 13:01:38.981533 (+ 32654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.009832 (+ 28299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.097429 (+ 87597us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5400172fd0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:39.101114 (+  3685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42053376}
I20260709 13:01:39.070767  2479 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:39.080226  2614 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.128304  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.128914  1607 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.129238  2614 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.080550  2712 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.133139  1681 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.112829  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.134589  1684 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.117208  2591 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.109206  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.127226  1683 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.127905  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.111078  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.086308  2744 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.067909  2738 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:39.093495  2742 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.139113  1603 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:39.112586  2834 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.003s
I20260709 13:01:39.132869  2661 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.143436  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.134855  2693 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.166323  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 835) took 1123 ms. Trace:
W20260709 13:01:39.167418  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.166915  1609 rpcz_store.cc:276] 0709 13:01:38.042992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.929228 (+886236us) service_pool.cc:224] Handling call
0709 13:01:39.081855 (+152627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.089137 (+  7282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.166072 (+ 76935us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400249350. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:39.166248 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296633600}
I20260709 13:01:39.138103  2591 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.142784  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.176726  1683 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:39.109951  2691 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:39.151975  1607 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:39.113018  2595 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:39.182606  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet d501527377474732bddb08ed904bd34d: Illegal state: Replica 36f53e9bfce749bbba4a4b34829f563d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:39.154114  2755 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.157408  2624 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.136885  2741 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:39.113566  2697 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.112856  2751 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.107077  2836 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:01:39.137872  2735 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.187418  1603 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:39.174661  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.188017  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 831) took 1146 ms. Trace:
I20260709 13:01:39.173054  2742 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.135042  2606 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:39.184149  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.150385  1681 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.163739  2744 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.163403  2479 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:39.181028  2591 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.182163  2691 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.191694  1605 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:39.188933  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.175786  2712 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:39.207962  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.191335  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.184654  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:39.182363  2595 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.184897  2489 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.207672  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.219265  1609 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:39.150766  2496 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.176601  2709 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:39.191241  2697 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.225953  1605 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.192461  2756 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.212504  2479 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.188519  1610 rpcz_store.cc:276] 0709 13:01:38.042014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.883102 (+841088us) service_pool.cc:224] Handling call
0709 13:01:38.883405 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.883596 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:38.944487 (+ 60891us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.183027 (+238540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.183078 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:39.183139 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.187866 (+  4727us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.187971 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145225,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":32,"raft.queue_time_us":1314,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5790,"thread_start_us":297027,"threads_started":2}
I20260709 13:01:39.183728  2603 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.229380  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 157920us
I20260709 13:01:39.185341  2779 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.252583  1610 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:39.258211  1605 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.226805  2836 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.210562  2735 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.263041  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.217336  2746 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:39.211253  2742 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.271870  1608 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.270002  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.231987  2756 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:39.275013  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 165870us
I20260709 13:01:39.279234  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.279275  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:39.281836  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 148960us
I20260709 13:01:39.282264  1610 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:39.262043  2766 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.263108  2836 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.291823  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.266641  2712 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:39.278748  2756 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.298939  1605 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:39.300451  1605 pending_rounds.cc:85] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:39.259060  2717 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.280630  1676 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.301143  1605 pending_rounds.cc:107] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:39.300460  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.302860  1603 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:39.305848  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.304512  1605 raft_consensus.cc:2889] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.312652  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.308367  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.313946  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.314366  1526 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.314525  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.315464  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.305693  2553 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.297269  2738 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:01:39.317292  2496 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.317648  2738 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.318571  2764 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.319310  2738 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.286581  2748 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:39.321349  2748 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.300166  2712 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.326718  2712 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.328197  2808 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:39.330054  2808 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.333853  2661 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:39.334358  2603 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.336091  2779 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.337623  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.338403  2624 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.290704  2846 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.339505  2846 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.294386  2741 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:39.341027  2741 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.341481  2741 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.341632  2602 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.342139  2846 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.342344  2741 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.343369  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.344347  2717 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.294194  2768 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:01:39.316239  1535 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:39.347681  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.348295  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.349185  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.349442  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.349258  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.348335  1530 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
W20260709 13:01:39.355731  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.357432  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 267666us
I20260709 13:01:39.358434  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.358680  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.365074  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.372866  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.297823  2836 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.376844  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.291730  2803 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.382736  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.383419  1535 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.386269  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 36) took 1197 ms. Trace:
I20260709 13:01:39.293510  2613 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.303799  2716 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.391191  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.300606  2786 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 13:01:39.439891  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.386850  1604 rpcz_store.cc:276] 0709 13:01:38.189348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.987557 (+798209us) service_pool.cc:224] Handling call
0709 13:01:38.987854 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.988111 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:39.253330 (+265219us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.385818 (+132488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.385895 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:39.385956 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.386048 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.386198 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40941,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":278,"thread_start_us":389692,"threads_started":2}
I20260709 13:01:39.441251  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.350819  2748 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.377033  2624 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.334388  2661 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.425915  1603 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:39.455714  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64595us
I20260709 13:01:39.304010  2784 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:01:39.376396  2602 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.379531  2846 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.277597  2744 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.443964  1610 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:39.443598  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.431052  2746 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.293220  2479 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.287396  2595 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.445042  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.337656  2725 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.429111  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.431792  2712 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.431493  2435 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.440268  2796 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.432003  2764 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.420908  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 808) took 1061 ms. Trace:
W20260709 13:01:39.467679  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.467701  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 159370us
I20260709 13:01:39.468637  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:39.466516  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.476980  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.476526  2603 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.473156  2845 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:39.473198  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 172807us
I20260709 13:01:39.477339  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.480983  1683 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.521068  1604 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:39.478240  1528 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:39.443603  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.478789  2851 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.508298  1603 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:39.483670  2746 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.498253  2606 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.535154  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.521816  2624 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.476601  2614 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:01:39.485976  2748 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:39.524134  2603 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.565483  2606 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.481285  2553 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.567270  2603 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.567139  2553 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.480911  2602 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:39.563051  2478 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
I20260709 13:01:39.568833  2602 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.505620  2496 consensus_queue.cc:1175] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36f53e9bfce749bbba4a4b34829f563d" responder_term: 5 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.2-4.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:39.486555  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:39.563107  2691 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.570927  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 84474.4us
W20260709 13:01:39.538904  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.572283  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.572623  2691 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.572821  1604 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:39.573457  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:39.547096  2850 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:01:39.548336  2849 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:39.478091  1535 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.539777  2851 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.531662  2479 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.559624  2697 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.555681  2742 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.553046  2624 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.563691  2860 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:39.553530  2764 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:39.508626  1601 rpcz_store.cc:276] 0709 13:01:38.325767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.020540 (+694773us) service_pool.cc:224] Handling call
0709 13:01:39.020862 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.021209 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.021237 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.021685 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.293945 (+272260us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:39.298038 (+  4093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.305322 (+  7284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.363140 (+ 57818us) raft_consensus.cc:1685] finished
0709 13:01:39.374644 (+ 11504us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.386890 (+ 12246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22256,"raft.queue_time_us":1168,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":252779,"threads_started":1,"wal-append.queue_time_us":303083}
I20260709 13:01:39.506089  2712 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.530367  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:39.514626  2796 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.569525  2478 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.514247  2595 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.545370  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.577610  2847 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.598676  2738 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:39.558053  2853 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:39.581624  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.644884  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.584172  1679 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:39.591255  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:39.593539  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.595163  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87323.3us
I20260709 13:01:39.648115  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.649215  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.649902  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:39.651244  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60108.9us
I20260709 13:01:39.651818  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.651906  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.652722  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:39.606371  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:39.553170  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 89401.5us
I20260709 13:01:39.594601  2751 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.593822  2606 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.622843  1531 raft_consensus.cc:2368] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:39.668370  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.668995  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.669421  1679 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:39.674006  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.676277  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.677132  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.609280  2624 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.550485  2661 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.631304  2591 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.578359  1602 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.633750  2478 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.634368  1609 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 5. Ops: []
I20260709 13:01:39.602681  2784 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:01:39.636672  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.674759  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.665797  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.664913  2859 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:39.665396  2751 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.679212  2712 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.680398  2746 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.680749  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.681563  2697 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.682341  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.656787  2603 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.673419  2691 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:39.647012  2803 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.690131  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 811) took 1359 ms. Trace:
I20260709 13:01:39.748090  1606 rpcz_store.cc:276] 0709 13:01:38.330994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.040699 (+709705us) service_pool.cc:224] Handling call
0709 13:01:39.073114 (+ 32415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.073667 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.073692 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.082898 (+  9206us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.486968 (+404070us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:39.497234 (+ 10266us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.689776 (+192542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.689863 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.689914 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:39.689932 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.690071 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37016,"prepare.queue_time_us":9893,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":69793,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":6695,"thread_start_us":511692,"threads_started":2,"wal-append.queue_time_us":513788}
I20260709 13:01:39.707439  2725 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:39.750761  2735 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.707537  2478 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.667783  2766 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.675547  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.603600  2435 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:39.694849  1530 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:39.664865  2851 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.675240  2847 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.667562  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.700913  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.770874  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:39.702811  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66291.6us
I20260709 13:01:39.706455  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.772362  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.758066  1675 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.711098  1534 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:39.689205  2860 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:39.743294  1677 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.687094  2869 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:01:39.765148  2478 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.785425  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:39.786013  1680 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.786420  2478 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.745929  2836 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.788414  2836 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.788621  2860 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.789018  2860 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.690403  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:39.704747  2553 raft_consensus.cc:2764] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:39.763474  1610 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:39.791172  1679 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.684427  2606 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.793174  2606 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:39.794521  2606 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.762840  2766 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.796845  2766 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.798269  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.799185  1601 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.657874  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.800742  2478 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:39.800988  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143183us
I20260709 13:01:39.801276  2478 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.757556  2591 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.772334  1683 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.804885  2603 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.709736  2751 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.775172  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.789881  2860 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.811445  2860 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.811702  2435 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.816005  2836 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.816815  2836 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.826491  2848 log.cc:927] Time spent T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:01:39.769414  2847 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:39.830590  1680 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:39.837201  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:01:39.831772  2865 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:39.834664  2624 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.807437  2756 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:39.837078  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.830690  2862 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:39.828228  2847 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.839341  2878 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:39.857379  2878 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:39.857892  2878 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.847713  2756 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:39.859377  2868 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:39.860020  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.861158  1530 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:39.851461  2766 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.863248  1602 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:39.863816  2716 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:39.841372  2603 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.864494  2716 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.849354  2624 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.850373  2862 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:39.866331  2862 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.851761  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.868023  2603 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.870663  2836 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.870321  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.871506  2836 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.872987  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.875391  2836 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.877745  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:39.879267  2766 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.883868  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 2, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.885989  1430 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 2 to 3, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.887099  2766 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:39.888290  1431 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 1 to 2, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.890808  2603 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:39.890432  1431 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 1 to 2, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.884797  2836 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.888183  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.785184   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:39.893195  1605 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:39.839039  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.895522  1534 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:39.871538  2591 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.881322  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.879894  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.900077  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.906118  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.907922  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.928228  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:39.891191  2603 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:39.929713  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.930507  1535 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.926965  2591 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.929944  2603 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.898486  1430 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.938850  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.939523  1530 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:39.940186  1430 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.942565  1430 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.932729  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.933359  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.934087  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.944796  1534 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:39.944730  1430 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 2 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.949167  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.950440  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.951478  1534 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.949426  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.953284  1530 raft_consensus.cc:2368] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4.
I20260709 13:01:39.957965  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:39.823642  2751 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:39.961582  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.964087  2591 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.967010  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 555) took 1008 ms. Trace:
I20260709 13:01:39.977463  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 172) took 6399 ms. Trace:
I20260709 13:01:39.977710  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:39.978626  1610 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.981823  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.982360  1530 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:39.965481  1430 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193), VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194), VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195), NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:01:39.971171  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:39.972712  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:39.972986  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:39.985070  2751 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:39.987789  2885 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
W20260709 13:01:39.988669  2864 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.444s	user 0.004s	sys 0.003s
I20260709 13:01:39.992909  2851 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.978039  1432 rpcz_store.cc:276] 0709 13:01:33.570759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.575834 (+  5075us) service_pool.cc:224] Handling call
0709 13:01:39.969997 (+6394163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:36.768499 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:36.808577 (+ 40078us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:36.808641 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:01:36.808659 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:36.821643 (+ 12984us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:36.821739 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:36.821767 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:01:36.823101 (+  1334us) tablet.cc:701] Row locks acquired
0709 13:01:36.823137 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:01:36.823314 (+   177us) write_op.cc:270] Start()
0709 13:01:36.823462 (+   148us) write_op.cc:276] Timestamp: P: 1783602096823252 usec, L: 0
0709 13:01:36.823497 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:01:36.854913 (+ 31416us) log.cc:844] Serialized 6749 byte log entry
0709 13:01:37.693985 (+839072us) op_driver.cc:464] REPLICATION: finished
0709 13:01:38.018201 (+324216us) write_op.cc:301] APPLY: starting
0709 13:01:38.020373 (+  2172us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:38.020817 (+   444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:38.020963 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:38.034454 (+ 13491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:38.034936 (+   482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:01:38.035027 (+    91us) write_op.cc:312] APPLY: finished
0709 13:01:38.063220 (+ 28193us) log.cc:844] Serialized 118 byte log entry
0709 13:01:38.075518 (+ 12298us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.084108 (+  8590us) write_op.cc:454] Released schema lock
0709 13:01:38.093945 (+  9837us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:38.129304 (+ 35359us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.129336 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":256,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":305052,"apply.run_cpu_time_us":6246,"apply.run_wall_time_us":121986,"num_ops":17,"prepare.queue_time_us":156435,"prepare.run_cpu_time_us":18547,"prepare.run_wall_time_us":189180,"raft.queue_time_us":569317,"raft.run_cpu_time_us":16676,"raft.run_wall_time_us":217894,"replication_time_us":830683,"thread_start_us":590658,"threads_started":4,"wal-append.queue_time_us":152220,"wal-append.run_cpu_time_us":39103,"wal-append.run_wall_time_us":2058042}]]}
I20260709 13:01:39.992997  1534 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:39.992391  1535 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:39.993386  1675 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:39.953719  2764 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.993948  2761 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:40.015573  2761 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:40.016640  2761 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:40.017747  2761 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.019166  1601 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:39.995187  1605 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:40.020677  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.021061  1605 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:40.022497  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.023046  1533 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.023190  1605 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:39.948158  2435 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:40.024277  2435 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.027022  2435 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:39.959251  2624 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.998490  1604 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:39.974429  1682 rpcz_store.cc:276] 0709 13:01:38.958884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.104793 (+145909us) service_pool.cc:224] Handling call
0709 13:01:39.105171 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.489990 (+384819us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:01:39.490076 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.512611 (+ 22535us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.892787 (+380176us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:39.892822 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.894516 (+  1694us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.966738 (+ 72222us) raft_consensus.cc:1685] finished
0709 13:01:39.966767 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.966930 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31426,"raft.queue_time_us":36841,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13721,"thread_start_us":727134,"threads_started":2,"wal-append.queue_time_us":452038}
I20260709 13:01:39.996749  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.004156  1430 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:40.006105  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48236.4us
I20260709 13:01:39.980988  2603 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.012959  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.013738  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.035077  1534 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:40.035324  1535 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:40.028203  1529 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.036362  1610 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:40.038681  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.037866  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:40.038846  1533 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:40.041900  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:40.041361  1430 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.042171  1610 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.042907  1430 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 2, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.008379  2697 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.027647  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.011283  2591 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.049702  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:40.055313  1527 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:40.051281  2624 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.048581  2735 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.070523  2859 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:40.045619  2489 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.048468  2860 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.090251  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:40.078413  2751 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.129166  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:40.112421  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.045701  2857 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:01:40.079661  2744 raft_consensus.cc:2764] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:40.058930  2724 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:01:40.089028  2489 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.059361  2591 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.058754  2847 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.122102  2756 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.124109  2614 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.127523  1601 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:40.140396  2755 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.124782  2860 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:40.137643  2751 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.177767  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 863) took 1112 ms. Trace:
I20260709 13:01:40.120872  2697 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:40.194628  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.202883  1607 rpcz_store.cc:276] 0709 13:01:39.065197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.344659 (+279462us) service_pool.cc:224] Handling call
0709 13:01:39.344969 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.345307 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:39.345590 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.490896 (+145306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.497327 (+  6431us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.497654 (+   327us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:39.497693 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.497764 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.973279 (+475515us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:40.173323 (+200044us) raft_consensus.cc:1685] finished
0709 13:01:40.177607 (+  4284us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.177719 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6908,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":26084,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":19262,"spinlock_wait_cycles":54454400,"thread_start_us":144956,"threads_started":1,"wal-append.queue_time_us":198493}
I20260709 13:01:40.210034  1605 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:40.174144  2614 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.179104  2724 consensus_queue.cc:1243] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:01:40.185304  2882 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:40.208346  2755 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.223855  2858 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:40.180294  2869 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:01:40.230603  2860 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.237393  2591 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.240109  1607 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:40.249116  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 834) took 2206 ms. Trace:
I20260709 13:01:40.219599  2614 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.178123  2756 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.257771  1608 rpcz_store.cc:276] 0709 13:01:38.042756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.926942 (+884186us) service_pool.cc:224] Handling call
0709 13:01:38.938724 (+ 11782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.276157 (+337433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.247896 (+971739us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540003bbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:40.249037 (+  1141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765576960}
I20260709 13:01:40.193790  2716 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:40.262133  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127277us
I20260709 13:01:40.263722  1610 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:40.264389  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.270928  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:40.271651  1607 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.272912  2764 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:40.273865  2857 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:40.274387  2756 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.275043  1529 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:40.274428  2845 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:40.276239  2845 consensus_queue.cc:1243] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:40.276675  2845 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:40.276990  2845 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.277069  2716 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:40.278055  2845 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.279554  2591 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:01:40.279973  2764 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:40.280378  2764 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.281162  2764 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.281957  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:40.282891  1604 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:40.288902  1607 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:40.282223  2764 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.290758  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:40.292309  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:40.283973  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.301862  1607 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.297096  1604 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:01:40.304118  1607 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.279567  2845 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:40.305840  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.301065  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:01:40.319947  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.297544  2857 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.315706  1532 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.296159  2717 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:40.308185  2766 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.323594  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.290089  2878 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.322124  2836 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:40.342168  1648 leader_election.cc:400] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4.
W20260709 13:01:40.354097  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 101914us
I20260709 13:01:40.358563  1648 leader_election.cc:403] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.379103  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:40.351503  2766 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:40.392382  2840 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:40.408515  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 541) took 1129 ms. Trace:
I20260709 13:01:40.409180  1605 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:40.408947  1531 rpcz_store.cc:276] 0709 13:01:39.278731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.278912 (+   181us) service_pool.cc:224] Handling call
0709 13:01:40.408313 (+1129401us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000a37d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:40.408453 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782507392}
I20260709 13:01:40.359858  2697 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:40.392650  2742 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:40.428411  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.429814  1531 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.400718  2489 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.437978  2489 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:40.438819  2893 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:40.439236  2904 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4.
I20260709 13:01:40.430039  2742 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.440290  2878 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:40.440696  2898 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.400108  2847 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.441028  2742 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.441241  2898 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.442620  2742 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.331203  2755 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.370327  2735 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:01:40.403251  2766 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.446231  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.369508  2744 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:40.452306  2857 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:40.454530  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.438108  2891 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:01:40.369820  2591 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:01:40.469873  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:40.443787  2898 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.482189  1531 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:40.469105  2888 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 13:01:40.480139  2614 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.496739  2614 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.498750  2766 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:40.485911  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143915us
I20260709 13:01:40.476193  2735 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.465921  2697 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:40.518788  1531 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.509649  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:40.521687  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 203030us
I20260709 13:01:40.522511  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:40.526237  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:40.529088  1603 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.531176  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:40.531215  2479 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.528530  2836 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:40.549139  2891 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:40.534117  2725 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.548414  2748 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:40.551244  2901 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:40.554721  2717 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.583313  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:40.529516  2735 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.590343  2697 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.566135  2878 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:01:40.596858  2901 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:40.589627  2717 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.592549  2922 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.600190  2901 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.604069  2735 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.614645  2918 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.629880  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:40.615403  2918 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.635900  2717 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.605083  2725 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:40.643848  2725 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:40.644415  2725 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.645072  2478 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:40.646727  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.616427  2836 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.650962  2878 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:40.656813  2878 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:40.657624  2878 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.658866  2878 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.664304  1574 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:40.666033  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:40.667850  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.668354  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.671514  1527 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.672307  2478 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.672634  2725 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:40.671285  2914 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:40.674407  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:40.682755  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.683810  1531 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:40.685232  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.639240  2921 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:40.690585  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:40.632174  2922 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.653962  2766 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.693145  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.697502  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:40.750998  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54621.9us
I20260709 13:01:40.753201  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:40.779865  2917 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.700603  2915 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.791957  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.765403  2603 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.765203  2914 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.785989  2908 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.780714  2766 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:40.822067  2923 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:40.822767  1526 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:40.809449  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:40.789711  2915 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.857630  1534 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:40.860287  2915 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.801821  2917 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.856407  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:40.869202  1531 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.829073  2908 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:40.830240  2603 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:40.837044  2914 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:40.927623  2929 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
W20260709 13:01:40.929190  2927 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:01:40.933952  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 372581us
W20260709 13:01:40.956981  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 394115us
I20260709 13:01:40.961038  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:40.898473  2908 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.854933  2766 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:40.893780  2917 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:40.901836  2748 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.990770  1531 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:40.994100  2748 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.000869  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.008235  2741 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.012972  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:41.067911  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.068775  1605 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:41.051402  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.070825  1607 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.972684  2595 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:01:40.999840  2918 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.005761  2917 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:41.011989  2691 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.062664  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 309523us
W20260709 13:01:40.966847  2923 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:41.057503  1602 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:01:41.072896  2479 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
W20260709 13:01:41.080114  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.078856  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.075907  1607 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:41.091032  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.055s
W20260709 13:01:41.091427  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.055s
I20260709 13:01:41.104341  1574 leader_election.cc:400] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:41.104868  1574 leader_election.cc:403] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:41.105154  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 565) took 1209 ms. Trace:
I20260709 13:01:41.106077  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.105906  1534 rpcz_store.cc:276] 0709 13:01:39.895478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.036113 (+140635us) service_pool.cc:224] Handling call
0709 13:01:40.857426 (+821313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.860709 (+  3283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.104829 (+244120us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400319f50. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:41.105057 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888078592}
I20260709 13:01:41.109709  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.059739  2603 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.119767  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.120131  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.074590  2917 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.121559  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.126331  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 819) took 2793 ms. Trace:
I20260709 13:01:41.129071  1609 rpcz_store.cc:276] 0709 13:01:38.333172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.228203 (+895031us) service_pool.cc:224] Handling call
0709 13:01:39.255280 (+ 27077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.702572 (+447292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.126096 (+1423524us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400100c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:41.126270 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871334656}
I20260709 13:01:41.141490  2916 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.142028  2916 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:41.142436  2916 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:41.092384  2871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.343s	user 0.020s	sys 0.043s
I20260709 13:01:41.092411  2479 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.084126  2595 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:41.110904  2717 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.079869  2691 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.119779  2918 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:41.115513  2939 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
W20260709 13:01:41.148334  2871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.020s	sys 0.043s
I20260709 13:01:41.161298  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.151661  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.175688  1682 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:41.176488  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:41.159068  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 156895us
I20260709 13:01:41.063084  2914 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.159241  2613 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.158500  2931 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:41.196316  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.166997  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.166337  2479 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.167662  2918 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.184872  1678 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.218950  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:41.220191  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 249775us
I20260709 13:01:41.196086  2931 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:41.223126  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.211750  2871 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:41.217253  1676 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:41.199434  2932 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:41.224686  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.240332  1680 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:41.213461  2766 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.220340  1679 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:41.241853  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.243010  1679 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.247852  1606 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:41.218536  2479 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:41.236626  2871 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:41.252846  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.239755  2748 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.244879  2796 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.267325  1679 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:41.270334  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.270262  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.274595  1679 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:41.277027  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:41.277585  2942 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:41.278235  2479 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:01:41.279175  2937 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:41.277674  1680 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.243948  2932 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.286047  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63025.3us
I20260709 13:01:41.249502  2901 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:01:41.289465  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.306777  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:41.282321  2866 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.539s	user 0.004s	sys 0.004s
I20260709 13:01:41.309705  1679 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:41.311110  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.316758  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:41.321818  1680 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:41.323854  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.285295  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.255232  2918 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.325944  2916 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.330611  2934 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:01:41.327273  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:41.302946  2939 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.308727  2917 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.338451  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.308528  2936 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:41.343557  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:41.344048  1534 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:41.344676  2915 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.335807  2933 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:01:41.317133  2479 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.312716  2946 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:41.324184  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:41.340756  1680 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:41.271376  2931 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.331827  2691 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.341521  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:41.341650  2741 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.356395  1682 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:01:41.358865  2878 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.700s	user 0.014s	sys 0.000s
I20260709 13:01:41.359733  1534 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:41.359856  1677 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:41.357110  1676 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:41.363194  2940 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:01:41.364646  1676 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:01:41.365036  1676 pending_rounds.cc:85] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 1
I20260709 13:01:41.287148  2871 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.365317  1676 pending_rounds.cc:107] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:01:41.361254  2908 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.365793  2871 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.367632  2908 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.368242  2946 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:41.349480  2936 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.365658  1676 raft_consensus.cc:2889] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.381294  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.354115  2915 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.362653  2931 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.387627  2904 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:41.393471  2951 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:41.394129  2951 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.395323  2944 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:01:41.347549  2939 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.396350  2946 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:41.397714  2948 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:41.353550  2479 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.389815  1527 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:41.362187  2691 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:41.362469  2741 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.397760  2939 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:41.418164  2875 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.660s	user 0.002s	sys 0.010s
I20260709 13:01:41.423025  2958 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.423732  2958 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.426548  2958 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.430107  2916 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.415998  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 793) took 1123 ms. Trace:
I20260709 13:01:41.431972  1533 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:41.443832  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 792) took 1461 ms. Trace:
I20260709 13:01:41.444258  1533 rpcz_store.cc:276] 0709 13:01:39.982280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.443880 (+461600us) service_pool.cc:224] Handling call
0709 13:01:41.431572 (+987692us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:41.431763 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.443440 (+ 11677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.443753 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25696640}
I20260709 13:01:41.468693  1603 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:41.421944  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:41.438277  1602 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.436796  1676 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.489890  2496 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:41.496726  2496 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:41.433674  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:41.476779  2950 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:41.468251  2693 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.471629  2916 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.470516  2951 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.521502  1528 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:41.522086  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 780) took 1620 ms (client timeout 2013 ms). Trace:
I20260709 13:01:41.513648  2693 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.513173  1675 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.481046  2691 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:01:41.525736  1528 rpcz_store.cc:269] 0709 13:01:39.902148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.405504 (+1503356us) service_pool.cc:224] Handling call
0709 13:01:41.522006 (+116502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.542675  1676 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:41.542557  2964 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:41.543000  2741 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.548154  1676 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:41.523516  2916 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:41.564893  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.578248  2895 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 1.235s	user 0.008s	sys 0.000s
I20260709 13:01:41.578838  2916 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:41.589246  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:41.438038  1532 rpcz_store.cc:276] 0709 13:01:40.290796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.447716 (+156920us) service_pool.cc:224] Handling call
0709 13:01:40.454984 (+  7268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.455407 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.455451 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.489370 (+ 33919us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.057791 (+568421us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.059471 (+  1680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.065069 (+  5598us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.402214 (+337145us) raft_consensus.cc:1685] finished
0709 13:01:41.402232 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.413940 (+ 11708us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10526,"spinlock_wait_cycles":9157376,"thread_start_us":486727,"threads_started":1,"wal-append.queue_time_us":625106}
I20260709 13:01:41.599169  2943 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.612576  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.613699  1678 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:41.614287  2211 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:41.616521  2768 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:41.617096  2768 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:41.622012  2768 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.623176  2768 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.625623  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 893) took 1975 ms. Trace:
I20260709 13:01:41.625962  2693 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.626521  1675 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:41.626024  1681 rpcz_store.cc:276] 0709 13:01:39.649940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.784583 (+134643us) service_pool.cc:224] Handling call
0709 13:01:39.784919 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.824398 (+ 39479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.824432 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.324792 (+1500360us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:01:41.330879 (+  6087us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.468012 (+137133us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:41.468135 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.469871 (+  1736us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.625363 (+155492us) raft_consensus.cc:1685] finished
0709 13:01:41.625383 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.625564 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39049,"raft.queue_time_us":39274,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":158851456,"thread_start_us":132442,"threads_started":1,"wal-append.queue_time_us":240461}
I20260709 13:01:41.627897  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.581705  2961 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
I20260709 13:01:41.643461  2916 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.647635  2916 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.649188  2916 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.635282  2693 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:41.618214  2943 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.648449  2918 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.653105  2693 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:41.656654  2854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.294s	user 0.009s	sys 0.005s
I20260709 13:01:41.659245  2847 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:41.668362  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.665722  2854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.009s	sys 0.006s
I20260709 13:01:41.666389  2847 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.673405  2847 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.674670  2847 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.673878  2693 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.675364  2922 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.666035  2918 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.679613  2918 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.683259  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:41.684136  1675 raft_consensus.cc:606] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.684507  1675 raft_consensus.cc:614] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:41.684798  2496 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.686231  2496 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.689725  2943 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:41.690709  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.694677  2871 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.695420  2871 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.697502  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 786) took 1787 ms. Trace:
I20260709 13:01:41.697803  2871 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.698006  1526 rpcz_store.cc:276] 0709 13:01:39.910280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.133401 (+223121us) service_pool.cc:224] Handling call
0709 13:01:40.211667 (+ 78266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.875256 (+663589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.697178 (+821922us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:41.697433 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344016768}
I20260709 13:01:41.704998  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:41.705652  1675 raft_consensus.cc:606] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.708689  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 779) took 1806 ms. Trace:
I20260709 13:01:41.709156  1535 rpcz_store.cc:276] 0709 13:01:39.901873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.036323 (+134450us) service_pool.cc:224] Handling call
0709 13:01:40.050761 (+ 14438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.180870 (+130109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.180919 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.180974 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:40.181018 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.708434 (+1527416us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540003eb54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:41.708486 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.708612 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298686208}
I20260709 13:01:41.700182  2916 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:41.710470  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:41.712332  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.712457  1675 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.713836  2478 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:41.714236  2478 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.715085  2478 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.715620  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:41.716248  1681 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.717223  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.718215  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.718433  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.719736  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.723758  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.719882  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 879) took 1637 ms. Trace:
I20260709 13:01:41.721542  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 789) took 1810 ms. Trace:
I20260709 13:01:41.724651  1676 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:41.724711  2697 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.725070  1530 rpcz_store.cc:276] 0709 13:01:39.911080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.443281 (+532201us) service_pool.cc:224] Handling call
0709 13:01:41.720834 (+1277553us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:41.721017 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.721197 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.721229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.721270 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:41.721311 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.721366 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.721490 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11277184}
I20260709 13:01:41.725411  2697 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.727312  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.724711  1610 rpcz_store.cc:276] 0709 13:01:40.082794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.265440 (+182646us) service_pool.cc:224] Handling call
0709 13:01:40.265733 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.295489 (+ 29756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.295522 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.296015 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.426866 (+130851us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:40.426902 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.719506 (+1292604us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400365e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:41.719556 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.719606 (+    50us) raft_consensus.cc:1685] finished
0709 13:01:41.719617 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.719828 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7533,"raft.queue_time_us":9164,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6431,"spinlock_wait_cycles":50222976,"thread_start_us":130525,"threads_started":1,"wal-append.queue_time_us":252437,"wal-append.run_cpu_time_us":4590,"wal-append.run_wall_time_us":1058306}
I20260709 13:01:41.728929  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.729223  2847 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.727568  2697 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.729887  2847 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.730603  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.731662  2961 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.732328  2961 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.733007  2899 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.733572  2899 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.734422  2768 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.734892  2768 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.734903  2961 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.736094  2903 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.736567  2903 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.737301  2741 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.738129  2741 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.738788  2768 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.739320  2768 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.739723  2768 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.735569  2899 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:41.740695  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.740904  2741 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.741174  2693 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.743196  2751 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.743850  2751 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.744397  2751 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.745559  2906 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.746212  2859 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.749318  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.750507  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.746690  2859 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.738823  2903 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.751538  2751 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:41.721915  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.754550  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:41.770849  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.752655  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.774340  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.759143  2903 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:41.777074  2961 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.746023  2906 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.747387  2478 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.741693  2768 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.785329  2939 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:41.784582  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.759862  2859 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:41.787774  2906 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.781963  2943 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.801815  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.801462  2854 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:41.812834  1648 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:41.813176  1648 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:41.802429  2978 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:41.760572  2847 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:41.766471  2751 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.778517  2918 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.809449  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.777871  2910 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.811254  2914 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.820178  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.830037  1683 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:41.817781  2914 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.831408  2914 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.831523  2489 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:41.832103  2489 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.832983  2489 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.835057  2766 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:41.841856  2914 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.842605  2766 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:41.843035  2766 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.831424  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.818384  2961 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.844465  2914 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:41.848273  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.851260  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:41.829005  2693 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.829694  2908 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.819005  2751 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.862687  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.863093  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:41.867164  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.869011  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.871126  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.871719  1681 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.871126  1680 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:41.856725  2478 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.873035  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.876827  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.856948  2908 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:41.881933  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.882582  1680 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:41.883567  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.884163  1680 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:41.885056  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.886075  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:41.886595  1680 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.870767  2847 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:41.889897  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.843959  2766 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.872388  2871 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.880766  2908 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.874723  2478 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.909623  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.912374  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.913836  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:41.881738  2744 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.917536  1681 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:41.918421  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.919176  1681 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:41.877275  2914 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:01:41.933750  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.013s (SENT) [suppressed 8 similar messages]
I20260709 13:01:41.923640  1680 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:41.921461  2961 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.938091  2979 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:41.938627  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.915715  2478 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.938934  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.939652  1683 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:41.940637  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.941176  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:41.942025  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.942101  2768 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:41.942476  1679 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:41.942550  2768 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:41.942916  1679 pending_rounds.cc:85] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 2
I20260709 13:01:41.943177  1679 pending_rounds.cc:107] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:41.943113  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.943607  1679 raft_consensus.cc:2889] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.944310  1675 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.945888  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.908054  2720 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:41.951982  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:41.946777  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.962793  1604 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:41.911553  2847 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:41.960363  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.965870  1607 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:41.960893  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:41.915479  2624 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.947259  1610 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:41.920873  2857 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.893066  2435 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:41.923594  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:41.966776  1603 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:41.908710  2943 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:41.968557  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.935140  2871 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.936540  2766 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.946327  2697 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.943465  2768 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.919281  2951 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:01:41.974638  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:41.952572  2869 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:41.975183  2939 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:41.962338  1601 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:41.975505  2906 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:42.021126  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.029850  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55295.6us
W20260709 13:01:42.020689  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.972857  2489 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:42.016875  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.938102  2961 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:42.056382  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 122677us
I20260709 13:01:41.975773  2836 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:41.973681  2720 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:42.019420  2915 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:42.059674  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 91238.7us
I20260709 13:01:41.984270  2914 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:01:42.030274  2939 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:42.056567  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131414us
I20260709 13:01:42.030558  2871 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:42.051854  2768 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.989794  2918 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.075263  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.060294  2624 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:42.056737  2906 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.081573  2915 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.992156  2697 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:41.986949  2943 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.061482  2744 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.116459  2984 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:42.116325  2744 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.116637  2914 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.117241  2914 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.118479  2744 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.119184  2914 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.097930  2906 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.060014  2846 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:42.065470  2735 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.120064  2980 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:01:42.120379  2735 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.122408  2735 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.099608  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.093806  2489 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.123485  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:42.127702  1534 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:42.106802  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.108136  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.109601  2915 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.109977  2661 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.097329  2624 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.111387  1532 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:42.123632  2489 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:42.145767  2985 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:42.146452  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.147282  2489 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.074055  2435 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.147693  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.148301  2435 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.061480  2847 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.124823  2862 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.126264  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.128089  2936 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.149953  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:42.150172  1533 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:42.150662  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:42.091352  2871 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:42.097182  2987 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.139812  2784 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.174850  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.180655  1534 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:42.181509  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.120059  2846 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.178334  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:42.190258  1680 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:42.179167  1681 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:01:42.191262  1681 pending_rounds.cc:85] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 1
I20260709 13:01:42.151613  2918 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.182296  1534 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:42.126549  2693 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:42.150795  2914 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:42.184496  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 93010.6us
I20260709 13:01:42.188853  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:42.190340  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.191589  1681 pending_rounds.cc:107] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:01:42.144217  2915 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:42.192152  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.192402  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.170967  2479 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.183109  1526 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 2: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:42.223835  1606 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.196832  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.199272  1681 raft_consensus.cc:2889] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.200639  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.211755  1679 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:42.213447  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.226007  1535 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:42.226222  1534 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:42.226485  1609 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:42.227062  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:42.228319  1534 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:42.191290  2836 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:42.129496  2939 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.220096  1607 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:42.177328  1527 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:42.191143  2951 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.232548  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.196713  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.238885  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.240309  1609 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:42.205505  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:42.188750  2784 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.198011  1532 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:42.242529  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.245926  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:42.221643  2961 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.180234  2720 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.184670  2987 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.237319  2489 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.221920  2735 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:42.206265  2952 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:42.248522  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.204963  2914 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.218415  2478 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.222522  2915 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.268564  1609 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:42.245040  2435 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.255342  2994 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:42.273289  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.274107  1609 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:01:42.274259  2994 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.274385  2784 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.274847  2994 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.276223  2914 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.256524  2939 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.279795  2958 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.280439  2958 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.281386  2987 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.281985  2836 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.283425  2943 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.284591  2871 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:42.284911  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.276328  2915 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.285497  1608 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:42.274869  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.247597  2996 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.285964  1682 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:42.291088  1609 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:42.292945  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.293944  1606 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 1.
I20260709 13:01:42.298275  1609 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.258319  2489 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.312307  2489 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.312558  2932 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:42.315001  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.316075  2751 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.290560  2908 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.318882  2908 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.306689  2996 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.320264  1604 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.243716  2951 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.321837  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:42.322547  1678 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:42.307952  2478 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.308878  1608 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.309222  1605 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:42.288766  2993 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:42.327491  1684 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:42.321837  2996 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.338877  2878 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.339411  2878 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:42.342113  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 140322us
I20260709 13:01:42.343695  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:42.344442  1529 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.349310  2998 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.349932  2998 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.352226  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:42.335835  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 36) took 7119 ms. Trace:
I20260709 13:01:42.360395  1431 rpcz_store.cc:276] 0709 13:01:35.216797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.216988 (+   191us) service_pool.cc:224] Handling call
0709 13:01:42.335755 (+7118767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:40.056415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:40.057431 (+  1016us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:40.057460 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:01:40.057479 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:40.057847 (+   368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:40.057920 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:40.057952 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:40.070549 (+ 12597us) tablet.cc:701] Row locks acquired
0709 13:01:40.070568 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:40.070737 (+   169us) write_op.cc:270] Start()
0709 13:01:40.070847 (+   110us) write_op.cc:276] Timestamp: P: 1783602100070698 usec, L: 0
0709 13:01:40.070869 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:40.071499 (+   630us) log.cc:844] Serialized 918 byte log entry
0709 13:01:41.577517 (+1506018us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:41.746861 (+169344us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800351400. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:01:41.747182 (+   321us) op_driver.cc:464] REPLICATION: finished
0709 13:01:41.845147 (+ 97965us) write_op.cc:301] APPLY: starting
0709 13:01:41.846363 (+  1216us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:41.855799 (+  9436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:41.855844 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:41.880740 (+ 24896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:41.890760 (+ 10020us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:41.890827 (+    67us) write_op.cc:312] APPLY: finished
0709 13:01:41.910405 (+ 19578us) log.cc:844] Serialized 28 byte log entry
0709 13:01:41.916548 (+  6143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.922028 (+  5480us) write_op.cc:454] Released schema lock
0709 13:01:41.935310 (+ 13282us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:41.985723 (+ 50413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.987630 (+  1907us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1133309,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":66508,"apply.run_cpu_time_us":3074,"apply.run_wall_time_us":133106,"mutex_wait_us":5941,"num_ops":2,"prepare.queue_time_us":105226,"prepare.run_cpu_time_us":49213,"prepare.run_wall_time_us":205402,"raft.queue_time_us":230689,"raft.run_cpu_time_us":28599,"raft.run_wall_time_us":139541,"replication_time_us":1676172,"spinlock_wait_cycles":19858432,"thread_start_us":299805,"threads_started":4,"wal-append.queue_time_us":271525}]]}
I20260709 13:01:42.365597  2878 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.271502  2989 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:42.376583  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 175957us
W20260709 13:01:42.386016  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.388813  2857 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.385458  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.389434  2857 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.391534  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.322507  2697 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.365614  2998 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.427465  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:42.379796  2624 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.401852  2857 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.433627  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:42.434144  2869 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.434365  2211 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:42.434618  2869 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.435048  2869 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.436168  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:42.381294  2989 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.428331  2952 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:42.444736  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.446221  2958 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.448100  2624 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.448828  2624 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.449733  2951 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.453017  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:42.432205  2846 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.437247  2998 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.443641  2952 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.442425  1529 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:42.471007  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.461493  2951 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.488986  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.490070  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:42.491537  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:42.494347  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:42.492420  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 102156us
I20260709 13:01:42.472496  2952 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.469285  2906 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.556989  2744 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:42.557034  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62781us
I20260709 13:01:42.560175  2744 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:42.560607  2744 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:42.562489  3009 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.215s	user 0.001s	sys 0.002s
W20260709 13:01:42.565214  3008 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:01:42.565418  2989 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.565532  3015 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.566305  3015 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:42.567567  3004 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:01:42.556421  2624 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.473587  2846 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:42.568548  3013 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.569463  2846 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.570102  2846 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:42.570431  2846 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:42.468856  2998 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.498660  2951 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:42.626237  2846 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.602999  2624 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.632933  2869 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.635283  2869 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.633419  2624 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.640784  1603 raft_consensus.cc:2368] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:42.641815  2906 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.646911  2869 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:42.632745  2998 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.620059  2951 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.596221  2939 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:42.647617  2869 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.648499  2939 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.650585  2939 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.622545  3013 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:01:42.651538  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.652419  2869 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.626889  2489 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.654595  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.657490  1534 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.658782  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.660534  1533 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:42.660573  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.661741  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.662523  1533 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:42.663625  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.665251  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:42.667799  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.661638  1534 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:42.669174  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.670012  1534 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:42.671151  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.672345  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.673223  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.671643  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:42.675900  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 180368us
I20260709 13:01:42.689795  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.693913  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.695000  1610 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:42.698438  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:42.701192  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.704775  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.705432  1607 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:42.705613  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.708865  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:42.711604  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d120199a9d3441ab490816cfe76664f: Illegal state: Replica 8c6031790cc44edfba5c3964e6f27c6e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:42.716857  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.718475  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.704557  2725 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.722340  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.722544  2725 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.723246  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.723840  1527 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:42.724334  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.724709  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.724812  2725 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:42.724910  1602 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:42.722862  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.728205  1606 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:42.728718  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.729046  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.739738  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.725962  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.725883  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:42.740326  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.725831  2939 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:42.741483  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.743844  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.745122  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:42.746423  1606 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:42.746606  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.744812  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.748181  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.711202  2878 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:42.750799  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:42.749258  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.751260  1608 raft_consensus.cc:2368] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:42.726624  2847 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.738332  2489 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:42.710060  2869 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:42.744913  2871 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.752795  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.789510  1530 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.804155  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:42.743374  2836 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.845723  1606 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.711287  2624 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.745481  2906 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.737042  2998 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.754541  2990 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.753906  2932 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.754258  2725 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:42.865804  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 113109us
I20260709 13:01:42.742409  3013 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:01:42.833760  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 84580.1us
I20260709 13:01:42.753157  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:42.745473  2661 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
W20260709 13:01:42.841560  3019 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:42.784384  2939 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:42.895673  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:42.896785  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.922580  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.837409  2857 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:42.771787  2989 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:01:42.863149  2958 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.845844  2871 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.894235  2725 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.927439  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:42.925330  1534 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:42.772565  2878 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.838330  3020 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.869624  2999 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.897852  2916 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:42.894433  2932 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.973414  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.927867  2716 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.875556  2990 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:43.086181  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.094354  1606 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:42.872601  2998 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:42.928181  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:42.894714  2744 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:42.928723  2906 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.949195  2858 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:42.984059  2871 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.114938  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.218093  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:43.126766  2998 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.949873  2836 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.999143  3020 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.953755  2958 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.998653  2725 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.160049  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:01:43.161373  3011 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:01:43.201272  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 597) took 1062 ms. Trace:
I20260709 13:01:43.166904  3006 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.167943  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.171717  2847 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:43.172263  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9a84223e947489c829c528c860660d1"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:01:43.177855  2878 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.179153  3022 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:43.182200  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:43.184403  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 584) took 1116 ms. Trace:
W20260709 13:01:43.270593  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 88473.4us
I20260709 13:01:43.270466  1530 rpcz_store.cc:276] 0709 13:01:42.067573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.067696 (+   123us) service_pool.cc:224] Handling call
0709 13:01:42.069332 (+  1636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.846054 (+776722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.183898 (+337844us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:43.184272 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655682432}
W20260709 13:01:43.187281  2951 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.002s
I20260709 13:01:43.187114  2957 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:42.999508  2999 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:43.218448  2906 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.099218  2990 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.004324  3007 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:43.145780  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.062085  2932 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:43.193188  3024 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:43.195091  3016 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.200403  2994 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.075637  2716 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.952075  2857 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:43.216794  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.286579  2906 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.220933  1533 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:42.949554  2661 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:43.223289  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.041s	sys 0.049s
I20260709 13:01:43.276892  2999 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.257938  1531 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:01:43.164913  3021 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:01:43.231871  2836 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:43.267529  1610 raft_consensus.cc:606] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:43.256670  3020 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.271368  1576 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:43.263578  2211 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.189538  2624 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.259749  2958 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.279464  2878 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.330076  2878 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.273777  2847 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.217245  2939 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.219343  2858 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.284950  1527 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:43.273216  2957 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:43.129520  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 883) took 1163 ms. Trace:
W20260709 13:01:43.288872  2952 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.001s
I20260709 13:01:43.308652  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.262355  1532 rpcz_store.cc:276] 0709 13:01:42.139097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.146159 (+  7062us) service_pool.cc:224] Handling call
0709 13:01:43.201061 (+1054902us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b54000de654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:43.201211 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107336576}
I20260709 13:01:43.211164  2930 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.296140  3007 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:43.357334  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.358207  1601 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:43.358808  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 913) took 1103 ms. Trace:
I20260709 13:01:43.295293  3016 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.272344  3006 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.275508  2951 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:43.362649  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.313850  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.041s	sys 0.049s
I20260709 13:01:43.275529  3022 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.299923  2716 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.329339  2916 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:43.330404  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.284027  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.322232  1602 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:43.340230  1604 rpcz_store.cc:276] 0709 13:01:41.966079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.966230 (+   151us) service_pool.cc:224] Handling call
0709 13:01:41.966572 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.320716 (+354144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.129166 (+808450us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400101154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:43.129428 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812864256}
I20260709 13:01:43.374123  1531 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:43.320644  2994 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.324345  2836 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.342602  2847 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.352406  2878 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:43.353798  3010 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.730s	user 0.016s	sys 0.006s
I20260709 13:01:43.354983  2858 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.356145  1530 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:43.355813  2930 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.356921  2957 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.313689  2661 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.359148  1601 rpcz_store.cc:276] 0709 13:01:42.255220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.272981 (+ 17761us) service_pool.cc:224] Handling call
0709 13:01:43.357219 (+1084238us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54eee 0000000000375939 00007f469cfc81e0 00007f469d0910c4 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:43.358734 (+  1515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28202624}
I20260709 13:01:43.393946  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.345742  2952 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.364332  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.365883  2916 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:43.374364  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.400971  1604 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:43.361891  3016 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.380154  2744 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.389725  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.395998  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
W20260709 13:01:43.324256  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52961.1us
I20260709 13:01:43.395792  2858 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.366060  2489 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.370239  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.405601  1531 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:43.393270  2878 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.412436  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.415206  2857 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.414932  2878 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.415939  2951 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:43.417183  2878 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.417305  2211 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:43.417799  2878 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.404235  2768 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:43.406891  2858 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.419155  2768 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:43.420578  2858 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.421089  2858 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:43.421206  2768 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:43.421576  2858 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:43.423578  3006 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.426009  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.426694  2858 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:43.426975  1602 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:43.418221  2878 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.430083  2878 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.430305  2846 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.431910  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.433627  2768 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.434041  2768 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:43.434247  3012 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.794s	user 0.011s	sys 0.013s
I20260709 13:01:43.434408  2768 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.434849  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.437242  3022 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.437199  2858 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:43.437654  1605 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.396938  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.388846  2994 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.438163  2858 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:43.438838  1535 raft_consensus.cc:2368] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:43.440114  2994 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.403790  2916 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.439792  2878 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:43.441324  2988 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.441828  2988 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:43.441257  2858 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.442989  2858 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.442584  2988 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.443337  2858 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.443779  2988 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.444082  2847 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:43.399845  1527 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.448721  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.448920  2489 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.450119  1610 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:43.450973  2489 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.454582  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.455085  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.455657  1531 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:43.458705  2661 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.459301  2661 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.459621  2661 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:43.358170  3007 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:43.463551  1482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 124023us
I20260709 13:01:43.463647   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:43.464772  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.468870  1608 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:43.469434  1648 leader_election.cc:400] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:43.469836  1648 leader_election.cc:403] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.404563  2957 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.470597  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.479426  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.483474  1533 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:43.484262  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.471760  1608 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.522426  2768 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:43.441265  3025 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:43.467602  2932 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.536926  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.430145  2930 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:43.539767  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.016s
W20260709 13:01:43.551061  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.005s	sys 0.016s
W20260709 13:01:43.551713  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 800934us
I20260709 13:01:43.535903   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:43.471758  3020 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.467284  2858 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.561687  2768 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.562451  1498 leader_election.cc:400] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:43.565770  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:43.578691  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:43.589094  1607 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:43.565533  2661 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.559358  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.562376  2930 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:43.531839  2998 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.577955  2989 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.588137  3014 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.611809  2930 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.612434  3014 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:43.612991  3014 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.614426  2930 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.615118  2930 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.601207  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:43.616858  2211 raft_consensus.cc:2368] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:43.593837  2720 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:43.587383  2988 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.590591  2768 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.624755  2988 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.624931  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.624266  1433 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 4, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 4 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.626334  3029 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:43.615491  2930 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.630838  1499 leader_election.cc:400] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:43.685460  1499 leader_election.cc:403] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.645401  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.677688  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.599680  3022 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:43.687198  1608 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:43.686729  1607 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:43.710371  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.710965  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.601425  2697 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:43.723414  1608 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:43.711604  1607 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:43.726194  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.726913  1607 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:43.605930  3028 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.707477  2930 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.627198  2720 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:43.607587  3030 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.117s
W20260709 13:01:43.747802  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68849us
W20260709 13:01:43.758503  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 162839us
I20260709 13:01:43.759321  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:43.762511  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.727737  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:43.650454  2661 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.627748  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:43.733443  3028 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.677161  3020 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.785079  1607 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:43.761523  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:43.792943  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:43.760876  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.012s	sys 0.035s
I20260709 13:01:43.799861  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:43.760767  2735 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:43.807252  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:43.809056  1608 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.733848  1433 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 4, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195), no longer has a pending config: VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193), VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194), VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195), NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.810425  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.757835  2952 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:43.731086  3016 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:43.809058  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 280582us
I20260709 13:01:43.815649  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:43.818377  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 194646us
W20260709 13:01:43.801378  2990 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.001s
W20260709 13:01:43.822154  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62916.7us
I20260709 13:01:43.797586  2918 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:43.799777  3028 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.776945  2744 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:01:43.808298  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.036s
I20260709 13:01:43.830278  2624 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:43.802179  3039 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.839321  1607 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:43.850100  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:43.841162  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 898) took 1115 ms. Trace:
I20260709 13:01:43.818480  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:43.800602  2999 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.825668  3040 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.835387  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 902) took 1109 ms. Trace:
I20260709 13:01:43.821926  3031 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.851202  1603 rpcz_store.cc:276] 0709 13:01:42.725262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.131464 (+406202us) service_pool.cc:224] Handling call
0709 13:01:43.149217 (+ 17753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.149486 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:43.475294 (+325808us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.840832 (+365538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.840881 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.840918 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.840991 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.841112 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128617,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":1125,"thread_start_us":679989,"threads_started":2}
W20260709 13:01:43.858839  2997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.510s	user 0.009s	sys 0.041s
I20260709 13:01:43.854969  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 894) took 1130 ms. Trace:
I20260709 13:01:43.858287  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:43.815048  2735 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.838762  3039 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.845420  2932 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.844997  2858 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:43.867410  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.825162  2990 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.861719  1605 rpcz_store.cc:276] 0709 13:01:42.726314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.439405 (+713091us) service_pool.cc:224] Handling call
0709 13:01:43.439633 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.439797 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:43.443782 (+  3985us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.835057 (+391275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.835113 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.835158 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.835221 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.835333 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3564,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3772,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4893,"thread_start_us":388915,"threads_started":1}
I20260709 13:01:43.866463  1606 rpcz_store.cc:276] 0709 13:01:42.724268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.116389 (+392121us) service_pool.cc:224] Handling call
0709 13:01:43.442819 (+326430us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:43.443006 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.443183 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:43.534937 (+ 91754us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.854661 (+319724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.854710 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:43.854748 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.854810 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.854919 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29338,"prepare.queue_time_us":92012,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":3500,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6994,"spinlock_wait_cycles":50757504,"thread_start_us":319335,"threads_started":1}
W20260709 13:01:43.863732  3001 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.010s	sys 0.019s
W20260709 13:01:43.863562  2997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.515s	user 0.009s	sys 0.041s
I20260709 13:01:43.865792  1602 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.878947  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:43.888731  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161547us
W20260709 13:01:43.900964  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 139511us
W20260709 13:01:43.891436  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.865887  2939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.013s	sys 0.007s
W20260709 13:01:43.888098  3001 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.011s	sys 0.019s
I20260709 13:01:43.881384  1530 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:43.907338  1603 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:43.831828  2720 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.870339  3039 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:43.920171  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.926455  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:43.834086  2918 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.949302  2918 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:43.901646  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.951630  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:43.952795  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:43.953271  2918 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.930023  1684 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:43.922995  1679 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.890982  2932 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.911375  2939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.014s	sys 0.007s
W20260709 13:01:43.943388  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.975294  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:43.975723  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.923101  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:43.945474  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:43.941704  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:43.954739  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet b748cae74bbb4bdc9765bc293b0b6702: Illegal state: Replica f9fb126997be4ec79f8f60fcd6764b00 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:43.955556  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:43.917179  3030 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:43.985061  3030 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:43.985502  3030 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.868137  3040 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:43.900486  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:43.978024  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.976157  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:43.881188  2836 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:43.944196  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97978.5us
I20260709 13:01:43.992512  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:43.976866  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:43.977442  2958 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 13:01:43.987725  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:43.917742  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 589) took 1845 ms. Trace:
I20260709 13:01:43.923312  2858 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:01:43.974613  2918 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.995930  1679 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:43.977475  3006 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:43.999454  1676 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:43.996650  1605 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:44.006453  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:43.995764  3036 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:01:43.999934  1528 rpcz_store.cc:276] 0709 13:01:42.072551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.086111 (+ 13560us) service_pool.cc:224] Handling call
0709 13:01:42.359346 (+273235us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:42.370041 (+ 10695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.370285 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:42.425130 (+ 54845us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.196139 (+771009us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b180009e080. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:01:43.873789 (+677650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.876801 (+  3012us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:43.890716 (+ 13915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.899252 (+  8536us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.913740 (+ 14488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11944,"prepare.queue_time_us":40189,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":10171,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3286,"spinlock_wait_cycles":11792512,"thread_start_us":635352,"threads_started":1,"wal-append.queue_time_us":1467981}
W20260709 13:01:44.037510  3043 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:01:44.038600  3055 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:01:44.039366  3045 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:44.040383  3006 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:43.978905  2932 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.044258  2990 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:44.045545  3058 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:01:44.046119  3042 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:01:44.048987  2999 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.050709  2989 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:44.052124  2735 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.005591  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.053130  2998 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.053843  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.055080  2857 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.056116  2869 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.060006  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.065204  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.067520  1683 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:44.068120  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.079147  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.102191  2878 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.102344  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.106436  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.116724  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.173463  2932 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.174122  1675 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.175426  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.176149  3016 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.155431  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.123301  3064 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.137102  2988 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.138350  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.139794  3060 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.177688  3060 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.178213  3060 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.178333  3006 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:44.115808  2836 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.004725  2958 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.165948  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:44.141481  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 197059us
I20260709 13:01:44.149233  1608 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:44.156788  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.157315  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.161957  1684 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.154251  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 818) took 1496 ms. Trace:
I20260709 13:01:44.186820  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.186229  1534 rpcz_store.cc:276] 0709 13:01:42.658164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.195487 (+537323us) service_pool.cc:224] Handling call
0709 13:01:43.195722 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.319449 (+123727us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:43.331150 (+ 11701us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.801926 (+470776us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.830834 (+ 28908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.830887 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:43.830927 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.153924 (+322997us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540032f5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:44.153993 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.154182 (+   189us) inbound_call.cc:177] Queueing success response
0709 13:01:44.157490 (+  3308us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b4800002958. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
Metrics: {"mutex_wait_us":122633,"prepare.queue_time_us":866768,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":137065,"raft.run_cpu_time_us":2375,"raft.run_wall_time_us":337272,"spinlock_wait_cycles":298740352,"thread_start_us":375999,"threads_started":1,"wal-append.queue_time_us":527860}
W20260709 13:01:44.188179  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 188857us
I20260709 13:01:44.188285  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.188932  1684 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:44.165683  2878 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:44.162869  1679 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.173142  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.152112  2918 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.118476  3061 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.181710  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.211244  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.212076  1530 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 1.
I20260709 13:01:44.213575  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.214243  1530 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.182075  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.152621  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.216066  1681 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:44.156939  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.217108  1531 raft_consensus.cc:2410] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:44.146968  2989 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.222005  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.223529  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.186311  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 144) took 8159 ms. Trace:
I20260709 13:01:44.206070  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.207877  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:44.208724  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.209326  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:44.218688  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.177819  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.235052  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.236933  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.237555  1684 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:44.238368  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.238937  1684 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:44.240470  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.241271  1531 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:44.242204  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.243429  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.242249  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:44.155526  2857 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:44.155656  2869 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:44.258841  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:44.265019  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.158025  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.255980  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:44.274474  1679 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:44.207216  3062 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:44.267742  1684 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:44.284822  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.282835  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.282091  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:44.286036  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.286463  1531 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.235453  2999 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:44.297188  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 115181us
I20260709 13:01:44.288637  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.297972  1684 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
W20260709 13:01:44.254793  2916 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.011s
W20260709 13:01:44.295851  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.219660  2836 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:44.298034  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.303434  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.159413  3028 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.294636  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.251725  3007 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:44.253666  2735 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:44.330417  1684 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:44.253942  3034 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.353441  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.350827  2836 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:44.302641  3080 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:01:44.349990  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46779.9us
I20260709 13:01:44.342288  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.341773  1531 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:44.349720  1530 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:44.281431  2939 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.292469  1527 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.329972  3064 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:44.360683  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.302803  3013 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.380430  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:44.375502  1676 raft_consensus.cc:2368] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
W20260709 13:01:44.381991  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.341693  3073 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.350425  3007 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:44.414815  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 72658.8us
I20260709 13:01:44.236809  3061 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.329602  3068 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:44.341581  2990 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:44.427146  1608 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.359581  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.422030  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.359980  3040 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.371788  3051 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.304194  2878 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.434989  3007 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:44.373279  2735 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:44.226490  1430 rpcz_store.cc:276] 0709 13:01:36.026454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.063170 (+ 36716us) service_pool.cc:224] Handling call
0709 13:01:44.186249 (+8123079us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:40.308528 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:40.343444 (+ 34916us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:40.343491 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:01:40.343517 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:40.344584 (+  1067us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:40.344634 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:40.344663 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:40.345479 (+   816us) tablet.cc:701] Row locks acquired
0709 13:01:40.345520 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:01:40.345663 (+   143us) write_op.cc:270] Start()
0709 13:01:40.345790 (+   127us) write_op.cc:276] Timestamp: P: 1783602100345615 usec, L: 0
0709 13:01:40.345812 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:40.346456 (+   644us) log.cc:844] Serialized 4280 byte log entry
0709 13:01:41.813151 (+1466695us) op_driver.cc:464] REPLICATION: finished
0709 13:01:42.020096 (+206945us) write_op.cc:301] APPLY: starting
0709 13:01:42.029597 (+  9501us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:42.071612 (+ 42015us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:42.077790 (+  6178us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:42.078910 (+  1120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:42.079252 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:01:42.079313 (+    61us) write_op.cc:312] APPLY: finished
0709 13:01:42.079614 (+   301us) log.cc:844] Serialized 76 byte log entry
0709 13:01:42.079793 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.079933 (+   140us) write_op.cc:454] Released schema lock
0709 13:01:42.079978 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:42.081148 (+  1170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.081174 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":855578,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":158852,"apply.run_cpu_time_us":3425,"apply.run_wall_time_us":92482,"mutex_wait_us":3169,"num_ops":10,"prepare.queue_time_us":50680,"prepare.run_cpu_time_us":4103,"prepare.run_wall_time_us":49663,"replication_time_us":1465047,"thread_start_us":57076,"threads_started":1}]]}
I20260709 13:01:44.439955  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.417289  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.350268  2916 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.299530  3062 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.457428  1684 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:44.387573  2939 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.452639  3064 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.459491  3001 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.465145  3001 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.465471  2939 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.455365  1528 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.467357  3001 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:44.469071  2661 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.009s
W20260709 13:01:44.460179  2957 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.988s	user 0.019s	sys 0.000s
W20260709 13:01:44.470660  2871 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.228s	user 0.010s	sys 0.011s
I20260709 13:01:44.470742  1607 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:44.471256  1607 pending_rounds.cc:85] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:44.462505  2735 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.471598  1607 pending_rounds.cc:107] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:44.472502  1681 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:44.415586  3013 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.442883  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.371579  3034 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.471190  2871 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.471890  1607 raft_consensus.cc:2889] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.473152  1609 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:44.445969  2990 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.481936  1531 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:44.474020  2716 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.075s	user 0.008s	sys 0.010s
W20260709 13:01:44.455718  3014 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.842s	user 0.024s	sys 0.025s
I20260709 13:01:44.482801  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:44.458490  2768 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.006s
I20260709 13:01:44.487530  1608 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:44.373745  2857 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:44.474727  2725 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.192s	user 0.002s	sys 0.016s
I20260709 13:01:44.501816  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.532694  1531 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:44.532902  1535 raft_consensus.cc:2368] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:44.434446  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:44.534031  1607 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:44.481875  2906 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.009s
W20260709 13:01:44.482090  2846 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.044s	user 0.006s	sys 0.013s
I20260709 13:01:44.508621  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.516953  2916 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:44.520872  3030 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.007s
I20260709 13:01:44.505100  2990 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.512109  2958 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.445554  3068 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:44.534152  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 99785us
I20260709 13:01:44.542455  1530 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:44.510094  2716 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.547291  1533 raft_consensus.cc:2410] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:44.521961  2930 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.011s
I20260709 13:01:44.534610  2768 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
W20260709 13:01:44.522197  3039 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.012s
W20260709 13:01:44.584764  1602 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.672s	user 0.014s	sys 0.015s
I20260709 13:01:44.585268  1602 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:44.564935  3068 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:44.565953  3075 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:01:44.567296  3031 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.691s	user 0.002s	sys 0.012s
I20260709 13:01:44.551993  3030 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.568225  2661 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:44.571197  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.601763  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.523658  3014 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.603173  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.538766  3081 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:44.604265  3081 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.604745  3081 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.604885  3031 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:44.606945  3030 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:44.572548  3072 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:01:44.572821  2836 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.567943  1647 leader_election.cc:400] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:44.537070  2725 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.609265  1647 leader_election.cc:403] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.610761  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:44.610942  2725 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.611686  2725 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.547031  2857 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.588089  1680 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.592427  3039 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.613114  1678 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.613619  3062 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.592875  2916 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.559024  3076 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:01:44.614255  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.614542  1679 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.546299  2906 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.615727  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.622829  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.626706  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.637032  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.637892  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:44.638871  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.644779  2869 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.646571  2869 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.669369  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.651788  3028 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.622743  3062 raft_consensus.cc:2764] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:44.655750  3061 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.682256  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:44.685380  3082 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:44.686919  3039 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.686683  2918 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.595507  2930 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.684324  1682 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:44.690338  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.690882  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.653957  2878 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.654790  2716 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.691413  1678 raft_consensus.cc:2368] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:44.678257  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:44.694119  3060 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 13:01:44.694645  3060 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.695114  3081 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.614213  2989 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.697075  1682 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:44.698959  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.623149  2916 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.726224  2916 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.727322  2989 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.716521  3034 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.733139  3007 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.736346  3007 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.737143  3014 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.714476  3013 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.740337  3060 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.742280  3081 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.571676  1528 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:44.769348   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:44.773474  1528 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:44.776789  1528 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:44.572798  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.787276  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:44.795426  1535 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:44.801071  1535 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:44.797864  1610 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:44.804917  1604 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:44.801460  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 926) took 1534 ms (client timeout 1558 ms). Trace:
I20260709 13:01:44.796839  1607 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:44.805848  1609 rpcz_store.cc:269] 0709 13:01:43.266731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.283683 (+ 16952us) service_pool.cc:224] Handling call
0709 13:01:44.800928 (+1517245us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001711d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:44.801174 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544081280}
W20260709 13:01:44.817001  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 201767us
I20260709 13:01:44.818913  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:44.820438  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.821703  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 912) took 1179 ms. Trace:
I20260709 13:01:44.822595  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.825027  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.811515  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 921) took 1635 ms. Trace:
I20260709 13:01:44.833930  1604 rpcz_store.cc:276] 0709 13:01:43.176055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.533555 (+357500us) service_pool.cc:224] Handling call
0709 13:01:44.804319 (+1270764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.805407 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.811138 (+  5731us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001711d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:44.811383 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2921305472}
I20260709 13:01:44.836202  1608 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.701761  1681 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:44.838774  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.839628  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.836892  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 928) took 1525 ms. Trace:
I20260709 13:01:44.837760  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.696969  1679 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.848963  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:44.822317  1603 rpcz_store.cc:276] 0709 13:01:43.641724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.912972 (+271248us) service_pool.cc:224] Handling call
0709 13:01:44.821209 (+908237us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540024a254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:44.821420 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850384256}
I20260709 13:01:44.664196  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.840479  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:44.704015  1683 raft_consensus.cc:2368] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:44.856177  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:44.858279  1603 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.843189  1529 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:44.860338  1529 pending_rounds.cc:85] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:01:44.860673  1529 pending_rounds.cc:107] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:44.860898  1534 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:44.844434  1684 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.833917  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.862562  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.864552  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.865712  1678 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:44.865536  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:44.848143  1677 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.866811  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.860970  1529 raft_consensus.cc:2889] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.703838  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.840668  1610 rpcz_store.cc:276] 0709 13:01:43.311263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.548305 (+237042us) service_pool.cc:224] Handling call
0709 13:01:43.556353 (+  8048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.804953 (+1248600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.836575 (+ 31622us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001c7ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:44.836831 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854009600}
I20260709 13:01:44.869892  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 628) took 1020 ms. Trace:
I20260709 13:01:44.870178  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:44.870893  1682 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:44.870326  1529 rpcz_store.cc:276] 0709 13:01:43.849016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.781636 (+932620us) service_pool.cc:224] Handling call
0709 13:01:44.840135 (+ 58499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.867947 (+ 27812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.869019 (+  1072us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b54000de150. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:44.869806 (+   787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132950784}
I20260709 13:01:44.866863  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:44.885995  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:44.886883  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.889111  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:44.890177  1681 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:44.892576  2847 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:44.893842  2916 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:44.894703  2916 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:44.886019  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:44.840430  3096 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:01:44.907979  1603 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:44.917433  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47576us
I20260709 13:01:44.924153  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:44.927426  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:44.893857  2930 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:44.933063  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:44.711664  2871 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.938398  1676 raft_consensus.cc:2368] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:44.939222  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:44.942186  2836 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:44.942809  2836 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:44.943354  2836 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.944419  2661 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:44.945226  2661 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:44.946229  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49759.2us
W20260709 13:01:44.946936  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80329.4us
I20260709 13:01:44.947463  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 609) took 1087 ms. Trace:
I20260709 13:01:44.948630  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:44.948962  2958 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.950657  2989 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:44.951817  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.952243  1675 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:44.953186  3038 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.953534  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.954336  2906 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.954111  3038 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.737296  2990 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.956804  2918 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.958577  2990 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.958280  2916 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.918471  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:44.960714  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 851) took 1142 ms. Trace:
I20260709 13:01:44.955947  2987 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:44.961433  2858 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.962139  2858 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:44.962037  2987 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:44.963161  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 77401.1us
I20260709 13:01:44.964584  3064 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.964952  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:44.965075  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:44.916873  2847 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.966066  1683 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.948493  2957 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.967456  2957 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:44.967638  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:44.949007  1574 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:44.969267  1574 leader_election.cc:403] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.967922  2957 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.970460  2957 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.970796  1531 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:44.970876  2871 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:44.949568  2489 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:44.971673  2871 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.973068  2489 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:44.976166  2952 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:44.976908  2952 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.980975  2871 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.963862  2858 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.979727  2952 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:44.937757  1678 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:44.947242  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:44.994972  1683 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:44.965122  3064 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:44.996587  3064 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.998728  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:45.000279  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.017s	sys 0.020s
I20260709 13:01:44.947937  1530 rpcz_store.cc:276] 0709 13:01:43.836226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.572596 (+736370us) service_pool.cc:224] Handling call
0709 13:01:44.573020 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.573418 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.573463 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.574096 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.787723 (+213627us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.787856 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.787969 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.921436 (+133467us) raft_consensus.cc:1685] finished
0709 13:01:44.921461 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.924094 (+  2633us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1271,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":212704,"threads_started":1,"wal-append.queue_time_us":214271}
W20260709 13:01:45.000707  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.017s	sys 0.020s
I20260709 13:01:45.001520  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.002187  1530 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.951371  2989 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:44.951395  2958 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.007387  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 606) took 1171 ms. Trace:
I20260709 13:01:44.999943  1529 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:45.009321  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62284.2us
I20260709 13:01:45.005702  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:45.008950  1501 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.010s	sys 0.009s
I20260709 13:01:45.011323  3062 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.012748  3062 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.013350  3062 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.014464  3062 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.000627  2716 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.011842  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.007675  1531 rpcz_store.cc:276] 0709 13:01:43.835552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.533277 (+697725us) service_pool.cc:224] Handling call
0709 13:01:44.970458 (+437181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.971290 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.004500 (+ 33210us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54002201d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:45.007339 (+  2839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999277312}
I20260709 13:01:44.961136  1527 rpcz_store.cc:276] 0709 13:01:43.818128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.823138 (+  5010us) service_pool.cc:224] Handling call
0709 13:01:44.157878 (+334740us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:44.960602 (+802724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23012608}
W20260709 13:01:45.021490  1501 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.010s	sys 0.009s
W20260709 13:01:45.024153  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75522.8us
I20260709 13:01:45.029663  2847 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:45.031391  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45502.6us
I20260709 13:01:45.008970  2489 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.032977  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.034215  2918 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.035060  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.021683  1679 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:45.042042  1535 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.040704  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.049399  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.051440  2847 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.036388  2661 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:45.052332  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.051463  1532 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:45.053110  1529 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.054633  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.055358  2725 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:45.056232  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.016641  2716 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.035033  2918 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.040867  2990 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
W20260709 13:01:45.068162  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 100704us
W20260709 13:01:45.065163  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 793927us
I20260709 13:01:45.078814  2847 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:45.083760  2869 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:45.084663  2869 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.086661  2869 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.088904  2871 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:45.089704  2871 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.093425  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 951) took 1114 ms. Trace:
I20260709 13:01:45.093973  1679 rpcz_store.cc:276] 0709 13:01:43.979182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.073368 (+1094186us) service_pool.cc:224] Handling call
0709 13:01:45.092614 (+ 19246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.092979 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.093024 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.093113 (+    89us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.093153 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.093219 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.093337 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.097766  2716 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.102334  1526 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:45.103780  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 617) took 1265 ms. Trace:
I20260709 13:01:45.104981  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 610) took 1268 ms. Trace:
I20260709 13:01:45.089723  2989 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.105898  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 918) took 1166 ms. Trace:
I20260709 13:01:45.106251  1605 rpcz_store.cc:276] 0709 13:01:43.891493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.456295 (+564802us) service_pool.cc:224] Handling call
0709 13:01:44.459920 (+  3625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.481213 (+ 21293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.481243 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.497009 (+ 15766us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.022878 (+525869us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.037263 (+ 14385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.040198 (+  2935us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.040251 (+    53us) raft_consensus.cc:1685] finished
0709 13:01:45.040264 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.057953 (+ 17689us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23538,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9265,"thread_start_us":446212,"threads_started":1,"wal-append.queue_time_us":486372}
I20260709 13:01:45.105175  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.109330  2958 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.110231  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:45.110409  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:45.110755  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54701.2us
I20260709 13:01:45.111301  1534 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:45.111917  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:45.116286  2989 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.116772  2989 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:45.117110  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.117457  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.117761  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 950) took 1162 ms. Trace:
I20260709 13:01:45.118193  2661 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:45.118306  1683 rpcz_store.cc:276] 0709 13:01:43.955409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.010723 (+1055314us) service_pool.cc:224] Handling call
0709 13:01:45.036797 (+ 26074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.117311 (+ 80514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.117351 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.117430 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.117471 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.117563 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.117676 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:45.110257  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65453.8us
I20260709 13:01:45.118204  1527 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.122337  2661 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.117761  2878 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.127015  1680 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:45.078828  3028 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 13:01:45.130611  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.117180  2989 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.132652  3031 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.133203  3031 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:45.134217  3031 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.136787  1683 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:45.138671  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 956) took 1096 ms. Trace:
I20260709 13:01:45.138718  1530 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:45.139179  1683 rpcz_store.cc:276] 0709 13:01:44.042259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.119448 (+1077189us) service_pool.cc:224] Handling call
0709 13:01:45.119871 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.138400 (+ 18529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.138617 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.131567  2988 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:45.152743  2211 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:45.137981  3038 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.099761  1603 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
W20260709 13:01:45.156328  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44592.4us
I20260709 13:01:45.141443  1531 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:45.160585  3099 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:45.161114  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:45.142280  2939 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.222883  2939 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:45.143543  2847 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:45.224790  2847 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:45.105598  1532 rpcz_store.cc:276] 0709 13:01:43.836437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.355271 (+518834us) service_pool.cc:224] Handling call
0709 13:01:45.104799 (+749528us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54000deb54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:45.104927 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340728576}
I20260709 13:01:45.147449  2987 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.147205  3064 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.148484  2918 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.149966  2906 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.142554  2990 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:45.161717  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.162093  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 938) took 1209 ms. Trace:
I20260709 13:01:45.123649  2661 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.168974  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:45.169824  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:45.171573  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55728.4us
I20260709 13:01:45.178315  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.178915  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.178995  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.175386  2716 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:01:45.258081  1610 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.147701  1535 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:45.217411  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.220225  1527 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:45.228911  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.066658  2916 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:45.255224  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.253528  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.230849  2836 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.228538  2918 consensus_queue.cc:1243] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:45.219586  3007 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:45.104873  1526 rpcz_store.cc:276] 0709 13:01:43.838017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.411681 (+573664us) service_pool.cc:224] Handling call
0709 13:01:45.103572 (+691891us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540031a454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:45.103700 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476621696}
I20260709 13:01:45.228735  2989 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.265331  1603 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:45.265689  1683 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:45.266297  3006 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.266672  1576 leader_election.cc:400] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:45.279211  1576 leader_election.cc:403] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:45.266765  3023 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.274242  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 112677us
I20260709 13:01:45.283282  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.285697  1607 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:45.300980  1683 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:45.290210  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.261695  2957 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.281920  2987 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:45.311480  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.310525  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.316355  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:45.327008  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.253109  1677 rpcz_store.cc:276] 0709 13:01:43.952415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.866959 (+914544us) service_pool.cc:224] Handling call
0709 13:01:44.867651 (+   692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.868610 (+   959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.868654 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.883880 (+ 15226us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.928953 (+ 45073us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:44.929019 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.931422 (+  2403us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.115186 (+183764us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:45.161796 (+ 46610us) raft_consensus.cc:1685] finished
0709 13:01:45.161822 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.162020 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84729,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":183,"spinlock_wait_cycles":30528256,"thread_start_us":41055,"threads_started":1,"wal-append.queue_time_us":127339}
I20260709 13:01:45.328783  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.330711  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.331569  1677 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:45.310477  2916 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:45.340503  1605 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:45.327049  2939 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.338820  2735 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:45.343668  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.346783  1609 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.349315  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.352116  1607 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:45.353608  1608 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.356293  2735 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:45.357157  3092 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.348s	user 0.002s	sys 0.006s
I20260709 13:01:45.358944  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 948) took 1404 ms. Trace:
I20260709 13:01:45.359442  1678 rpcz_store.cc:276] 0709 13:01:43.954929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.991473 (+1036544us) service_pool.cc:224] Handling call
0709 13:01:45.005575 (+ 14102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.025959 (+ 20384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.026016 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.049414 (+ 23398us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.298361 (+248947us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:45.298431 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.298542 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.358689 (+ 60147us) raft_consensus.cc:1685] finished
0709 13:01:45.358709 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.358872 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7667,"raft.queue_time_us":20066,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":238477,"threads_started":1,"wal-append.queue_time_us":226389}
I20260709 13:01:45.362087  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.362908  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 953) took 1360 ms. Trace:
I20260709 13:01:45.363791  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 906) took 1734 ms. Trace:
I20260709 13:01:45.363929  2489 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:45.364707  2489 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.365702  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 637) took 1294 ms. Trace:
I20260709 13:01:45.286396  3023 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:45.363351  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.367264  1678 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:45.363314  1679 rpcz_store.cc:276] 0709 13:01:44.002407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.095466 (+1093059us) service_pool.cc:224] Handling call
0709 13:01:45.137320 (+ 41854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.139094 (+  1774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.139135 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.139786 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.288176 (+148390us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.288228 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.288298 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.362709 (+ 74411us) raft_consensus.cc:1685] finished
0709 13:01:45.362727 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.362855 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":527,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":147834,"threads_started":1,"wal-append.queue_time_us":205966}
I20260709 13:01:45.368909  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:45.371299  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.341445  2987 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:45.310866  3006 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.377413  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.364332  1606 rpcz_store.cc:276] 0709 13:01:43.629744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.079724 (+449980us) service_pool.cc:224] Handling call
0709 13:01:44.080187 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.080458 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.080498 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.096583 (+ 16085us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.001315 (+904732us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:45.001395 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.001504 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.356235 (+354731us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:45.363442 (+  7207us) raft_consensus.cc:1685] finished
0709 13:01:45.363465 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.363732 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37326208,"thread_start_us":840124,"threads_started":1,"wal-append.queue_time_us":862683}
I20260709 13:01:45.366101  1533 rpcz_store.cc:276] 0709 13:01:43.990904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.798681 (+807777us) service_pool.cc:224] Handling call
0709 13:01:44.799290 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.855229 (+ 55939us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:44.929512 (+ 74283us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.278789 (+349277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.278908 (+   119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.285102 (+  6194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.285272 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.285421 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94791,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":127694,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":21197,"thread_start_us":356531,"threads_started":2,"wal-append.queue_time_us":388396}
I20260709 13:01:45.383793  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.365389  2489 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.384649  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 942) took 1431 ms. Trace:
W20260709 13:01:45.390949  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.390949  3064 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.313706  3007 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:45.386504  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77192.6us
I20260709 13:01:45.393162  1682 rpcz_store.cc:276] 0709 13:01:43.953393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.872393 (+919000us) service_pool.cc:224] Handling call
0709 13:01:44.968402 (+ 96009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.984862 (+ 16460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.984896 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.986124 (+  1228us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.250084 (+263960us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:45.250146 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.250247 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.376193 (+125946us) raft_consensus.cc:1685] finished
0709 13:01:45.376222 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.384563 (+  8341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8878,"raft.queue_time_us":815,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":11661,"thread_start_us":223593,"threads_started":1,"wal-append.queue_time_us":316684}
W20260709 13:01:45.406508  3107 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:45.406605  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 962) took 1229 ms. Trace:
I20260709 13:01:45.407006  3007 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:45.407080  1682 rpcz_store.cc:276] 0709 13:01:44.177253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.405485 (+1228232us) service_pool.cc:224] Handling call
0709 13:01:45.405959 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.406253 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.406288 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.406341 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:45.406373 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.406436 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.406553 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:45.407869  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.408227  2988 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:45.409822  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.416600  1531 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.408285  2735 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.417996  1608 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:45.424216  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:45.425593  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 634) took 1071 ms. Trace:
I20260709 13:01:45.433082  1680 rpcz_store.cc:276] 0709 13:01:44.353929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.669001 (+315072us) service_pool.cc:224] Handling call
0709 13:01:45.419946 (+750945us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002e90d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:45.425527 (+  5581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887498624}
I20260709 13:01:45.434058  1678 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:45.424427  1682 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:45.429145  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.435792  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 965) took 1257 ms. Trace:
I20260709 13:01:45.436298  1682 rpcz_store.cc:276] 0709 13:01:44.178073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.410834 (+1232761us) service_pool.cc:224] Handling call
0709 13:01:45.424229 (+ 13395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.435557 (+ 11328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.435741 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.421646  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.402976  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.425438  3014 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:45.444396  2989 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.446091  3014 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:45.446594  3102 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:45.447366  3014 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.448906  3014 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.449120  3007 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:45.449379  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44268.4us
I20260709 13:01:45.449659  3007 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:45.450089  3007 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.451030  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.452404  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 627) took 1603 ms. Trace:
I20260709 13:01:45.452718  1680 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:45.453441  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 623) took 1273 ms. Trace:
I20260709 13:01:45.453816  1680 rpcz_store.cc:276] 0709 13:01:44.179670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.439671 (+1260001us) service_pool.cc:224] Handling call
0709 13:01:45.452470 (+ 12799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.453186 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.453366 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.455358  3031 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.424639  2988 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.456617  2988 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:45.457507  2847 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:45.457705  2988 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.460872  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.455844  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 629) took 1210 ms. Trace:
I20260709 13:01:45.453853  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.461794  1680 rpcz_store.cc:276] 0709 13:01:44.245469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.454679 (+1209210us) service_pool.cc:224] Handling call
0709 13:01:45.455149 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.455477 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.455510 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.455551 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.455584 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.455653 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.455765 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.387804  2939 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.427125  3006 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.435477  2836 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.472857  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.473901  1608 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.425081  3034 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:45.477044  1678 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.478375  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.478448  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.479285  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:45.479848  1606 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.481225  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.484476  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:45.486259  1603 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.486732  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.487249  3034 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.487488  1608 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.490160  3023 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.493917  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:45.497383  1531 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:45.512881  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 619) took 1299 ms. Trace:
I20260709 13:01:45.513561  1678 rpcz_store.cc:276] 0709 13:01:44.178605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.435086 (+1256481us) service_pool.cc:224] Handling call
0709 13:01:45.468299 (+ 33213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.477629 (+  9330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.477888 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:45.524580  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53985.1us
I20260709 13:01:45.466082  2906 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.527616  1682 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:01:45.528403  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 620) took 1349 ms. Trace:
I20260709 13:01:45.528892  1682 rpcz_store.cc:276] 0709 13:01:44.178878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.436853 (+1257975us) service_pool.cc:224] Handling call
0709 13:01:45.523092 (+ 86239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.528142 (+  5050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.528350 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.509759  1677 raft_consensus.cc:2368] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
W20260709 13:01:45.530740  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 79860.1us
I20260709 13:01:45.425897  2987 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.534472  1603 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:45.506661  3038 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.507496  2735 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.555209  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:01:45.556730  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102955us
I20260709 13:01:45.559746  1602 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:45.561076  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.568930  3109 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:01:45.569554  1576 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:45.570734  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.570889  3116 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:45.571431  2916 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:45.572654  2847 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:45.573429  2847 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:45.573736  2916 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.573995  2847 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.575284  1605 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:45.578981  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 42) took 1142 ms. Trace:
I20260709 13:01:45.579402  1682 rpcz_store.cc:276] 0709 13:01:44.436876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.549795 (+1112919us) service_pool.cc:224] Handling call
0709 13:01:45.567155 (+ 17360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.567417 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.567454 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.578800 (+ 11346us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:45.578826 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.578865 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.578942 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.580169  1680 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.582119  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 637) took 1164 ms. Trace:
W20260709 13:01:45.574656  3115 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:45.582613  1680 rpcz_store.cc:276] 0709 13:01:44.417630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.462658 (+1045028us) service_pool.cc:224] Handling call
0709 13:01:45.551837 (+ 89179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.581815 (+ 29978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.582038 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.533922  2957 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.530407  1601 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.583042  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 638) took 1160 ms. Trace:
I20260709 13:01:45.590111  2878 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:45.595326  2847 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.585088  2735 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:45.569561  3038 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.611642  2735 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.612780  2847 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.596710  2916 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.597625  2939 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.598383  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.599227  2989 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.601552  3007 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.452894  1528 rpcz_store.cc:276] 0709 13:01:43.848764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.778119 (+929355us) service_pool.cc:224] Handling call
0709 13:01:44.778951 (+   832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.779858 (+   907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.779948 (+    90us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.920683 (+140735us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.078328 (+157645us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.078424 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.078545 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.452107 (+373562us) raft_consensus.cc:1685] finished
0709 13:01:45.452144 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.452307 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115782,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":412,"thread_start_us":144714,"threads_started":1,"wal-append.queue_time_us":361766}
W20260709 13:01:45.533597  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43922.4us
I20260709 13:01:45.584275  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.603840  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 947) took 1649 ms. Trace:
I20260709 13:01:45.607988  1678 rpcz_store.cc:276] 0709 13:01:44.422717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.523879 (+1101162us) service_pool.cc:224] Handling call
0709 13:01:45.577393 (+ 53514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.577599 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.577635 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.582682 (+  5047us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.582728 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.582829 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.582972 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.619638  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 945) took 1665 ms. Trace:
I20260709 13:01:45.608688  2958 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.642285  2958 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.643206  2958 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.644563  2989 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.628666  1684 rpcz_store.cc:276] 0709 13:01:43.954144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.902483 (+948339us) service_pool.cc:224] Handling call
0709 13:01:44.994309 (+ 91826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.001897 (+  7588us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:45.002287 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.619162 (+616875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.619239 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.619301 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.619392 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.619561 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":345982,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"thread_start_us":259101,"threads_started":1,"wal-append.queue_time_us":306148}
I20260709 13:01:45.638331  2489 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.616582  2878 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:45.640870  3119 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:45.617218  2916 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:45.651888  3007 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.653609  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 43) took 1211 ms. Trace:
I20260709 13:01:45.654182  1677 rpcz_store.cc:276] 0709 13:01:44.442049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.606265 (+1164216us) service_pool.cc:224] Handling call
0709 13:01:45.652920 (+ 46655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.653195 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.653228 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.653293 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:45.653347 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.653414 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.653544 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:45.655926  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 57689.6us
I20260709 13:01:45.657233  1576 leader_election.cc:400] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
W20260709 13:01:45.657015  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72992.4us
I20260709 13:01:45.657095  1609 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:45.657735  1576 leader_election.cc:403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:45.662177  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.651988  2939 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.657789  3014 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:45.661326  2958 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.667939  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.668450  1684 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.668853  3007 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.669095  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 647) took 1114 ms. Trace:
I20260709 13:01:45.669284  3007 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.664192  2989 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:45.669678  3007 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.670552  1677 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.671252  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 649) took 1084 ms. Trace:
I20260709 13:01:45.671576  1677 rpcz_store.cc:276] 0709 13:01:44.587267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.655318 (+1068051us) service_pool.cc:224] Handling call
0709 13:01:45.661411 (+  6093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.670968 (+  9557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.671187 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.674624  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.675261  3038 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.675532  1528 raft_consensus.cc:2368] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:45.676566  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.676887  1677 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.677644  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 652) took 1068 ms. Trace:
I20260709 13:01:45.673235  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:45.669445  1684 rpcz_store.cc:276] 0709 13:01:44.554380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.646524 (+1092144us) service_pool.cc:224] Handling call
0709 13:01:45.667396 (+ 20872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.668828 (+  1432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.669040 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.675555  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.667397  3014 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:45.661026  2988 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.681705  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.683137  2858 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.685771  1527 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:45.677973  1677 rpcz_store.cc:276] 0709 13:01:44.608887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.672466 (+1063579us) service_pool.cc:224] Handling call
0709 13:01:45.676545 (+  4079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.677333 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.677564 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.688464  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.689118  1531 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:45.694231  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.695041  1526 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:45.680992  3014 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.696677  1535 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:45.699059  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.700624  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.689101  3034 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.691640  2989 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.696177  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.705562  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50938 (request call id 2) took 1447 ms. Trace:
I20260709 13:01:45.706240  1528 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:45.706151  1684 rpcz_store.cc:276] 0709 13:01:44.258437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.682123 (+1423686us) service_pool.cc:224] Handling call
0709 13:01:45.705411 (+ 23288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.700307  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.689566  2916 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.705633  1431 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 1 to 3, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.688639  2988 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.711316  2988 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.703729  2989 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:45.712332  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.712821  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.714381  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.715485  1530 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:45.715559  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.716706  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.708258  2916 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.717996  2857 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.712924  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.725935  1602 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:45.718108  3123 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.727393  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.727485  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.731038  2988 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.734122  2988 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:45.734357  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.735018  2988 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.735162  1602 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.716872  2489 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.736471  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.737092  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.740855  1606 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:45.744776  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.745898  1535 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.745167  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.712716  2989 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.747417  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.748379  1610 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:45.745167  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.754053  1602 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:45.754967  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.754190  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.756506  1606 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:45.756599  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.715958  3007 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:45.761718  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.762337  3132 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:45.766558  1534 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:01:45.768711  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.771608  1534 pending_rounds.cc:85] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:45.772172  1534 pending_rounds.cc:107] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:01:45.772378  1530 raft_consensus.cc:2368] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:45.772661  1534 raft_consensus.cc:2889] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:45.776989  1605 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:45.760592  3123 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.791621  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.793438  1682 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.794283  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 640) took 1340 ms. Trace:
I20260709 13:01:45.794353  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.794672  1682 rpcz_store.cc:276] 0709 13:01:44.454033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.792762 (+1338729us) service_pool.cc:224] Handling call
0709 13:01:45.793103 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.793974 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.794229 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.795219  1679 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:45.797964  2725 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.798470  2725 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.800208  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 944) took 1846 ms. Trace:
I20260709 13:01:45.800711  1681 rpcz_store.cc:276] 0709 13:01:43.953914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.891196 (+937282us) service_pool.cc:224] Handling call
0709 13:01:44.891895 (+   699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.988405 (+ 96510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.988439 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.005766 (+ 17327us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.313063 (+307297us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.350167 (+ 37104us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.799863 (+449696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.799956 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.799998 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:45.800018 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.800152 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449435,"prepare.queue_time_us":24548,"prepare.run_cpu_time_us":1973,"prepare.run_wall_time_us":2377,"raft.queue_time_us":4261,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":266,"thread_start_us":291836,"threads_started":1,"wal-append.queue_time_us":402662}
I20260709 13:01:45.803018  2932 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:45.803987  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 425607us
I20260709 13:01:45.804711  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:45.805800  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:45.806615  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:45.807770  3064 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.808987  3030 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.809244  3064 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.809551  3030 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.809827  3064 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.810001  2871 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.810339  3062 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.810760  3046 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:45.810896  3062 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.811484  3046 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.813225  3062 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.627060  1676 rpcz_store.cc:276] 0709 13:01:43.954687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.954676 (+999989us) service_pool.cc:224] Handling call
0709 13:01:44.955128 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.955741 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:44.960954 (+  5213us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.261151 (+300197us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.603269 (+342118us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b18002f00e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:01:45.603446 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.603498 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.603563 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.603630 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.603771 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":362155,"prepare.queue_time_us":4415,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":373005,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":25704448,"thread_start_us":286296,"threads_started":1,"wal-append.queue_time_us":327339}
I20260709 13:01:45.779561  3123 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:45.825394  3123 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.816092  2489 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:01:45.824322  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.824417  2847 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:45.818629  2939 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:45.810527  3030 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.826707  1606 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.807422  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:45.822397  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.810014  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.826393  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:45.836784  3073 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.837349  3073 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.838841  1683 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:45.839394  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 642) took 1358 ms. Trace:
I20260709 13:01:45.821739  3014 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.824467  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.836467  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.839605  3073 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.839802  1680 rpcz_store.cc:276] 0709 13:01:44.480912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.585421 (+1104509us) service_pool.cc:224] Handling call
0709 13:01:45.602982 (+ 17561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.603312 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:45.603661 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.839041 (+235380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.839095 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.839132 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.839195 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.839308 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215398,"prepare.queue_time_us":1066,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6016,"raft.queue_time_us":216700,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":19426,"threads_started":1,"wal-append.queue_time_us":26916}
I20260709 13:01:45.842481  1681 raft_consensus.cc:2376] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4. Re-sending same reply.
I20260709 13:01:45.849923  1606 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:45.814045  3051 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:45.854712  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.857967  1605 raft_consensus.cc:2368] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:45.859818  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.813755  3062 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.813741  3046 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:45.862550  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.862457  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.863338  1684 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.864194  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.865316  1679 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:45.808058  2661 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.841357  3014 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.815101  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 961) took 1638 ms. Trace:
I20260709 13:01:45.830325  3116 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:45.866758  1535 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:45.818962  1601 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:45.810808  3064 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.907897  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.908812  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:45.899384  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77108.5us
I20260709 13:01:45.916707  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.869575  2735 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.857194  3051 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:45.928452  1679 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:45.867350  2988 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:45.910564  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 103247us
I20260709 13:01:45.953864  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.963078  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:45.956763  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:45.973850  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:45.958218  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.938699  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.982897  1683 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.965821  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:45.941685  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131752us
I20260709 13:01:45.961977  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:45.984326  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:45.982791  1527 raft_consensus.cc:2376] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4. Re-sending same reply.
I20260709 13:01:45.942020  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:45.966557  1501 leader_election.cc:400] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
W20260709 13:01:45.880847  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56457.7us
I20260709 13:01:45.878146  3116 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:45.949241  1679 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:45.988333  1501 leader_election.cc:403] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:45.906461  2725 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:45.728734   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:45.919978  3083 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:45.987838  1531 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:45.925591  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:45.941962  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.023247  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:45.911123  2489 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:01:45.917090  2990 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:01:45.917325  3006 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:01:45.972448  3007 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:45.881481  3062 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.928157  3073 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.953019  3051 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.928076  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:45.960557  2735 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:46.022111  2932 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.944983  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 59115.3us
I20260709 13:01:46.054267  2932 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.026083  3023 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.040082  2725 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.057937  3062 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.058127  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 154) took 10418 ms. Trace:
I20260709 13:01:46.058444  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.045053  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:46.023275  1530 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:46.044426  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:46.035645  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69309us
I20260709 13:01:45.933635  2878 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:45.952404  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.026511  1684 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:46.052403  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:46.022070  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65382.3us
I20260709 13:01:46.038167  3083 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:46.064108  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 79871.8us
I20260709 13:01:46.065515  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:01:46.069171  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45999.6us
I20260709 13:01:46.071681  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.072324  1605 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:46.037878  3038 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:45.931509  2661 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.076020  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.076225  2661 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.076861  1574 leader_election.cc:400] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:46.077229  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.078169  3039 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:46.078298  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.078717  3039 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.080763  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.081423  1683 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:46.082217  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.083003  1534 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.084702  1607 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:46.084393  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.060063  2735 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.086045  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:45.916857  2906 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 13:01:46.088554  1602 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:46.036885  2988 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.063877  2918 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:46.084393  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.102924  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:46.087189  2716 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.106822  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.093600  1528 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:46.108248  1531 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:46.076062  2878 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.085193  2725 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.087543  2989 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.114535  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.100306  3006 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.132170  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:46.133093  1603 raft_consensus.cc:2368] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:46.128665  2988 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:46.133766  3038 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.133901  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:46.100764  3046 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.134507  2489 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.134081  3028 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:46.134961  2489 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.135257  3028 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.129539  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:46.136610  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 8cee4cb45f7c44278850093451991c78: Illegal state: Replica 8c6031790cc44edfba5c3964e6f27c6e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:01:46.139782  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 68728.6us
I20260709 13:01:46.140828  2988 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:46.141196  1501 leader_election.cc:400] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:46.141261  2988 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:46.141644  1501 leader_election.cc:403] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.143229  1606 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:01:46.144160  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 79419.3us
I20260709 13:01:46.144244  2987 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:46.145332  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:46.133916  3069 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.145263  3039 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.146855  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:46.143950  3122 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:46.135381  2489 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.147936  3122 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:45.877894  1675 rpcz_store.cc:276] 0709 13:01:44.176920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.125771 (+948851us) service_pool.cc:224] Handling call
0709 13:01:45.126242 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.126771 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.126810 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.127409 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.315809 (+188400us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.432550 (+116741us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.807853 (+375303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.807943 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.807987 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:45.808002 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.815045 (+  7043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394112,"prepare.queue_time_us":52405,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":384966,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":208,"thread_start_us":219613,"threads_started":2,"wal-append.queue_time_us":257892}
I20260709 13:01:46.148438  3122 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.148607  1526 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:46.149344  2932 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.149876  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.038784  3116 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.058544  1433 rpcz_store.cc:276] 0709 13:01:35.639287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.640209 (+   922us) service_pool.cc:224] Handling call
0709 13:01:46.057913 (+10417704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:44.509223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:44.676185 (+166962us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:44.680290 (+  4105us) write_op.cc:435] Acquired schema lock
0709 13:01:44.683385 (+  3095us) tablet.cc:662] Decoding operations
0709 13:01:44.711470 (+ 28085us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:44.713189 (+  1719us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:44.715627 (+  2438us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:44.728392 (+ 12765us) tablet.cc:701] Row locks acquired
0709 13:01:44.728416 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:01:44.728620 (+   204us) write_op.cc:270] Start()
0709 13:01:44.728776 (+   156us) write_op.cc:276] Timestamp: P: 1783602104728557 usec, L: 0
0709 13:01:44.728801 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:44.729710 (+   909us) log.cc:844] Serialized 924 byte log entry
0709 13:01:44.907311 (+177601us) op_driver.cc:464] REPLICATION: finished
0709 13:01:45.000081 (+ 92770us) write_op.cc:301] APPLY: starting
0709 13:01:45.000265 (+   184us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:45.000440 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:45.000592 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:45.001122 (+   530us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:45.001452 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:45.006628 (+  5176us) write_op.cc:312] APPLY: finished
0709 13:01:45.087442 (+ 80814us) log.cc:844] Serialized 28 byte log entry
0709 13:01:45.087631 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.087786 (+   155us) write_op.cc:454] Released schema lock
0709 13:01:45.087839 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:45.088480 (+   641us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.088513 (+    33us) write_op.cc:454] Released schema lock
0709 13:01:45.787731 (+699218us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b18000faa80. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4697ff6190 00007f4697fefae7 00007f4697feedd9
Metrics: {"mutex_wait_us":687725,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":92128,"apply.run_cpu_time_us":3239,"apply.run_wall_time_us":88395,"num_ops":2,"prepare.queue_time_us":300934,"prepare.run_cpu_time_us":11204,"prepare.run_wall_time_us":259022,"raft.queue_time_us":159809,"raft.run_cpu_time_us":7902,"raft.run_wall_time_us":31216,"replication_time_us":177823,"spinlock_wait_cycles":66317568,"thread_start_us":486038,"threads_started":5,"wal-append.queue_time_us":14009}]]}
I20260709 13:01:46.115962  2716 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.159373  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:46.163231  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61337.3us
I20260709 13:01:46.164861  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.113989  2918 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:46.130980  1601 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:46.155663  2836 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.170931  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:46.170254  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.192835  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.116827  2858 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:01:46.194195  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.176364  3116 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.195621  1531 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:46.200783  2878 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:46.201376  2878 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.202508  2878 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.136618  3028 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.176961  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.178632  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.179206  2988 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.209721  2988 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.215973  2906 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:46.159941  2916 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.102773  3123 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.146287  3069 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.131433  3051 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.166391  2716 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.180651  2939 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:46.180158  3062 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.161998  3006 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:01:46.254294  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 110873us
I20260709 13:01:46.142374  3083 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.252305  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:46.244848  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103814us
W20260709 13:01:46.220898  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56132.8us
I20260709 13:01:46.181561  2857 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:46.249347  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.276502  1534 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:46.246132  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:46.255234  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:46.278591  3034 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:46.279090  3034 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.279670  3034 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.279244  3152 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:46.307444  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:46.279846  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 102996us
I20260709 13:01:46.310322  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.311695  1679 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:46.318459  1498 leader_election.cc:400] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:46.319020  1498 leader_election.cc:403] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.321702  3069 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.218281  2489 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.324293  2489 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.282437  2857 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:46.233417  2916 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.328107  3038 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:46.328591  3038 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:46.179891  2918 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.335302  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.243305  3123 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.235227  3064 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:01:46.222393  2871 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
W20260709 13:01:46.338887  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 63321us
I20260709 13:01:46.339743  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.340379  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 644) took 1829 ms. Trace:
I20260709 13:01:46.340960  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.340878  1678 rpcz_store.cc:276] 0709 13:01:44.510882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.627604 (+1116722us) service_pool.cc:224] Handling call
0709 13:01:45.628007 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.840635 (+212628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.840664 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.841165 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.094935 (+253770us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.094973 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.095030 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.340095 (+245065us) raft_consensus.cc:1685] finished
0709 13:01:46.340122 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.340298 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261728,"raft.queue_time_us":224801,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":22049,"thread_start_us":253411,"threads_started":1,"wal-append.queue_time_us":378696}
I20260709 13:01:46.344273  2957 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.284857  2939 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:46.345439  2957 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.345566  2939 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.346266  2930 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.350852  3152 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:46.361102  2836 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:46.361167  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50974.9us
I20260709 13:01:46.363350  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:46.364977  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46729.2us
W20260709 13:01:46.378749  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62842.9us
I20260709 13:01:46.380565  3153 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:46.381428  3153 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:46.381750  3153 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:46.382799  3153 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.385126  3153 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.384702  1608 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:46.387492  1602 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:46.391525  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:46.395031  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:46.397461  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.398846  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:46.370491  2988 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:46.393098  2847 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:46.417929  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:46.425710  1678 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.421743  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.376428  2716 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:46.438046  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 95566.9us
I20260709 13:01:46.401330  3014 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:46.438973  1574 leader_election.cc:400] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:46.440523  1574 leader_election.cc:403] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.421053  2916 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.441645  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.448997  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.410383  2869 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:01:46.456547  1680 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:46.458174  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:46.464700  3151 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:46.461161  3073 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.464445  3154 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:46.475137  3046 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.480180  3156 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:46.480731  2725 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:46.481968  3150 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:46.452064  3039 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:01:46.484498  3039 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:46.484997  3039 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.486109  3123 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:46.461246  2489 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:01:46.489010  1677 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:46.491035  3148 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:46.492856  2918 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.493858  3154 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:46.479606  2989 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.435758  2906 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:46.492705  3152 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:46.554934  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93640.4us
I20260709 13:01:46.494293  3154 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:46.605748  1678 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:46.552162  3028 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:46.638216  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 209533us
I20260709 13:01:46.643025  3153 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:46.644965  1681 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:46.645117  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.556120  3152 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:46.647488  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62125.8us
I20260709 13:01:46.648277  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:46.640573  2661 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:46.659938  1647 leader_election.cc:400] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
W20260709 13:01:46.660730  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 253145us
I20260709 13:01:46.662461  1647 leader_election.cc:403] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.673017  3069 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:46.674839  1601 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:46.663203  2735 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:01:46.531968  3122 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.667107  3051 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:46.709849  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.649768  3046 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:46.714826  1531 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:46.715112  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.646416  3028 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.717203  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.717391  1609 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:46.714262  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.715431  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:46.764354  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.784562  2932 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:46.774987  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.773746  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.677964  2661 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.693012  2847 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:46.785322  3147 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.461s	user 0.017s	sys 0.005s
I20260709 13:01:46.775107  1604 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:46.776865  1607 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:46.711830  3154 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.703073  2906 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.782373  3122 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.803092  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:46.804553  1605 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:46.696250  2735 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.817412  1526 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:46.817734  3034 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
I20260709 13:01:46.822472  3069 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:46.885612  3034 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.885723  3069 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.824599  3028 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.827705  2932 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.841549  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:46.891286  1606 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:46.855099  1607 pending_rounds.cc:85] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
W20260709 13:01:46.873852  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 432298us
I20260709 13:01:46.891840  1607 pending_rounds.cc:107] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:46.892379  1607 raft_consensus.cc:2889] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:46.879343  3144 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.020s
I20260709 13:01:46.883713  3180 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.840435  3007 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.897660  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.880004  3159 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:01:46.913455  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:46.915900  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 140999us
I20260709 13:01:46.916602  3186 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.916802  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.918725  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.920171  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.927188  3186 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.927500  3185 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.927881  3185 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:46.927932  3186 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.928364  3185 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.934962  2661 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:46.894860  3144 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.020s
I20260709 13:01:46.890425  3051 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:46.890086  3034 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.939795  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.943781  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.950173  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.955005  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.958575  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:46.948691  2939 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.937310  3122 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.925886  3007 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.974473  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:46.976195  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.975489  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.977557  3170 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.960685  3069 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:46.961722  2489 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.963672  2916 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.984599  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.972517  3122 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:46.994781  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:46.914489  3180 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.968642  3185 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.000376  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.001051  2930 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.002806  3180 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.003131  3181 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:46.980437  3170 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.959944  3156 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:01:47.016345  2930 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.009943  2918 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.017716  2918 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.020582  2918 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:46.978914  2847 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.983363  3153 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:47.009665  3173 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.012022  3051 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:46.999930  3122 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.013157  3186 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.013648  2932 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.013772  3181 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.014498  2735 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.014848  3177 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.016954  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.011574  3007 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:47.028322  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52965.1us
I20260709 13:01:47.036195  1501 leader_election.cc:400] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4.
I20260709 13:01:47.038371  3181 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:47.039921  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81478.4us
I20260709 13:01:47.025627  3156 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:46.997146  3069 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:47.041114  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.044574  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.052520  2735 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.053639  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.054718  2735 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:47.055222  2735 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:47.057201  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.058233  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.058683  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.059860  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.055747  2735 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.060949  1677 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:01:47.068933  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 108902us
I20260709 13:01:47.043215  3156 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:47.047348  3181 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.079414  3196 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.094354  3156 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.095139  3185 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.096607  3034 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.114563  3034 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.095844  3171 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.084383  3180 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:47.079034  2989 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.095670  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.105252  3199 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:47.047868  3007 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:47.117249  3034 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.098728  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.131865  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:47.130667  3155 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.794s	user 0.003s	sys 0.015s
I20260709 13:01:47.145779  3187 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.136844  2989 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:47.149971  3156 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.129375  3199 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.153033  2857 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.154546  3199 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.117964  3180 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.157346  3186 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:47.156340  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 83614.8us
I20260709 13:01:47.131960  3191 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:47.165007  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.147498  2989 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.165745  1534 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:47.166853  1607 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.134714  2735 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.169634  1534 pending_rounds.cc:85] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:01:47.168967  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:47.170359  1534 pending_rounds.cc:107] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:47.113274  3196 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.170661  1534 raft_consensus.cc:2889] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.170674  1533 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:47.175770  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43984.1us
I20260709 13:01:47.176208  1603 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:47.179523  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.181202  1532 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.183385  1530 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:47.144462  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:01:47.186717  1602 raft_consensus.cc:606] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:47.187098  1602 raft_consensus.cc:614] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:47.188724  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.188753  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:47.194882  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.192305  1533 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:47.169385  3122 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.202913  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.170051  3191 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.187748  2939 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:01:47.191149  3038 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.190657  3069 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:47.210436  3171 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:47.211071  3191 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.210891  3069 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.211266  3171 consensus_queue.cc:1243] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:47.191007  3006 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:01:47.206609  3154 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.227104  1532 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:47.214829  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.213333  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.216382  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:47.227655  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.239559  3006 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:47.240116  3006 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.240483  3006 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.245178  2735 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.246455  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.247332  1602 raft_consensus.cc:2368] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:47.247990  3196 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.249379  1498 leader_election.cc:400] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:47.249708  1498 leader_election.cc:403] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.250228  3196 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:47.251101  3180 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.250759  3006 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.215975  3069 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.252524  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.253975  3006 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.216094  3122 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.256419  2878 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.256304  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.257745  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 688) took 1063 ms. Trace:
I20260709 13:01:47.216243  1526 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.274550  1682 rpcz_store.cc:276] 0709 13:01:46.194193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.200180 (+  5987us) service_pool.cc:224] Handling call
0709 13:01:46.253430 (+ 53250us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:46.253806 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.308335 (+ 54529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.308374 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.309246 (+   872us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.652714 (+343468us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.652771 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.652863 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.831218 (+178355us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b48000e0358. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:01:47.253724 (+422506us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b2400255458. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcafb0 00007f4697c41488 00007f4697c41be8 00007f4697c19398 00007f4697c1476a 00007f4697c13bb6
0709 13:01:47.257442 (+  3718us) raft_consensus.cc:1685] finished
0709 13:01:47.257470 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.257642 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23275,"raft.run_cpu_time_us":12384,"raft.run_wall_time_us":518493,"spinlock_wait_cycles":243788032,"thread_start_us":272617,"threads_started":1,"wal-append.queue_time_us":453854}
I20260709 13:01:47.279543  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.280993  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.281599  1682 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.281330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.283618  1677 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:47.284446  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.285097  1677 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:47.285892  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.293036  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.293708  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:47.293980  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 0246a4c90f2b48c5a3a10ad330723a67: Illegal state: Replica f9fb126997be4ec79f8f60fcd6764b00 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:47.294229  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:47.294936  1677 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.295326  1677 raft_consensus.cc:614] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:47.295419  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 681) took 1343 ms. Trace:
I20260709 13:01:47.295885  1681 rpcz_store.cc:276] 0709 13:01:45.951903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.046033 (+ 94130us) service_pool.cc:224] Handling call
0709 13:01:46.046525 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.645412 (+598887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.295125 (+649713us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540041ad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:47.295353 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375411456}
I20260709 13:01:47.297655  1681 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:47.297761  1677 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:47.298069  1681 pending_rounds.cc:85] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 2
I20260709 13:01:47.298439  1681 pending_rounds.cc:107] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:47.298739  1681 raft_consensus.cc:2889] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.299338  1677 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:47.299798  1681 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:47.301033  1681 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:47.302219  1681 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:47.302927  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:47.303404  1681 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:47.304790  3051 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.304999  1647 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.306949  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.294301  1533 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.306006  3069 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.309908  3051 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:47.312112  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:47.313277  3207 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:01:47.316254  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.316767  3046 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.317662  3046 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.316949  1604 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:47.321516  1601 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:47.322705  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 37) took 4198 ms. Trace:
I20260709 13:01:47.323138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.326272  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.328184  2939 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:47.328516  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.328771  2939 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.329957  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.330789  1601 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:47.331079  2939 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.331674  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.335008  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.335668  1610 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:47.336479  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.336376  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.339326  3051 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:47.339599  3146 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.017s	user 0.004s	sys 0.019s
I20260709 13:01:47.339110  3046 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.339783  3051 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:47.340283  3051 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.342675  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.344471  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 670) took 1370 ms. Trace:
I20260709 13:01:47.345045  1529 rpcz_store.cc:276] 0709 13:01:45.974041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.987346 (+ 13305us) service_pool.cc:224] Handling call
0709 13:01:46.022390 (+ 35044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.039963 (+ 17573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.039990 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.040540 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.168915 (+128375us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.169222 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.169289 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.338925 (+1169636us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:47.341904 (+  2979us) raft_consensus.cc:1685] finished
0709 13:01:47.341924 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.344387 (+  2463us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":114,"spinlock_wait_cycles":69881600,"thread_start_us":127320,"threads_started":1,"wal-append.queue_time_us":280808}
I20260709 13:01:47.347121  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:47.350416  1607 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:47.351581  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.355058  1610 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:47.361425  1529 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.364773  2735 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:47.365176  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:47.365474  2735 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:47.366705  2735 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.366919  3152 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.323243  1431 rpcz_store.cc:276] 0709 13:01:43.124805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.161832 (+ 37027us) service_pool.cc:224] Handling call
0709 13:01:47.322607 (+4160775us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:45.954489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:45.955182 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:45.955238 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:01:45.955270 (+    32us) tablet.cc:662] Decoding operations
0709 13:01:45.955688 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:45.955775 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:45.955803 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:45.956116 (+   313us) tablet.cc:701] Row locks acquired
0709 13:01:45.956166 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:45.956337 (+   171us) write_op.cc:270] Start()
0709 13:01:45.956511 (+   174us) write_op.cc:276] Timestamp: P: 1783602105956265 usec, L: 0
0709 13:01:45.956535 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:45.957262 (+   727us) log.cc:844] Serialized 535 byte log entry
0709 13:01:46.329663 (+372401us) op_driver.cc:464] REPLICATION: finished
0709 13:01:46.787855 (+458192us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4694f6f0ac 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f469baafef0
0709 13:01:46.945938 (+158083us) write_op.cc:301] APPLY: starting
0709 13:01:46.953094 (+  7156us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:46.970258 (+ 17164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:46.972020 (+  1762us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:47.016075 (+ 44055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:47.016254 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:47.016307 (+    53us) write_op.cc:312] APPLY: finished
0709 13:01:47.016535 (+   228us) log.cc:844] Serialized 22 byte log entry
0709 13:01:47.016720 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.016809 (+    89us) write_op.cc:454] Released schema lock
0709 13:01:47.016850 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:47.017225 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.017258 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":382786,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":596124,"apply.run_cpu_time_us":2184,"apply.run_wall_time_us":79734,"num_ops":1,"prepare.queue_time_us":238795,"prepare.run_cpu_time_us":3107,"prepare.run_wall_time_us":4616,"replication_time_us":372937,"spinlock_wait_cycles":77148416,"thread_start_us":657803,"threads_started":2}]]}
I20260709 13:01:47.363258  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8501e8317ed348cca428d77d106f937c"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:01:47.380849  3172 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.679s	user 0.004s	sys 0.000s
I20260709 13:01:47.380741  3006 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:47.392288  1533 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:47.398736  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.382709  2916 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:47.380774  1675 raft_consensus.cc:606] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:47.378345  2939 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.404402  2989 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.402873  3201 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.404222  2916 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:47.413031  2989 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:47.407820  1675 raft_consensus.cc:614] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:47.423173  1682 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:47.425112  3201 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.431941   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:47.409566  2939 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.433007  3201 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.434108  2939 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.434077  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.436290  1607 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:47.438664  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.436807   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:47.447613  2916 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.426663  3046 raft_consensus.cc:2764] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:47.450640  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:47.452643  1529 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:47.454546  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.446973  3186 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:47.464547  2916 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.473875  3006 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.469162  3186 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.485968  3186 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.489787  3030 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.490271  3030 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:47.491106  3030 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.504051  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.511700  3189 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:47.512809  3189 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:47.516103  1682 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:47.516207  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.516836  1677 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:47.525864  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.504901  3030 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.530092  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.534400  1682 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.483451  2989 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.542133  3221 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:01:47.531445  1609 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:01:47.542856  1609 pending_rounds.cc:85] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:47.542550  3152 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.543375  1609 pending_rounds.cc:107] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 13:01:47.543677  1609 raft_consensus.cc:2889] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.531589  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.545225  1677 raft_consensus.cc:2368] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:47.546245  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.546849  1677 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:47.549273  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.549568  1682 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:47.557376  1609 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:47.560640  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:47.564497  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.565701  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.543234  3220 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:47.590456  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.547281  3154 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.514657  3189 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.593271  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.598218  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.541864  3051 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.578727  2987 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.530841  3186 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.599282  3069 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.600946  3201 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:47.632337  3201 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:47.632947  3201 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.632416  3069 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.635092  3069 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.639293  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.640061  1682 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:47.641062  1681 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.641265  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.641924  1677 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:47.642228  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.627226  1684 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:47.603844  3204 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:47.603402  2878 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.593703  2871 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.645022  3204 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:47.645279  2878 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.645641  3204 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.645838  2871 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:47.647881  2878 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:47.649159  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.645540  1677 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:47.651759  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46740.8us
I20260709 13:01:47.603384  3083 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:47.657652  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.658366  1682 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.624615  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.599164  3154 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.605754  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 107894us
I20260709 13:01:47.665024  3007 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.654816  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 889) took 1534 ms (client timeout 1610 ms). Trace:
I20260709 13:01:47.692878  1682 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:47.665558  2990 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:01:47.698312  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.703078  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.704931  1682 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:47.671882  3174 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.713373  1682 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.693608  3116 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:47.662871  3083 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.698683  2987 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:01:47.729203  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73527us
W20260709 13:01:47.730260  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.731593  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.690804  3007 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.734267  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.730332  2489 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.738763  3200 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.747413  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:47.739876  3228 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:47.740593  3083 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:47.740908  3229 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:47.713989  3185 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:47.745260  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:47.720463  3174 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.737659  3154 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.706005  3236 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:01:47.764454  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:47.694237  1528 rpcz_store.cc:269] 0709 13:01:46.118405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.139363 (+ 20958us) service_pool.cc:224] Handling call
0709 13:01:46.335075 (+195712us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:47.594428 (+1259353us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b54003d2b28. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de56924 00007f469d03f227 00007f469d03eab8 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6
0709 13:01:47.652806 (+ 58378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45938176}
I20260709 13:01:47.756389  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:47.766249  3232 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:01:47.727252  3116 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.768447  3242 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:47.769426  3242 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.770215  3116 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.746425  3201 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.772372  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64412.4us
I20260709 13:01:47.773290  3201 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:47.761793  3162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.002s	sys 0.007s
I20260709 13:01:47.772701  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.763262  1682 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:47.749185  3241 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.751188  2489 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.784179  2990 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.784739  2990 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:47.785230  2489 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.785637  2990 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.785852  2489 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:01:47.786545  3219 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.304s	user 0.000s	sys 0.003s
I20260709 13:01:47.786695  2489 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:47.790151  3174 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.791082  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 893) took 1559 ms. Trace:
I20260709 13:01:47.792833  3007 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.793111  3051 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.790156  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 689) took 1595 ms. Trace:
I20260709 13:01:47.794353  1683 rpcz_store.cc:276] 0709 13:01:46.194462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.194608 (+   146us) service_pool.cc:224] Handling call
0709 13:01:46.240926 (+ 46318us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:46.241107 (+   181us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:46.285111 (+ 44004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.307776 (+ 22665us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:46.317605 (+  9829us) log.cc:844] Serialized 52 byte log entry
0709 13:01:46.593010 (+275405us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:46.593958 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.443582 (+849624us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b48000e0358. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:01:47.789775 (+346193us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b5400035554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:47.789837 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.789896 (+    59us) raft_consensus.cc:1685] finished
0709 13:01:47.789916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.790085 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":17103,"raft.run_wall_time_us":1183003,"spinlock_wait_cycles":281258112,"thread_start_us":182435,"threads_started":1,"wal-append.queue_time_us":300205}
I20260709 13:01:47.796066  1533 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.796463  3243 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:47.797907  2489 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:47.777915  3171 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:47.781792  3186 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.798415  3171 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:47.798866  3171 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.791723  1531 rpcz_store.cc:276] 0709 13:01:46.231957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.282758 (+ 50801us) service_pool.cc:224] Handling call
0709 13:01:46.353044 (+ 70286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.715232 (+362188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.790799 (+1075567us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400319f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:47.790991 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831559424}
W20260709 13:01:47.776059  3162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.003s	sys 0.008s
I20260709 13:01:47.809110  3242 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.776752  3200 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:47.815183  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 67835.5us
I20260709 13:01:47.815622  1602 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:47.816790  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.818310  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.821375  1602 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:47.825623  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 686) took 1632 ms. Trace:
I20260709 13:01:47.826297  1680 rpcz_store.cc:276] 0709 13:01:46.193429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.196087 (+  2658us) service_pool.cc:224] Handling call
0709 13:01:46.252159 (+ 56072us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:01:47.825283 (+1573124us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002ad5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:47.825493 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468129920}
I20260709 13:01:47.819352  3200 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:47.829015  3200 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.830137  3246 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.831974  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.832592  1602 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.830669  3246 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.833815  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.834400  1601 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:47.834944  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:47.836560  1609 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:47.837641  3246 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.845607  1431 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 2 to 4, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:01:47.855576  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:47.856402  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77595.5us
I20260709 13:01:47.856992  3236 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:47.857530  3236 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.857896  3236 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.859277  3156 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:47.859359  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:47.860558  2489 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.860898  2489 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.861181  2489 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:47.861232  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44562.3us
I20260709 13:01:47.862648  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:47.863890  1501 leader_election.cc:400] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:47.847548  2932 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:47.865394  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:47.876787  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.877449  1682 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.880333  3154 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.864416  3007 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:01:47.829137  3204 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.884291  1602 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:47.890182  1682 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:47.864146  3186 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.899724  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.872246  2932 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.906687  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:47.907331  1677 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.908488  2932 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.909933  3248 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:47.911348  3215 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.582s	user 0.005s	sys 0.000s
I20260709 13:01:47.912774  1680 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:47.919184  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:47.920336  1602 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:47.935209  2489 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.941710  2489 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.871415  3199 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:01:47.943629  2716 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:47.913715  3171 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.953756  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58340.8us
I20260709 13:01:47.955251  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:47.963652  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98711.2us
I20260709 13:01:47.963142  2871 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.968930  2871 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:47.970762  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.977541  1677 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:47.983990  3039 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:47.985263  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:47.990370  3245 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:47.985303  3039 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.990036  3249 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:47.992504  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:47.994563  1679 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:01:47.994956  3217 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.717s	user 0.004s	sys 0.000s
I20260709 13:01:47.996413  1676 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:48.002010  3204 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:47.991119  3038 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.979482  2990 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:01:48.006446  3171 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:48.015026  1679 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:48.014402  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:48.021678  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:48.031746  1602 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:48.032538  1602 pending_rounds.cc:85] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 1
I20260709 13:01:48.032912  1602 pending_rounds.cc:107] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:48.033269  1602 raft_consensus.cc:2889] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.031548  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:48.065810  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:48.066622  1683 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.067989  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:48.079589  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:48.093230  3149 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.767s	user 0.010s	sys 0.023s
I20260709 13:01:48.094434  3185 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.093379  3163 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.629s	user 0.000s	sys 0.012s
I20260709 13:01:48.095067  3185 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.371440  1679 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:48.096983  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 966) took 1702 ms. Trace:
I20260709 13:01:48.181905  2489 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:48.107700  1683 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:48.400799  2489 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:48.398262  1608 rpcz_store.cc:276] 0709 13:01:46.394456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.394663 (+   207us) service_pool.cc:224] Handling call
0709 13:01:46.397374 (+  2711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.397844 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.397885 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.398514 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.409545 (+ 11031us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:46.409612 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.409719 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.092441 (+1682722us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:48.096636 (+  4195us) raft_consensus.cc:1685] finished
0709 13:01:48.096659 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.096910 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9758,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9276,"spinlock_wait_cycles":12696320,"thread_start_us":10540,"threads_started":1,"wal-append.queue_time_us":62337}
I20260709 13:01:48.474844  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:48.475633  1683 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:48.356617  2725 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.519918  3249 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.533790  2725 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.534065  3249 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:48.394177  3252 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:01:48.097357  3235 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.395s	user 0.003s	sys 0.000s
I20260709 13:01:48.259265  2716 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.381534  2930 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.245597  2990 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.109563  3154 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:48.381690  3191 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.272987  3248 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.583765  1683 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 13:01:48.584275  1603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.022s	sys 0.066s
W20260709 13:01:48.604337  1603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.022s	sys 0.067s
I20260709 13:01:48.096915  3236 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:48.587105  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.014s	sys 0.020s
W20260709 13:01:48.587433  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.017s
W20260709 13:01:48.607975  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.014s	sys 0.021s
W20260709 13:01:48.608078  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.010s	sys 0.017s
I20260709 13:01:48.576937  2725 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:48.620887  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:48.622572  3154 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.599336  2990 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.591063  2930 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.583009  2716 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.628198  3236 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:48.635681  2489 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:48.611577  3248 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.639106  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:48.648350  1683 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
W20260709 13:01:48.592103  3162 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.010s	sys 0.020s
I20260709 13:01:48.608783  3191 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.681020  3156 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:48.681665  3156 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:01:48.728262  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.038s	sys 0.078s
W20260709 13:01:48.728808  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.038s	sys 0.078s
I20260709 13:01:48.682775  3156 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:48.791180  2716 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:48.794005  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:48.664629  3162 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.021s
I20260709 13:01:48.791271  3156 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.960595  2858 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.942751  2916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.028s	sys 0.085s
W20260709 13:01:48.997747  2916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.029s	sys 0.085s
I20260709 13:01:49.001724  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:49.005681  2716 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:01:49.016721  3040 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:49.017490  3040 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:49.019053  2716 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.021000  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.022596  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1018) took 1145 ms. Trace:
I20260709 13:01:49.022769  2930 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.023883  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.023021  1677 rpcz_store.cc:276] 0709 13:01:47.877213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.981373 (+104160us) service_pool.cc:224] Handling call
0709 13:01:47.981783 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.998195 (+ 16412us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:47.998528 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.729323 (+730795us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.741040 (+ 11717us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.741177 (+   137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:48.741217 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.741309 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.022394 (+281085us) raft_consensus.cc:1685] finished
0709 13:01:49.022407 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.022507 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3597,"raft.queue_time_us":25323,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":9420,"spinlock_wait_cycles":17290752,"thread_start_us":711597,"threads_started":1,"wal-append.queue_time_us":988466}
I20260709 13:01:49.024727  1602 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:49.010355  3262 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:01:49.000137  2858 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.032083  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 981) took 1833 ms. Trace:
I20260709 13:01:49.042896  3040 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:49.048442  3040 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.049208  3040 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.055547  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 717) took 1040 ms. Trace:
I20260709 13:01:49.059063  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.060348  2716 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:49.059789  1678 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:49.063912  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.051527  3185 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.056068  1681 rpcz_store.cc:276] 0709 13:01:48.014743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.791713 (+776970us) service_pool.cc:224] Handling call
0709 13:01:48.792017 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.792246 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:48.792511 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.055054 (+262543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.055123 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.055183 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.055288 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.055443 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266,"prepare.queue_time_us":156525,"prepare.run_cpu_time_us":4596,"prepare.run_wall_time_us":25395,"raft.queue_time_us":3175,"thread_start_us":261818,"threads_started":1}
I20260709 13:01:49.044516  3248 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.052702  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:49.038863  2990 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.067915  3191 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.086488  3040 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.088809  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.095595  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 718) took 1080 ms. Trace:
I20260709 13:01:49.100106  2930 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.096261  1677 rpcz_store.cc:276] 0709 13:01:48.015747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.025328 (+1009581us) service_pool.cc:224] Handling call
0709 13:01:49.025629 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.025871 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.025889 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.026258 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.078205 (+ 51947us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.081939 (+  3734us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.083618 (+  1679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.083698 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.095279 (+ 11581us) raft_consensus.cc:1685] finished
0709 13:01:49.095310 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.095499 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1383,"prepare.queue_time_us":3901,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":10184,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":9293,"thread_start_us":51591,"threads_started":1,"wal-append.queue_time_us":66424}
I20260709 13:01:49.104457  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.105603  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 715) took 1091 ms. Trace:
I20260709 13:01:49.102911  2858 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.113972  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 977) took 1932 ms. Trace:
I20260709 13:01:49.118945  1606 rpcz_store.cc:276] 0709 13:01:47.181219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.181338 (+   119us) service_pool.cc:224] Handling call
0709 13:01:47.187485 (+  6147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.212358 (+ 24873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.212392 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.212437 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.212468 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.113698 (+1901230us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400086454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:49.113751 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.113909 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56742656}
I20260709 13:01:49.114470  3191 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.120440  3191 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.100893  2930 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.123191  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 697) took 1736 ms. Trace:
I20260709 13:01:49.124696  1533 rpcz_store.cc:276] 0709 13:01:47.386801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.725219 (+338418us) service_pool.cc:224] Handling call
0709 13:01:47.748877 (+ 23658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.796507 (+ 47630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.122915 (+1326408us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:49.123080 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107972864}
I20260709 13:01:49.107203  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.118446  3156 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.130506  1677 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:49.133471  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 719) took 1116 ms. Trace:
I20260709 13:01:49.117038  1683 rpcz_store.cc:276] 0709 13:01:48.014117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.649507 (+635390us) service_pool.cc:224] Handling call
0709 13:01:48.667300 (+ 17793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.667590 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:49.033107 (+365517us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.105266 (+ 72159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.105334 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.105374 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.105431 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.105541 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70424,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":40762,"raft.queue_time_us":105,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10272,"thread_start_us":427745,"threads_started":2}
I20260709 13:01:49.134254  1678 rpcz_store.cc:276] 0709 13:01:48.017168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.065283 (+1048115us) service_pool.cc:224] Handling call
0709 13:01:49.065742 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.066011 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:49.066345 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.133088 (+ 66743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.133146 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.133190 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.133258 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.133412 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2708,"prepare.queue_time_us":153,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2105,"raft.queue_time_us":956,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":66313,"threads_started":1}
I20260709 13:01:49.128774  3191 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.141700  1678 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:49.145172  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.136715  3156 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.140707  2858 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:49.150066  2858 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.149505  2871 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.155555  3269 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.158118  3269 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.166180  3154 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.167485  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.168177  1608 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:49.163820  2858 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.171881  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.172830  1605 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:49.167258  2871 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.174803  2871 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.176942  2871 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.179052  3156 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.166870  3154 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.180757  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.183565  3154 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.187386  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 721) took 1156 ms. Trace:
I20260709 13:01:49.187914  1681 rpcz_store.cc:276] 0709 13:01:48.031176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.070024 (+1038848us) service_pool.cc:224] Handling call
0709 13:01:49.070436 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.075717 (+  5281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.075765 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.099784 (+ 24019us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.146654 (+ 46870us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.152826 (+  6172us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.163557 (+ 10731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.163678 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.187079 (+ 23401us) raft_consensus.cc:1685] finished
0709 13:01:49.187110 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.187306 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6579,"prepare.queue_time_us":3313,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":9383,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":1618,"thread_start_us":46489,"threads_started":1,"wal-append.queue_time_us":73804}
I20260709 13:01:49.206161  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 722) took 1128 ms. Trace:
I20260709 13:01:49.206717  1683 rpcz_store.cc:276] 0709 13:01:48.077586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.137643 (+1060057us) service_pool.cc:224] Handling call
0709 13:01:49.142085 (+  4442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.142398 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.142423 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.142782 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.169200 (+ 26418us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.169255 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.169346 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.205950 (+ 36604us) raft_consensus.cc:1685] finished
0709 13:01:49.205968 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.206102 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":2163,"thread_start_us":17897,"threads_started":1,"wal-append.queue_time_us":57074}
W20260709 13:01:49.187111  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.969s (SENT) [suppressed 16 similar messages]
I20260709 13:01:49.198691  2858 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.216302  2858 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:49.220744  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:49.221654  2211 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
W20260709 13:01:49.239522  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.240694  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 996) took 1898 ms. Trace:
I20260709 13:01:49.241218  1610 rpcz_store.cc:276] 0709 13:01:47.342750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.363854 (+ 21104us) service_pool.cc:224] Handling call
0709 13:01:47.389784 (+ 25930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.434488 (+ 44704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.434517 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.434997 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.469865 (+ 34868us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:47.469918 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.240197 (+1770279us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54001711d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:49.240257 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.240316 (+    59us) raft_consensus.cc:1685] finished
0709 13:01:49.240335 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.240624 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":249,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":101883264,"thread_start_us":34435,"threads_started":1,"wal-append.queue_time_us":69033,"wal-append.run_cpu_time_us":1823,"wal-append.run_wall_time_us":1015899}
I20260709 13:01:49.251456  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:49.252779  3268 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.253407  3268 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.256220  3040 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.257025  3040 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.263420  3161 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.264068  3161 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.264530  3161 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.341225  3271 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.342015  3271 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.352723  3271 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.368072  3268 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.259778  3040 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.376117  3040 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.377295  3040 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.386199  3040 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.390201  3191 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:49.408143  3191 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.409410  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1008) took 1865 ms. Trace:
I20260709 13:01:49.409829  1684 rpcz_store.cc:276] 0709 13:01:47.543933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.558692 (+ 14759us) service_pool.cc:224] Handling call
0709 13:01:47.559091 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.644683 (+ 85592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.409153 (+1764470us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b5400140ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:49.409348 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156160896}
I20260709 13:01:49.410435  3161 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:49.411087  3191 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.221668  2858 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:49.402809  3189 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.412739  3161 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:49.404968  2735 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:49.413592  2735 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.415580  2735 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:49.405890  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.419579  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:49.424165  3185 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:49.424412  3241 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.424775  3185 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.425225  3241 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.427419  3241 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.429379  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:49.430227  1531 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:01:49.432744  3266 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.452s	user 0.004s	sys 0.002s
I20260709 13:01:49.433137  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.433960  1534 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:49.429528  2930 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.436157  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.437013  1533 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:49.437227  3185 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:49.438083  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 251012us
I20260709 13:01:49.438385  1531 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:49.438911  2725 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:49.439316  2725 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:49.440429  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.441098  1602 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:49.441658  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.442732  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.443069  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.443475  1610 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:49.443702  1684 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:49.444464  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.445421  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.445978  1528 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:49.447235  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.447368  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.448405  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.448936  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:49.449111  1528 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:49.451251  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 38) took 2010 ms. Trace:
I20260709 13:01:49.451443  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.472131  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.473114  1528 raft_consensus.cc:2410] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:49.452888  3185 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.452960  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.482298  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:49.482898  1602 raft_consensus.cc:2410] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:49.483234  1683 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:49.484252  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.485725  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:49.467761  1431 rpcz_store.cc:276] 0709 13:01:47.440685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.445204 (+  4519us) service_pool.cc:224] Handling call
0709 13:01:49.451170 (+2005966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:48.003491 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:48.029983 (+ 26492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:48.030030 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:01:48.030051 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:48.070401 (+ 40350us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:48.082565 (+ 12164us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:48.086562 (+  3997us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:48.179163 (+ 92601us) tablet.cc:701] Row locks acquired
0709 13:01:48.246776 (+ 67613us) write_op.cc:260] PREPARE: finished
0709 13:01:48.404243 (+157467us) write_op.cc:270] Start()
0709 13:01:48.495870 (+ 91627us) write_op.cc:276] Timestamp: P: 1783602108361233 usec, L: 0
0709 13:01:48.524386 (+ 28516us) op_driver.cc:348] REPLICATION: starting
0709 13:01:48.616704 (+ 92318us) log.cc:844] Serialized 535 byte log entry
0709 13:01:49.176949 (+560245us) op_driver.cc:464] REPLICATION: finished
0709 13:01:49.405389 (+228440us) write_op.cc:301] APPLY: starting
0709 13:01:49.405474 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:49.405567 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:49.427831 (+ 22264us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:49.428086 (+   255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:49.428260 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:49.428312 (+    52us) write_op.cc:312] APPLY: finished
0709 13:01:49.428503 (+   191us) log.cc:844] Serialized 22 byte log entry
0709 13:01:49.429287 (+   784us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.429372 (+    85us) write_op.cc:454] Released schema lock
0709 13:01:49.429416 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:49.429772 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.429801 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":228174,"apply.run_cpu_time_us":1661,"apply.run_wall_time_us":24352,"num_ops":1,"prepare.queue_time_us":142704,"prepare.run_cpu_time_us":27187,"prepare.run_wall_time_us":1034255,"raft.queue_time_us":77574,"raft.run_cpu_time_us":8056,"raft.run_wall_time_us":237091,"replication_time_us":639783,"thread_start_us":747564,"threads_started":4,"wal-append.queue_time_us":464371}]]}
I20260709 13:01:49.482298  3185 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.490149  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.491252  3185 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.491569  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.495257  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.496084  1528 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:49.454874  2930 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.497159  2930 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.497619  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.498721  1528 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:49.456084  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:49.499974  1606 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.459247  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.501448  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.502067  1533 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:49.502928  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.461863  3241 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.503683  3241 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.464200  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:49.452162  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.473948  3191 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:49.475111  3007 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.476414  2836 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.477560  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:49.480278  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1017) took 1603 ms. Trace:
I20260709 13:01:49.464305  2725 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.506515  1534 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:49.511138  1534 pending_rounds.cc:85] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:01:49.504019  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.454521  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:49.511391  1534 pending_rounds.cc:107] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:50.103360  1534 raft_consensus.cc:2889] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:50.107215  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1012) took 2233 ms (client timeout 1556 ms). Trace:
W20260709 13:01:50.107654  1680 rpcz_store.cc:269] 0709 13:01:47.873823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.873981 (+   158us) service_pool.cc:224] Handling call
0709 13:01:50.106995 (+2233014us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400039b54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:50.107119 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27955584}
I20260709 13:01:50.108948  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.109694  1680 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:49.505672  1610 raft_consensus.cc:2410] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:49.509979  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.148125  3297 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.148250  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 638279us
I20260709 13:01:49.508922  1682 rpcz_store.cc:276] 0709 13:01:47.876972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.898861 (+ 21889us) service_pool.cc:224] Handling call
0709 13:01:47.900894 (+  2033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.901385 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:48.034777 (+133392us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.029469 (+994692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.029929 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.030051 (+   122us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.031137 (+  1086us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.042249 (+ 11112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.043552 (+  1303us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.431972 (+388420us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:49.480014 (+ 48042us) raft_consensus.cc:1685] finished
0709 13:01:49.480079 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.480221 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11317,"prepare.queue_time_us":25698,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":46441,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":12069,"spinlock_wait_cycles":13525888,"thread_start_us":1088283,"threads_started":3,"wal-append.queue_time_us":738373}
I20260709 13:01:49.522246  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.154264  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.154680  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.154909  1682 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:49.511720  2836 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.156486  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.157186  1682 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:50.157603  3297 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.157955  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.158352  2836 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.506732  2957 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:49.510140  3007 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.511601  3040 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.516640  2725 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.506598  2930 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.552500  3152 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.512202  3187 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.173496  3152 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.174220  3187 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.175711  3152 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.510262  3191 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.573982  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.176729  3187 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.577589  3269 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:49.607566  1535 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:01:49.611909  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 679) took 2448 ms. Trace:
I20260709 13:01:50.178563  3191 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.178884  1526 rpcz_store.cc:276] 0709 13:01:47.163113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.164374 (+  1261us) service_pool.cc:224] Handling call
0709 13:01:47.183093 (+ 18719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.282695 (+ 99602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.611572 (+2328877us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000f7154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:49.611811 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72979328}
I20260709 13:01:50.179597  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.180374  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.181406  3290 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.182183  1526 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:50.181986  3290 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.183552  1526 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:49.678566  3250 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.184306  3250 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.185736  3290 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.186452  3250 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.682873  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 712) took 1680 ms. Trace:
I20260709 13:01:49.715112  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.187181  1679 rpcz_store.cc:276] 0709 13:01:48.002480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.078968 (+ 76488us) service_pool.cc:224] Handling call
0709 13:01:49.682680 (+1603712us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003cc8d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:49.682803 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667771648}
I20260709 13:01:49.731161  3198 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.188527  1602 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:50.188352  3198 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.731424  3289 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.190889  3198 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.191316  3289 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.193586  3289 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.731725  2987 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.738721  2990 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.194864  2987 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:49.741719  3189 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.196396  3189 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.196481  1431 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 4 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.197309  2987 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.177837  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:49.752296  3240 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.762951  2988 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.769134  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.776155  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.892s	user 0.012s	sys 0.021s
W20260709 13:01:50.200173  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.316s	user 0.012s	sys 0.021s
W20260709 13:01:50.201653  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.912446  3177 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.943123  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.041136  1603 rpcz_store.cc:276] 0709 13:01:47.198256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.198443 (+   187us) service_pool.cc:224] Handling call
0709 13:01:47.974946 (+776503us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:47.975148 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.975370 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:48.607314 (+631944us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.031521 (+424207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.031602 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.031679 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.031778 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.031949 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119152,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":250,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3564,"spinlock_wait_cycles":11769088,"thread_start_us":1049575,"threads_started":2}
I20260709 13:01:49.982661  3165 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:49.989917  3260 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:49.991163   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:50.005288  3293 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.206984  3293 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:50.013504  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 124229us
I20260709 13:01:50.206692  3250 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.208572  3250 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.207975  2988 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.019841  3039 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:50.021976  2932 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:50.038208  3295 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.038616  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.037154  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:50.051635  2989 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:50.048381  3156 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.058825  3161 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:50.061100  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.223711  2836 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:50.224663  2836 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.225009  2836 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:50.217139  3177 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.225543  3295 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.226110  2836 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.227411  2836 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.063078  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.229156  3039 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:50.229561  3039 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:50.229843  3156 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.230357  3039 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.231628  3039 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.061708  3296 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:50.064232  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.232436  3260 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.065097  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.234714  3260 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.066453  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 982) took 3008 ms. Trace:
I20260709 13:01:50.236217  1676 rpcz_store.cc:276] 0709 13:01:47.057780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.059327 (+  1547us) service_pool.cc:224] Handling call
0709 13:01:47.059649 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.996858 (+937209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.066167 (+2069309us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400030cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:50.066362 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153538816}
I20260709 13:01:50.205592  3240 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:50.067708  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.081318  3299 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:50.077644  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:50.241523  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 163940us
I20260709 13:01:50.242084  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.242187  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.084460  2939 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:50.087720  3241 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.110631  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.243330  3299 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:50.243698  3191 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.125871  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 681) took 2962 ms. Trace:
I20260709 13:01:50.118813  3249 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.127869  3006 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.244829  3006 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.245172  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:50.246137  3156 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.227842  3295 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.244248  2939 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:01:50.133244  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 92832.9us
I20260709 13:01:50.244328  3191 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.519582  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.204586  3189 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.149206  2857 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.227844  3177 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.244349  1527 rpcz_store.cc:276] 0709 13:01:47.163564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.163667 (+   103us) service_pool.cc:224] Handling call
0709 13:01:47.168498 (+  4831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.168831 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.168855 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.178267 (+  9412us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.261413 (+ 83146us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.286506 (+ 25093us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.288849 (+  2343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.288919 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.334396 (+ 45477us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b18002b5820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:01:48.077963 (+743567us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18002b5820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1
0709 13:01:50.123400 (+2045437us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b18002b5820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:01:50.125657 (+  2257us) raft_consensus.cc:1685] finished
0709 13:01:50.125676 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.125809 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20544,"prepare.run_cpu_time_us":2785,"prepare.run_wall_time_us":4726,"raft.queue_time_us":5773,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3203,"spinlock_wait_cycles":67069056,"thread_start_us":68263,"threads_started":1,"wal-append.queue_time_us":114830}
I20260709 13:01:50.251091  1532 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:50.152587  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.256448  1678 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.256847  2988 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:49.500006  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.259908  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.260632  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.159224  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.262300  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.262827  1682 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:50.260651  1607 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.264719  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.249171  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.265447  1607 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 2: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:50.266021  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.266454  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.162936  3007 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.266703  1604 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.266578  3260 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:50.262310  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.176365  1530 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:50.268266  3260 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:50.265470  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.269037  3260 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:50.198619  1529 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:50.188371  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.198691  1431 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.217120  3165 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.199332  1535 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:50.195457  2990 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.271297  3260 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.249866  1533 raft_consensus.cc:2368] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:50.273319  2990 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.217119  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.271327  1431 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.274255  1610 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:50.275540  1610 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:50.218698  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.064394  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.277760  1607 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:50.277856  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
W20260709 13:01:50.083063  1606 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.006s
I20260709 13:01:50.221330  2987 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.106592  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.278743  1606 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:50.243709  1680 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:50.244012  3299 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:50.280126  1608 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:50.280421  3240 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.280470  3299 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.282001  1679 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:50.243336  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.247771  2939 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.249361  3191 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.290900  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.283918  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.291810  1608 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:50.160552  2957 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.267905  1601 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.274796  1431 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.307235  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58156.4us
I20260709 13:01:50.307934  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.276878  1610 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.224864  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.278916  2987 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.149618  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.263897  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.288869  1678 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.288724  1684 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:50.320914  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.300419  1526 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:50.301462  3293 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.330668  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.212559  3250 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.331396  3039 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.304075  1531 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:50.309736  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:50.310745  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.321431  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.333244  1608 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
W20260709 13:01:50.314699  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72671.6us
I20260709 13:01:50.333648  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.307688  1431 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.334188  1684 raft_consensus.cc:2376] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5. Re-sending same reply.
I20260709 13:01:50.335453  1679 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:50.322140  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.336519  1607 raft_consensus.cc:2410] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:50.336365  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.336637  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.303324  3165 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.337441  2930 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.337843  2930 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.321817  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.338186  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.306653  3295 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:50.338999  1678 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:50.339248  3295 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:50.339670  3295 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.324816  2957 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.322930  3007 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.340900  3007 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.341367  3007 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.341900  2957 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:50.342353  2957 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.342742  2957 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.328881  1677 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:01:50.344877  1684 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.327683  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.345832  1603 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:50.273075  3260 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.328912  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 179364us
I20260709 13:01:50.347018  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.348117  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.348537  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.338200  2930 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.344995  1677 pending_rounds.cc:85] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 3
I20260709 13:01:50.352711  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.352996  1677 pending_rounds.cc:107] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:50.320534  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.353597  1677 raft_consensus.cc:2889] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.353690  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.354533  3153 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.354996  3153 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.356431  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.357089  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.338120  2725 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.357915  2725 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.358472  2725 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.322849  1675 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.352705  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.339057  1606 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.353032  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.361346  1680 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.361828  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.362087  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.362844  1676 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:50.334807  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.363541  1683 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:50.331358  1601 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 1.
I20260709 13:01:50.357962  1677 raft_consensus.cc:2376] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6. Re-sending same reply.
I20260709 13:01:50.364778  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.364215  1431 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 4 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.365338  1679 raft_consensus.cc:2376] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7. Re-sending same reply.
I20260709 13:01:50.366086  1431 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.357504  3153 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.368700  3269 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:50.369402  3269 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.369910  3269 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.371273  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.371995  1528 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:50.291036  2939 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:50.376554  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.376901  2939 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.377691  1530 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:50.378139  2939 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.378590  2735 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:50.378935  3152 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.379690  2857 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.379320  2735 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.380147  2857 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.382125  2857 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.382249  2735 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.368891  2988 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:50.385170  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69716.2us
I20260709 13:01:50.372196  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.388510  1529 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:50.388348  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.391016  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.392760  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.367537  1431 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.396171  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 47702.7us
W20260709 13:01:50.443725  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56794.7us
I20260709 13:01:50.465947  1684 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:50.332970  3039 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:50.463011  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.389421  1530 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.463549  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.463990  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.468492  1431 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.475430  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 929) took 1006 ms. Trace:
I20260709 13:01:50.475724  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.480325  1533 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:50.314714  2932 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:50.462404  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 122380us
I20260709 13:01:50.615152  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.481443  1527 rpcz_store.cc:276] 0709 13:01:49.469194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.250871 (+781677us) service_pool.cc:224] Handling call
0709 13:01:50.251218 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.282001 (+ 30783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.282034 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.282535 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.461870 (+179335us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:50.461929 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.462055 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.474733 (+ 12678us) raft_consensus.cc:1685] finished
0709 13:01:50.474762 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.475348 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100013,"raft.queue_time_us":40551,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":178902,"threads_started":1,"wal-append.queue_time_us":190116}
I20260709 13:01:50.480255  1431 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.617565  1431 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.372350  3293 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.378438  3187 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:50.490895  1602 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.414697  2988 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.414601  3294 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.373062  2987 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.494196  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.495674  1534 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.498833  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.463644  2836 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.477146  2857 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.504345  1529 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:50.379451  3152 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.519336  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:50.440393  3181 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:01:50.486891  3296 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.487534  3297 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.525332  1535 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:50.527808  1604 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:50.537242  3006 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.507301  3165 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:01:50.539827  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.475301  3161 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:01:50.542618  3295 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:50.650930  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.550454  2932 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:50.523586  2725 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.490365  3039 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.553540  2957 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.569171  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 930) took 1099 ms. Trace:
W20260709 13:01:50.561372  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800156da0 after lost signal to thread 434
I20260709 13:01:50.668686  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.669775  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.623020  3293 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.670099  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.637809  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.486971  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:50.633940  3040 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.634222  2857 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.652340  2987 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.635789  3187 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.486562  3007 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.652972  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.664259  1532 rpcz_store.cc:276] 0709 13:01:49.469452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.251882 (+782430us) service_pool.cc:224] Handling call
0709 13:01:50.252215 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.252406 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:50.329968 (+ 77562us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.568821 (+238853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.568876 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:50.568915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.568981 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.569112 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6109,"prepare.queue_time_us":77558,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":6248,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5911,"spinlock_wait_cycles":1408,"thread_start_us":309543,"threads_started":2,"wal-append.queue_time_us":293332}
I20260709 13:01:50.687273  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.688426  1532 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.688896  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.689565  1530 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:50.689426  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.690586  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.690644  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.690896  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.691876  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.669108  2932 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.692478  1530 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.693356  2725 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.693747  1530 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:50.597476   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:50.694813  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.667770  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.635066  2988 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.672003  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 185070us
I20260709 13:01:50.632426  1531 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:50.672226  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.695992  1533 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:50.698776  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.619978  1431 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.638198  3296 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:50.699172  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.677616  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:50.680428  3309 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:01:50.673566  3293 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.647948  2836 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.699882  1431 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 4, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.651677  3297 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.707813  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.677138  3177 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.692363  1526 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:50.691727  1532 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:50.708746  1431 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.716228  1431 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.717519  1431 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.640828  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 146749us
W20260709 13:01:50.702935  1556 debug-util.cc:398] Leaking SignalData structure 0x7b080019dac0 after lost signal to thread 1467
I20260709 13:01:50.680372  3294 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.683056  2987 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.714249  1534 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:50.703505  3296 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.716795  1531 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:50.719091  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:50.634349  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 145460us
I20260709 13:01:50.656107  2930 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.709558  2725 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.694028  2932 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:50.720587  3310 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:50.720844  1431 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.696312  3152 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.723086  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.724535  3161 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.695420  3269 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.681972  2857 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.714883  1526 pending_rounds.cc:85] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:50.727666  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.732291  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.735738  1431 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 4 to 5, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.758049  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.741863  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:50.742997  1556 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0fe0 after lost signal to thread 1559
I20260709 13:01:50.718811  3040 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.726589  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.734195  2725 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:50.732728  3308 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:01:50.731966  2987 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.773054  3007 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.773902  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:50.762029  3250 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.776697  3250 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.777549  3006 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.755577  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:50.759966  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.744390  3313 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.734329  3249 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.743892  3295 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:50.789554  2957 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.746901  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.768373  1681 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:50.794891  2857 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.746444  3014 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:50.759183  1526 pending_rounds.cc:107] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:50.799125  1526 raft_consensus.cc:2889] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.762948  3191 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.799140  3014 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:50.797695  2987 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.800328  3260 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.800925  1529 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.801491  3191 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.802189  3260 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.800330  3014 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.802649  3260 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.771176  1556 debug-util.cc:398] Leaking SignalData structure 0x7b08002418e0 after lost signal to thread 1634
W20260709 13:01:50.806875  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800101340 after lost signal to thread 1635
W20260709 13:01:50.808097  1556 debug-util.cc:398] Leaking SignalData structure 0x7b080038e360 after lost signal to thread 1708
I20260709 13:01:50.807742  2857 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.808199  3191 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.808440  2987 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.771531  3187 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.772002  2836 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:50.809303  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 63074.6us
W20260709 13:01:50.809578  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800315b00 after lost signal to thread 2236
I20260709 13:01:50.810701  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.811380  2836 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.811735  2836 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:50.760283  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61215.2us
I20260709 13:01:50.811947  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.812103  2836 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.812443  3293 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.813020  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.814121  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.814273  2939 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.814525  3293 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.814718  2939 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:50.782871  1533 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:50.784605  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:50.815558  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50731.8us
I20260709 13:01:50.769697  2725 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.787160  2930 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.787375  3039 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.787189  3153 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.787600  3249 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.789803  3313 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.791103  3297 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.782574  3250 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.818608  3165 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:50.792326  3269 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:50.839186  3249 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.829591  3241 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:50.828532  3187 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:01:50.793965  2735 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.844410  2735 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:50.845345  2735 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.846544  2735 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.805913  2988 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.770056  1535 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:50.808811  3191 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.815301  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.863493  3269 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:50.863649  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48427.6us
I20260709 13:01:50.863987  3269 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.862080  3153 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:50.864315  3293 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:50.865513  3153 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.862063  2857 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:50.766050  3289 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.866850  3289 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.867278  3289 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.763964  1431 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:50.821225  2957 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.819135  1609 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:50.818372  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:50.820014  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 121296us
I20260709 13:01:50.874308  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:50.826788  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.875290  1684 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 3: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:50.827491  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.875813  1679 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.830571  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.830844  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.831656  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.835080  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.835105  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.878624  1677 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.878829  1528 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:50.836504  3313 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.815237  2939 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.821449  3040 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.857199  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.869436  1431 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.818370  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.872304  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:50.874651  2988 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:50.886837  1603 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:50.864368  3269 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.883455  1431 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 5, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.871572  3191 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.900957  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 82639.2us
I20260709 13:01:50.901803  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.896695  1608 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.893163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:50.904561  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86262.1us
I20260709 13:01:50.909636  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.905215  1607 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:50.911372  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.911574  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.904955  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:50.912536  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.913241  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.913592  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.912127  1607 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:50.914077  1684 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.914274  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:50.914718  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.915261  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.915445  1607 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.916241  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:50.917687  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.875470  3165 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:50.919654  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.920497  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:50.906039  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.907179  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.924507  1609 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.856492  2987 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:50.923730  1608 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:50.925325  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:50.922147  1680 raft_consensus.cc:606] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:50.926992  1680 raft_consensus.cc:614] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.927142  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.916811  3250 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.897573  3322 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:01:50.894553  3313 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:50.929592  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.929811  1684 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:50.882800  2930 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:01:50.863121  3260 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:50.934762  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:50.902999  2857 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.938752  1677 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:50.940128  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:50.940203  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:50.933589  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:50.941344  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.999284  1606 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.941419  1607 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:50.926662  3006 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.932600  3250 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:50.922848  3189 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.995805  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:50.937247  3295 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:50.998361  3293 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.026085  3293 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.026549  3293 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.026773  3260 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.029532  1684 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:51.002460  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62459.9us
I20260709 13:01:51.004912  1679 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:51.005370  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.031325  1609 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:51.032402  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.006286  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.033147  1607 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.009763  1606 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
W20260709 13:01:51.011976  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 78465.8us
I20260709 13:01:51.014861  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:50.926393  3152 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:01:50.998595  3014 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.039012  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:51.002269  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 105544us
I20260709 13:01:50.998806  3198 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.945585  3313 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:51.001978  3006 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:51.035184  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:51.064802  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.066397  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:50.883586  3039 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:01:51.045003  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:01:51.016734  3250 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.017524  3153 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.058087  1607 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:51.020224  2857 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.018253  3189 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.037382  3014 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:51.053150  3198 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.045998  3156 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.042640  3295 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:51.046180  3242 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.068921  3006 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.072081  2735 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.068853  3260 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.081367  3153 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.071955  3241 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.107102  3241 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:51.106877  2836 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.108137  3295 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:51.108256  3241 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.109527  3295 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.089907  3156 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.111976  3156 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.120393  3014 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.121687  2957 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.121851  3014 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.095589  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.081681  3189 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.059454  3249 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:01:51.089677  3242 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:51.097285  3260 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.122532  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.127363  3249 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.127691  3249 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:51.059429  3299 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:51.127926  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.128536  3249 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.129040  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.130023  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.104192  3153 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.130573  1681 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:51.087976  3198 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.130576  3242 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.132824  3313 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:51.126812  3260 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.053593  3165 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.093148  3335 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:51.123189  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.135937  3335 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:51.137584  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.137084  3335 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:51.138341  2957 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.138990  3335 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.106281  3297 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:51.142244  3297 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:51.143392  3297 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.095445  2735 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.145215  2735 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.138850  2957 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:51.126374  3329 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:51.148963  1681 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:51.125484  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.160164  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.162074  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.163234  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:51.164383  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 292183us
I20260709 13:01:51.173777  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.175951  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.170189  3321 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:51.178500  3296 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.179100  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:51.170089  3039 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:51.175509  2988 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.180516  3294 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.184333  2930 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:51.208699  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.209555  1678 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:51.215648  1679 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.164072  3249 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:51.199460  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.199074  3321 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.225236  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.201035  3181 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.226442  1678 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:51.239208  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.241732  3296 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:51.197069  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 133483us
I20260709 13:01:51.243405  1608 raft_consensus.cc:606] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:51.206825  2988 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:51.259353  1608 raft_consensus.cc:614] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:51.215358  2930 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:51.267550  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.203804  3294 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.198092  3161 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:51.215597  2957 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:51.215523  3320 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.244966  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.225998  3152 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:51.237684  3321 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.291603  1682 raft_consensus.cc:2368] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:51.280421  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:51.297902  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 254314us
I20260709 13:01:51.272212  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.298880  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.303239  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:51.306037  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:51.306806  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:51.308921  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 135216us
I20260709 13:01:51.309078  1648 leader_election.cc:400] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:51.309492  1648 leader_election.cc:403] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.291558  3294 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.312091  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.309616  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.255453  3296 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.313220  1682 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:51.315738  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:51.292694  3289 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.294399  3156 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.328452  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.328830  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:51.305742  2957 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:51.319325  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.321462  3205 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.349442  1501 leader_election.cc:400] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:51.350514  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:51.344158  2930 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.317767  2987 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:51.353365  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43820.7us
I20260709 13:01:51.339787  2836 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.358635  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.339435  3240 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.308611  3152 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:51.360704  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52749.4us
I20260709 13:01:51.360791  1501 leader_election.cc:403] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.351545  3296 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:51.364578  3337 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:51.365486  3156 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.353570  3241 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:51.366511  3347 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:51.358421  2725 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260709 13:01:51.320982  3007 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:51.345342  3350 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.358167  3187 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:51.365803  3343 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:51.360731  3205 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.392212  3338 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:51.392297  3205 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.360105  2939 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.363691  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.359853  3040 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.360791  3181 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:51.397687  1683 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.353415  3351 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.402223  2735 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.363179  3177 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.362825  2987 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.404359  2987 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.381382  2988 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:51.372816  3165 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.368589  3240 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.390441  3187 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.408398  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:51.410785  3187 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.410184  3352 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.384102  3242 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.413384  3242 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:51.414110  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50486.6us
I20260709 13:01:51.417039  3352 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.417977  3152 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.387218  2725 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.417064  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.421084  1679 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.421584  3320 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:51.421922  3352 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:51.422454  1676 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:51.404394  3177 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:51.410430  3165 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.424230  3165 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.424049  3177 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.424892  1678 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.425381  2939 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.425942  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.427145  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.427690  1678 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.428900  3250 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.431432  3250 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.432778  3198 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.433331  3293 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.435484  3293 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.388640  3350 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.436390  3350 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:51.394826  3344 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:51.406201  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.393782  3241 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.440845  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.422063  3320 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.405411  3191 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.448287  1679 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:51.403923  2735 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.451133  1682 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.451040  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:51.421864  2725 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:51.410547  3240 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.462999  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.464334  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.391750  3006 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.462342  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.423130  3352 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.466638  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.452522  3039 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.478315  1610 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.462832  1678 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:51.431576  3153 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.456516  3242 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.455929  3289 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.490191  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:01:51.494395  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 145156us
I20260709 13:01:51.472581  3198 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.498217  2725 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.504992  2725 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.505374  2725 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.506731  3187 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.472415  2990 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:01:51.511346  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44802.9us
I20260709 13:01:51.514199  3187 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.479488  3006 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.477824  3039 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:51.515342  3299 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:51.517652  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.535494  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.535867  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:51.537202  1681 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.522161  3039 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.463796  3296 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:51.557231  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95442.5us
W20260709 13:01:51.562837  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.583630  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:51.584477  1532 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:51.584316  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.590690  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.547037  3299 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:51.611655  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:51.521202  3260 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.605988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:51.608894  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:51.609375  3358 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:51.609494  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.610134  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:51.638484  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 171286us
I20260709 13:01:51.616781  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.595860  3313 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.619375  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.623355  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.624423  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:51.673476  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 323040us
I20260709 13:01:51.674535  1533 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:51.674471  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:51.674791  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43804.9us
I20260709 13:01:51.629568  3153 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.629627  3250 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:01:51.632746  3189 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.004s
I20260709 13:01:51.555531  3198 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:01:51.589085  3269 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.000s
I20260709 13:01:51.620812  1535 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:51.654495  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.749215  1682 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:51.617846  1528 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:51.748611  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.661572  3299 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.669471  3177 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:51.628134  2932 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.696246  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:51.834731  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.563963  3289 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:01:51.744870  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.838846  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.745780  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.747624  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.821384  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.823601  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.716807  3361 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.746405  3153 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.840587  1609 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:51.827301  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.827323  1533 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:51.756143  3313 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:51.744441  3191 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:51.829573  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.869707  1605 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:51.870826  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.841866  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.866546  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.873443  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:51.873600  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 177436us
I20260709 13:01:51.874239  1608 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:51.874354  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.875057  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:51.875602  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 132551us
I20260709 13:01:51.876219  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.876343  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:51.877949  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.877003  1676 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:51.879407  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.880113  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.880323  1608 raft_consensus.cc:2368] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:51.880990  1676 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:51.881471  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.881901  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.892958  1608 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:51.753537  3269 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.891549  1603 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:51.900617  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.892293  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:51.882787  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.834551  2932 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:51.843852  3289 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:51.906211  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:51.843937  3249 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:51.906750  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.839169  3370 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.909559  1610 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:51.976486  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.978024  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.979404  3297 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.978689  1610 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.911054  1603 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.985864  1603 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:01:51.979851  3368 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:51.843487  3177 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:51.980515  3360 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:01:51.911712  1605 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.979382  3373 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:51.893880  3345 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:51.965685  1677 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.906217  3242 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.965790  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.991878  3177 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:51.844159  3361 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:51.965623  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:51.992343  3242 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.992882  3361 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.992918  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:51.819531  3189 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:51.979230  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:51.994690  1533 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:52.027016  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.913601  3289 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:51.882617  3153 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.033447  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.882725  3350 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.036763  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.063446  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:51.917665  3363 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.056015  1602 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:01:52.056430  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 178066us
I20260709 13:01:52.061318  1610 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:52.064335  1676 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.029232  3370 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:51.960211  3249 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:52.056571  3366 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:01:52.073179  1681 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:52.077980  1683 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:52.079711  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.080704  1533 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:52.082213  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.084079  1533 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6.
I20260709 13:01:52.066694  3260 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.084865  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:52.079555  3359 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:01:52.094910  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.056865  3313 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.084550  3242 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:52.091606  3365 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 13:01:52.101517  2725 consensus_meta.cc:287] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.001s
I20260709 13:01:52.103387  3269 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.103107  2725 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:52.104417  3165 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 13:01:52.105123  3249 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.104866  3165 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.105790  2725 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.106879  3165 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.108347  1530 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.108711  3350 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:52.109110  3374 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:52.109786  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.112509  1608 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:52.099946  1610 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:52.115921  3321 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.797s	user 0.006s	sys 0.006s
I20260709 13:01:52.116581  3321 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.117686  3189 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:52.122121  2987 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.000s
W20260709 13:01:52.094951  3241 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.003s
I20260709 13:01:52.107797  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 752) took 1274 ms. Trace:
I20260709 13:01:52.067164  2932 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.126341  1677 rpcz_store.cc:276] 0709 13:01:50.833045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.998592 (+165547us) service_pool.cc:224] Handling call
0709 13:01:51.013898 (+ 15306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.991746 (+977848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.107577 (+115831us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400035054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:52.107740 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176748928}
I20260709 13:01:52.104302  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.128213  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.134547  1609 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:52.125805  3241 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:52.150782  3153 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.088454  3289 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.119673  3321 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.136252  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.150758  3386 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:52.141510  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.142835  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.144232  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.145939  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.164486  1678 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.148056  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.154139  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.136005  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.166429  1609 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:52.166244  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.156666  1676 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:52.168970  1676 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:52.161998  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.170872  1676 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:52.172835  3386 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.173328  3289 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.175588  3386 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.179958  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.142829  2957 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.180672  1527 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.180573  1678 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:52.181425  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.182057  1534 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.186239  1531 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:52.186408  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:52.129407  2987 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.190294  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.190927  2987 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.160704  3189 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:01:52.191867  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.100185  3370 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:52.192449  3205 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
I20260709 13:01:52.132854  3352 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:01:52.192512  1529 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.194550  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.197482  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.198421  1533 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:52.172598  3181 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.015s
I20260709 13:01:52.204777  1527 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:52.177822  3161 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.204932  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:52.206736  3181 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.001s	sys 0.015s
I20260709 13:01:52.192884  3205 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.208773  3187 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:52.199361  3384 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:52.210225  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.218058  1527 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.212438  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.213168  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.213706  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.215941  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.216408  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.209543  3187 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.219763  1676 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:52.220261  1610 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.225661  1602 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:52.231014  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.232887  3187 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.234380  3361 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.236214  1535 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:52.238160  3240 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.000s
I20260709 13:01:52.238761  3205 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.238651  3240 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.239568  1526 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: [6.2-6.2]
W20260709 13:01:52.244222  3320 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 13:01:52.244992  3320 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.196553  2957 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.247989  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.270162  3240 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:52.272557  3294 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.004s
I20260709 13:01:52.277498  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.200819  2725 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:52.278999  1533 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:52.274632  3039 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.005s
I20260709 13:01:52.277583  3294 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.272431  1610 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:52.275044  3161 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.281739  1684 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:52.283170  3294 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.279852  3321 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.284128  3321 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:52.285049  3321 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.286298  3321 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.276564  3361 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:52.290637  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.293068  1530 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:52.279944  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.274868  3320 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.293150  1529 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
W20260709 13:01:52.274935  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53524.9us
I20260709 13:01:52.301810  1676 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:52.302788  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.304268  1529 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.305716  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.307575  3161 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:52.314903  1676 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.315035  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:52.313777  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 127447us
W20260709 13:01:52.320677  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.320643  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.322470  1533 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.323531  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.324610  1533 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:52.328823  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:52.330186  3355 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.332077  3355 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:52.332727  3355 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:52.332880  3350 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.333632  3350 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.333967  3355 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.336484  3350 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.338213  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:52.338258  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.340462  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.342607  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.347462  1533 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:52.289495  3039 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.311863  2957 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.350899  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.327653  3289 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.326742  3384 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.347994  1533 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 1
I20260709 13:01:52.353592  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.357151  1533 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:52.357710  1533 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.359059  1533 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.359414  1533 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.344556  3382 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.346544  3165 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:52.361348  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.362141  1529 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:52.364090  1679 raft_consensus.cc:606] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.363982  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.364578  1679 raft_consensus.cc:614] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:52.366621  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.368574  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:52.369138  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet c56ae97ed5df4be18120cf680fd57f57: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:52.370431  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.344566  3198 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:01:52.371054  1676 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.344305  2987 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:01:52.373409  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.348614  3361 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:01:52.364207  3241 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.365207  3205 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.363516  2725 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:52.362859  1533 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.365839  3391 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.372658  3392 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.360435  3386 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:52.382440  3039 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.385893  1529 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:52.386432  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.384162  3240 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.403067  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1075) took 1182 ms. Trace:
I20260709 13:01:52.377502  3289 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.393370  2725 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.414981  2725 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:52.388213  1533 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.403489  1682 rpcz_store.cc:276] 0709 13:01:51.221204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.457541 (+236337us) service_pool.cc:224] Handling call
0709 13:01:51.457835 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.752086 (+294251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.402810 (+650724us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54003cb4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:52.403008 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669528960}
W20260709 13:01:52.416432  3390 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:52.383877  2990 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.417438  2990 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:52.397048  3189 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.418484  3313 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:52.418819  3189 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.419070  3313 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.419664  3189 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.420804  3189 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.421177  3313 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.418488  2990 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.422696  2990 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.394856  3152 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.404214  3198 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.429278  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.439446  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.441843  1498 leader_election.cc:400] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3.
I20260709 13:01:52.442966  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:52.445196  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.446344  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.450286  1676 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:52.460523  1681 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:52.447127  2987 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.451246  3386 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:52.447463  3289 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.427096  3240 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.438016  3293 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.456640  3152 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.461800  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.464262  1533 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:52.477655  1533 pending_rounds.cc:85] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:01:52.478045  1533 pending_rounds.cc:107] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:52.477916  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:52.478677  1533 raft_consensus.cc:2889] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.467438  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.466439  3386 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.482582  3386 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.456247  3357 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.935s	user 0.001s	sys 0.003s
I20260709 13:01:52.485435  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1074) took 1269 ms. Trace:
I20260709 13:01:52.485934  1680 rpcz_store.cc:276] 0709 13:01:51.215974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.371162 (+155188us) service_pool.cc:224] Handling call
0709 13:01:51.371422 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.388742 (+ 17320us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:51.388799 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.390452 (+  1653us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.439385 (+ 48933us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.439429 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.439499 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.455502 (+1016003us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:52.485051 (+ 29549us) raft_consensus.cc:1685] finished
0709 13:01:52.485081 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.485356 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29478,"raft.queue_time_us":18202,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5410,"spinlock_wait_cycles":19341696,"thread_start_us":48607,"threads_started":1,"wal-append.queue_time_us":87431}
W20260709 13:01:52.507130  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 57c2065ad5cf4ab19e1aabd16c64fe95: Illegal state: Replica 8c6031790cc44edfba5c3964e6f27c6e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:52.509405  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.476904  1526 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.514127  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.514055  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.516800  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.518265  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:52.512533  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.524194  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.525612  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.526279  1532 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:52.527138  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.506028  3293 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:52.500514  2987 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.500320  3165 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:52.557751  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.598290  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 64951.9us
I20260709 13:01:52.603799  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.631320  3364 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:52.513486  3289 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.513617  3152 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.521363  2725 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.521836  3355 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.532506  3187 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.637761  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.535807  3350 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:52.642133  1531 raft_consensus.cc:2368] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
W20260709 13:01:52.635231  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98448.8us
I20260709 13:01:52.633137  3165 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.649281  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.650326  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 40) took 1034 ms. Trace:
I20260709 13:01:52.652274  1531 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:52.651360  1433 rpcz_store.cc:276] 0709 13:01:51.610898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.611077 (+   179us) service_pool.cc:224] Handling call
0709 13:01:52.644283 (+1033206us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:01:52.645447 (+  1164us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0,"spinlock_wait_cycles":302663040}
I20260709 13:01:52.653828  1531 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:52.535667  3241 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:01:52.659240  3355 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:52.654757  2836 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.659236  3350 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:52.660974  3241 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.658615  1531 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:52.661695  3241 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.661073  3364 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:52.662206  3364 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:52.662052  3350 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.662734  3241 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.663184  3364 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.664279  3241 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.664774  3364 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.665684  3361 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:52.666146  3361 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.667284  2836 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:52.666970  3361 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.659579  3240 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.669967  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.656071  2987 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:52.672165  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:52.670650  3361 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.687429  1680 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.668108  2836 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.692917  2836 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.688967  3351 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:52.696453  3351 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:52.699056  3351 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:52.700341  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:52.701130  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:52.705572  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:01:52.707928  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 178249us
I20260709 13:01:52.679991  3320 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:52.656296  3386 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.712272  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.713598  3392 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.675467  2725 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:52.717531  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.718650  1532 raft_consensus.cc:2368] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:52.709069  3321 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.710078  3320 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.720935  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.724153  3409 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.727685  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.728379  1604 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:52.730903  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.732487  2735 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.732939  2735 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.733367  1607 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:52.733840  2735 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.735147  2735 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.736043  3386 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:52.738720  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.738996  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.739358  1607 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.741096  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.718319  3402 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:01:52.739933  3404 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:52.720928  3392 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.747578  1601 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:52.747797  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.748570  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:52.732512  3406 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:52.743299  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:52.745361  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.721271  3321 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:52.721956  3320 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:52.751989  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.754005  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.751937  1607 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:52.754951  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.755394  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.755754  1601 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:52.756008  1609 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.757073  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:52.759001  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:52.766050  1609 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:52.756841  3321 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.767125  3392 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:52.767555  3392 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.767894  3392 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.723538  3293 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.781032  1604 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:52.782509  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1073) took 1569 ms (client timeout 2034 ms). Trace:
W20260709 13:01:52.782999  1675 rpcz_store.cc:269] 0709 13:01:51.213118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.268519 (+ 55401us) service_pool.cc:224] Handling call
0709 13:01:52.782274 (+1513755us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54000bf4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:52.782445 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902787456}
I20260709 13:01:52.784816  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.788700  2932 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.788934  3293 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.794130  1531 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
W20260709 13:01:52.812546  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59136.7us
I20260709 13:01:52.791464  2857 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:01:52.815771  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.811582  3409 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:52.814944  3354 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.007s	sys 0.019s
W20260709 13:01:52.814309  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0820938770000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:01:52.819406  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:52.820941  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0622037580000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:01:52.821571  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0131112160000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:01:52.821935  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 961) took 1191 ms. Trace:
I20260709 13:01:52.827664  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.824891  1528 rpcz_store.cc:276] 0709 13:01:51.630376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.751761 (+121385us) service_pool.cc:224] Handling call
0709 13:01:51.752004 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.824238 (+ 72234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.824266 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.833482 (+  9216us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.088776 (+255294us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:52.103091 (+ 14315us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4800002958. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:01:52.790982 (+687891us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003e9200. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:01:52.820843 (+ 29861us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.821610 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.821702 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.821740 (+    38us) raft_consensus.cc:1685] finished
0709 13:01:52.821749 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.821881 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96228,"prepare.queue_time_us":9187,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":88105,"raft.run_cpu_time_us":3267,"raft.run_wall_time_us":261774,"spinlock_wait_cycles":52597760,"thread_start_us":227288,"threads_started":2,"wal-append.queue_time_us":306606}
I20260709 13:01:52.828177  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.830700  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:52.830942  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.831310  1682 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:52.828845  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.832273  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.832901  1528 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:52.833463  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:52.833636  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:52.834050  1682 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 6. Ops: []
I20260709 13:01:52.835870  1528 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:52.837183  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:52.837949  1528 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:52.837486  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.839749  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.840736  3409 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.835711  3289 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:01:52.829984  3354 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.008s	sys 0.020s
I20260709 13:01:52.845528  3321 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:52.849064  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1064) took 1670 ms. Trace:
I20260709 13:01:52.819322  3241 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.849583  1684 rpcz_store.cc:276] 0709 13:01:51.178632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.280105 (+101473us) service_pool.cc:224] Handling call
0709 13:01:52.848827 (+1568722us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b5400032ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:52.848989 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244593408}
I20260709 13:01:52.851764  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:52.852275  3386 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:52.830910  3240 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.818418  3410 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:01:52.854508  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 963) took 1175 ms. Trace:
I20260709 13:01:52.856089  2990 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.859242  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58454 (request call id 8) took 1422 ms. Trace:
I20260709 13:01:52.861960  1609 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.862093  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.866813  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.880229  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.880502  1601 raft_consensus.cc:2368] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:52.866994  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.881574  1610 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:52.882870  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.867704  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.884476  1608 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:52.885880  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:52.886849  1608 raft_consensus.cc:2368] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:52.864439  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:52.876561  1535 rpcz_store.cc:276] 0709 13:01:51.679039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.824762 (+145723us) service_pool.cc:224] Handling call
0709 13:01:51.838097 (+ 13335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.236604 (+398507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.854253 (+617649us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54004411d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:52.854442 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915133696}
I20260709 13:01:52.879473  1606 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:52.878381  1679 rpcz_store.cc:276] 0709 13:01:51.436524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.461293 (+ 24769us) service_pool.cc:224] Handling call
0709 13:01:52.859041 (+1397748us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698073853 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:52.859147 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984030592}
I20260709 13:01:52.889943  3321 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:01:52.891003  3412 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:52.892755  3320 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.874639  3313 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.895965  3381 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.896232  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:52.901263  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1055) took 1061 ms. Trace:
I20260709 13:01:52.930855  1603 rpcz_store.cc:276] 0709 13:01:51.839553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.996020 (+156467us) service_pool.cc:224] Handling call
0709 13:01:51.996667 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.084182 (+ 87515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.084215 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.084257 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:52.084293 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.900967 (+816674us) spinlock_profiling.cc:243] Waited 87.2 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:52.901018 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.901193 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200554240}
I20260709 13:01:52.915674  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:52.878407  3289 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:52.881366  3250 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.899534  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:01:52.967240  3156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.029s	sys 0.056s
I20260709 13:01:52.882174  3392 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.969635  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:52.970568  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 106388us
I20260709 13:01:52.978644  1647 leader_election.cc:400] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:52.979008  1647 leader_election.cc:403] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:52.945267  3181 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.969558  3156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.029s	sys 0.056s
I20260709 13:01:53.000846  1647 leader_election.cc:400] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:52.962044  3289 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:52.935459  3381 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:52.930411  3313 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:52.964498  2836 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.003891  1647 leader_election.cc:403] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:52.970160  1675 raft_consensus.cc:606] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:52.970913  3328 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:52.970372  3321 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:53.012638  3424 raft_consensus.cc:2764] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:01:53.029693  3370 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.962221  3250 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.031932  1609 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:53.032085  3250 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.032828  3313 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:01:53.004295  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143249us
I20260709 13:01:53.038113  1648 leader_election.cc:400] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:53.039212  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:53.019117  3364 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.002413  3040 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:53.022382  3356 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.519s	user 0.000s	sys 0.004s
I20260709 13:01:52.971148  2725 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:53.082865  3381 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.083518  3381 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:53.026460  3320 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.028074  3419 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:53.044404  1532 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:53.071280  1528 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:53.071802  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.088092  1528 pending_rounds.cc:85] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 3
I20260709 13:01:53.088281  1535 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.071933  3040 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.024003  3321 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:53.080641  3423 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:53.081326  3416 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:53.083845  2725 raft_consensus.cc:993] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:01:53.009227  3382 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.003279  3181 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:01:53.086724  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 101291us
I20260709 13:01:53.088377  1528 pending_rounds.cc:107] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:53.103871  1528 raft_consensus.cc:2889] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.072656  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:53.021369  2836 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.114144  3382 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:01:53.115875  2836 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.070816  3354 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.117789  3354 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:53.118201  3354 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.120484  3321 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.122033  1609 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:53.123677  3410 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:53.124087  1608 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:53.125561  3403 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 13:01:53.127269  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 760) took 1066 ms. Trace:
I20260709 13:01:53.086385  3352 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:53.127660  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:53.127414  2988 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:53.108284  3181 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:01:53.128805  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.128417  1534 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:53.129317  3156 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:53.129739  3156 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:53.130549  3364 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:53.131577  3392 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.132475  3289 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.134384  3422 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:53.135136  3422 consensus_queue.cc:1243] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:53.033385  3328 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:53.135789  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 770) took 1789 ms. Trace:
I20260709 13:01:53.136191  1681 rpcz_store.cc:276] 0709 13:01:51.346228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.078504 (+732276us) service_pool.cc:224] Handling call
0709 13:01:52.460207 (+381703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.461058 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.135587 (+674529us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54002ea4d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:53.135725 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876854528}
I20260709 13:01:53.137054  3313 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:53.137457  3313 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:53.137873  3328 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.074149  2932 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:01:53.138286  3313 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.094547  3040 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.139623  3313 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:53.141564  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69056.4us
I20260709 13:01:53.142690  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.144229  3421 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.145009  3421 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:53.127717  1530 rpcz_store.cc:276] 0709 13:01:52.061198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.109525 (+ 48327us) service_pool.cc:224] Handling call
0709 13:01:53.127110 (+1017585us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000dcd54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:53.127216 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398229760}
I20260709 13:01:53.153493  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.155388  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:53.158092  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.158967  1530 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
I20260709 13:01:53.159535  1681 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:53.161962  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.162400  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:53.106997  1535 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:53.167307  1684 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:53.171283  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:53.173249  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:53.173489  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:53.174166  1680 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:53.174789  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:53.175563  1681 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:53.160956  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.179752  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:53.181556  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 159829us
I20260709 13:01:53.182495  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:53.188519  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:53.189366  1608 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.191798  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:53.178268  3410 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.198248  3422 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.198830  3422 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:53.199604  3422 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.160305  2836 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.198328  3410 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:53.202905  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.181349  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:53.207747  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 135710us
I20260709 13:01:53.201637  3426 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.237867  1648 leader_election.cc:400] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:53.213007  3250 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.208942  3410 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.209200  3382 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.178503  3419 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:01:53.262552  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 57543.3us
I20260709 13:01:53.263864  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:53.212602  2988 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:01:53.229377  2735 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.243546  3364 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:53.130568  3156 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.213871  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:01:53.281761  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78953us
I20260709 13:01:53.282606  1608 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:53.285152  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:53.246596  3426 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.259824  3423 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:01:53.294392  1608 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:53.283350  3420 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:53.301082  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.307257  1610 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:53.308750  3433 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:53.309800  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.310461  1531 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:53.310864  3367 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.313072  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.313663  1531 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:53.289712  3328 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.317657  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.290637  3419 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:53.293295  3156 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.321239  1682 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:53.287075  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 107995us
W20260709 13:01:53.328166  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.322386  3419 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:53.329742  3392 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:53.290268  3181 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:01:53.332600  3181 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:53.332996  3181 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:53.333935  3198 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:53.334440  3198 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:53.333868  3181 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.335417  3181 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.335278  3198 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.302256  2836 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.336525  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:53.336822  2836 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.336861  3198 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.337457  2836 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.323205  3328 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:53.340381  3328 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.343384  3426 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.344856  3040 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.346261  1679 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:53.305384  3420 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:53.301995  3431 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:53.399855  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82333.7us
I20260709 13:01:53.407878  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.427024  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:53.398608  3440 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:01:53.398731  3420 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.412225  3431 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:53.423170  2930 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.487803  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43898.8us
I20260709 13:01:53.456353  3439 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.456674  3040 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.463822  3449 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:53.486630  2990 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:53.514058  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.462651  2930 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.512485  2990 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.541770  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.544776  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.508641  3424 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:01:53.555263  3443 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:53.573815  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.542906  3438 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.535041  3431 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.579604  3433 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.576357  3354 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.592016  3424 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.599761  2725 raft_consensus.cc:1081] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:01:53.620661  1680 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:53.602113  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.627527  1603 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:53.630405  1574 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6.
I20260709 13:01:53.635040  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:53.605448  3402 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:53.606688  3451 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.587102  2836 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:53.567260  3423 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.609810  2930 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.609992  3410 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.662968  3410 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:53.610926  3435 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:01:53.569252  3448 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:01:53.545611  3440 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:01:53.636368  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.555568  3422 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.649819  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:53.617030  3367 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:53.646533  3355 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.675607  3418 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.651s	user 0.003s	sys 0.000s
I20260709 13:01:53.642362  3362 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.633332  3433 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.641521  3402 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:53.681087  1680 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:53.644577  3451 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:53.689441  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57490.7us
I20260709 13:01:53.704329  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.655561  3423 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:53.646044  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 192612us
I20260709 13:01:53.665195  3446 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:53.710178  3421 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.670063  3161 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:01:53.691097   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:53.692471  3447 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.706408  3451 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.679075  3313 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:01:53.710983  3423 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.703995  1675 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:53.688103  3367 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.714600  3446 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:53.690081  3355 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.713790  3250 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:53.697499  3362 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.741238  3446 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.755640  3367 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.758311  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:53.759001  3422 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.761108  3433 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.758992  1604 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:53.764816  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:53.764777  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:53.739475  3460 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:53.771739  3439 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:53.779838  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.773718  3420 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.779614  3453 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.777976  3422 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:01:53.783120  3460 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.803416  3460 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.733385  3402 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.778762  2932 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:01:53.809201  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 104968us
I20260709 13:01:53.790896  3354 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.808286  3351 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:53.810496  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.811611  3426 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.796782  3453 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:53.814335  3453 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.815150  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.816250  3440 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.817812  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.818589  3440 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.819938  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.820827  3440 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.822434  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 772) took 1063 ms. Trace:
I20260709 13:01:53.822499  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.823148  1534 rpcz_store.cc:276] 0709 13:01:52.758793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.844654 (+ 85861us) service_pool.cc:224] Handling call
0709 13:01:53.128134 (+283480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.129592 (+  1458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.822174 (+692582us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000dcd50. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:53.822360 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651136768}
I20260709 13:01:53.823798  3440 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:53.825212  3402 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.828460  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.829493   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:53.829602  3420 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.811306  3351 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.784919  3328 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:53.855867  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.858744  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.832824  3423 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.861130  1604 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:53.862556  3423 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.864318  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.864653  3426 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.859535  3420 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:53.865334  3426 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.865464  3362 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.866026  3426 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.866591  3420 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:53.866118  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.867592  3426 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:53.854365  3449 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.870880  3328 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:53.871495  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet bb1b18d08269419485367169ac7d79c5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:53.872347  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:53.875216  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:53.879136  3429 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.633s	user 0.002s	sys 0.000s
I20260709 13:01:53.898558  2990 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:53.898892  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1076) took 1032 ms. Trace:
I20260709 13:01:53.899348  3320 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:53.899933  3320 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:53.899266  1607 rpcz_store.cc:276] 0709 13:01:52.866925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.871462 (+  4537us) service_pool.cc:224] Handling call
0709 13:01:52.871946 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.980372 (+108426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.980413 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.000623 (+ 20210us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.069968 (+ 69345us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:53.070008 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.070136 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.878518 (+808382us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:53.898605 (+ 20087us) raft_consensus.cc:1685] finished
0709 13:01:53.898627 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.898839 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27502,"raft.queue_time_us":62810,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":52199168,"thread_start_us":125064,"threads_started":2,"wal-append.queue_time_us":148690}
W20260709 13:01:53.901695  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 11e72d8320164ed18fc7fccba3a0ecd3: Illegal state: Replica f9fb126997be4ec79f8f60fcd6764b00 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:53.900924  3320 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:53.907687  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.879997  3355 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.881405  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.854569  3440 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:53.886133  3351 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.888510  3453 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:53.890753  3465 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:01:53.917667  1610 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.917479  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:53.881398  3472 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.870929  2211 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:53.891897  3451 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.911173  1534 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.920212  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:53.913869  1528 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:53.920673  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.922192  1530 raft_consensus.cc:2410] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:53.923358  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.832762  3419 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.925457  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.925666  1535 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:01:53.926216  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.926633  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.926775  1529 raft_consensus.cc:2376] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5. Re-sending same reply.
I20260709 13:01:53.927433  1532 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:53.927465  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:53.928318  2212 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:53.928428  3362 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:53.929040  3362 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.929390  3453 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:53.929598  3362 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.919348  2957 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.935169  1610 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:53.932426  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.938642  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:53.944635  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:53.948369  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.950331  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.951359  1531 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:53.951820  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.953105  1529 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:53.953845  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.954864  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.955921  1529 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:53.958300  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.958346  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.959510  1529 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:53.960258  3469 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.960719  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.962644  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.963770  3469 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.967924  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.969166  3469 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.969563  1531 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:53.971063  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.972774  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.973820  1531 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:53.974927  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:01:53.975708  1531 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:53.978221  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:53.979811  1605 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.923388  3472 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:53.980691  3472 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.930511  2957 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:53.920300  3351 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:53.916384  3426 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:53.982970  1532 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:53.983043  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:53.936957  3352 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.984367  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:53.985683  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.992221  1532 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:53.997707  1526 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:53.924427  3355 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.987540  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:53.938267  3293 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:53.998978  1527 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:53.980406  1531 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.930804  3420 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:01:53.983733  3469 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.015519  1608 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:53.992120  3419 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.990971  2930 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.998474  2990 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.996848  3352 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:54.048936  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:53.993019  3351 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.061106  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
I20260709 13:01:54.063516  1531 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.064383  1534 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:54.028554  3320 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.023205  3469 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:54.068728  1531 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.053283  3352 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.050014  3422 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:54.069762  3446 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:54.071575  3474 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:54.007601  3293 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.073575  3260 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:54.074455  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:54.081041  1529 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:01:54.075644  2957 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.075254  3426 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.007443  3355 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.003676  3460 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:54.082481  3293 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.068305  3469 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.077520  1602 raft_consensus.cc:2410] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:54.024861  3440 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.065778  3320 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.080377  3321 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.030547  3439 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:54.086475  3451 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.090543  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:54.094025  1530 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:54.085021  3361 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:54.090135  3355 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.096886  3361 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:54.097862  3361 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.087672  2990 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.087889  3320 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.096441  3351 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.122131  2857 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.108482  3241 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.113680  2990 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.156224  3362 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:54.164603  3472 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.154840  2857 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.177968  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:54.173660  3446 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.180883  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:54.178946  3362 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:54.165696  3241 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.188110  2990 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:54.189608  2990 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.190296  3241 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.197357  2857 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.205739  3352 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.212915  1527 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:54.219857  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.219697  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:54.224555  3351 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.225831  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.226383  1606 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:54.227366  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.220963  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.228636  1610 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:54.225066  3351 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.234514  2836 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:54.235996  3351 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.238623  1528 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.241161  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.252372  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.255012  1680 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.256479  2930 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.249868  3466 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:01:54.259989  3460 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.268115  3460 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.272693  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.264631  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:54.276685  2211 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.280198  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:54.281996  1684 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:54.259686  3464 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:54.286638  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.286402  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.288578  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.288713  1677 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:54.279771  3444 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.290684  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.291409  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.279992  2857 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:54.293051  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:54.259822  2930 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.301450  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:54.343259  1684 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:54.344851  3391 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.324163  3460 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.301115  2857 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.329134  3165 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.292296  3464 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:54.323766  3444 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.347849  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.302064  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.353572  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:54.354403  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53029.4us
I20260709 13:01:54.355145  3381 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.363164  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:54.363101  1683 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:54.361099  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:54.364480  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:54.367372  1608 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.371345  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:54.372390  3422 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:54.365873  3156 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:54.372924  3422 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.373253  3156 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:54.373611  3156 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.373832  3422 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.370859  3313 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:54.375264  3313 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.375568  3468 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.375941  3468 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.376510  3468 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:54.377339  3475 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.315s	user 0.000s	sys 0.003s
I20260709 13:01:54.377876  3439 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:54.379427  3364 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.382372  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:54.355789  3391 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.386500  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1113) took 1301 ms. Trace:
I20260709 13:01:54.386873  1679 rpcz_store.cc:276] 0709 13:01:53.085604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.086005 (+   401us) service_pool.cc:224] Handling call
0709 13:01:53.086311 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.346621 (+260310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.386285 (+1039664us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003cbed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:54.386445 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597426432}
I20260709 13:01:54.365593  3469 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.389029  2987 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:54.389827  2987 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:54.389971  3469 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.390177  2987 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:54.382544  2857 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.391130  2987 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.391752  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:54.392696  3320 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.395231  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:54.397130  3382 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.397521  3382 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:54.359378  3165 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.398316  3382 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.405284  3391 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.408437  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:54.398418  3464 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.414965  3165 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.415174  2987 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.415922  2836 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:54.416556  2836 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.417851  2836 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:54.376151  3313 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.406944  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.424520  1679 raft_consensus.cc:2368] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 4. Current term is 5.
I20260709 13:01:54.426113  2178 leader_election.cc:400] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 4. Current term is 5.
I20260709 13:01:54.426460  2178 leader_election.cc:403] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.427416  3464 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.429912  1675 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.435896  1681 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:54.439980  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.441008  1675 raft_consensus.cc:2368] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:54.449131  1681 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:54.451844  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.452800  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.452731  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.453776  1679 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.453641  1682 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:54.455065  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.455708  1682 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:54.457195  1679 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:54.456689  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.461006  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.458127  1679 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.463042  1679 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.461841  1682 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:54.465916  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.466667  1682 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:54.473234  3444 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.474644  3472 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.481067  2930 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.476231  3320 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.477169  1679 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:54.489665  1501 leader_election.cc:400] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6.
I20260709 13:01:54.503511  1529 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:54.503697  2857 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:54.507843  3189 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:54.509233  3189 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:54.509696  3189 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:54.510617  3189 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:54.516652  3490 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:54.503530  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:54.485050  3364 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.503739  3464 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 4. Current term is 5.
W20260709 13:01:54.654335  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 150887us
I20260709 13:01:54.679749  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:54.668480  2211 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.654119  3391 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:54.684394  3391 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.685164  3391 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.686080  3381 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:54.687096  3433 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.687788  3433 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:54.653738  3411 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.645375  2930 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.689937  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:54.691327  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:54.644953  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.693346  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.688544  3411 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.694461  2857 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.694937  2857 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.695310  2857 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.654655  3165 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.696862  3165 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.697140  3411 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.698877  3165 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.688719  2930 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.701898  2930 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.703019  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:54.664857  3189 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.691937  2987 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.712340  3241 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.667785  3468 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.713531  3351 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:54.715333  3351 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.717308  3351 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.719310  3468 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.703946  3431 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:54.688649  3433 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:54.720309  1681 raft_consensus.cc:2368] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:54.720160  3431 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.707002  3165 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.723037  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.724265  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.724879  1682 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:54.709038  2930 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.727561  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:54.713940  2987 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.731803  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:54.734997  2735 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:54.736253  2735 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.736625  2735 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.736828  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:54.723359  3165 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.741009  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:54.728538  3241 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:54.747134  2735 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.740782  3454 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.745489  3449 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:54.750846  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.739804  2987 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.751389  1608 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:54.754551  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.741703  3460 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.755113  1608 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:54.744269  3468 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:01:54.744939  3165 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.760351  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.771246  3156 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.763008  1608 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:54.765075  3447 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:54.766595  3241 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.768918  2957 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:54.746472  2857 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.769412  3451 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:54.797422  2957 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:54.797648  3451 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.798491  2957 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.798578  3451 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.799571  2957 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.761970  3460 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.800511  3460 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.750238  3469 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:01:54.805519  3431 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.805574  2857 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.744475  3419 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:01:54.774607  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.909210  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:54.909957  1528 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.758401  2735 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:54.792236  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:54.912293  1608 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:54.912431  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 164662us
I20260709 13:01:54.770408  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:54.913653  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 143324us
I20260709 13:01:54.903455  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:54.815263  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.914950  1607 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:54.916323  2735 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:54.917174  2735 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.868059  3454 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.826108  3391 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.810823  3469 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:54.796514  3447 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.807101  3156 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.853817  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:54.735442  2930 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.845693  3411 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.859715  1501 leader_election.cc:400] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:54.837890  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1101) took 1217 ms. Trace:
I20260709 13:01:54.946602  1605 rpcz_store.cc:276] 0709 13:01:53.620430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.621067 (+   637us) service_pool.cc:224] Handling call
0709 13:01:53.621469 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.984207 (+362738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.837569 (+853362us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400085054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:54.837828 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823649664}
I20260709 13:01:54.818904  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:54.948593  1601 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.815441  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.950218  1603 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:54.821274  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:54.951488  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 130296us
I20260709 13:01:54.843261  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1103) took 1195 ms. Trace:
I20260709 13:01:54.817677  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:54.816884  3420 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.830452  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:54.856992  1683 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:54.955821  1501 leader_election.cc:403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.814211  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:54.777714  1682 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.750422  2836 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.869552  1677 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.921402  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:54.925642  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:54.929383  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:54.931661  1607 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:54.933071  1679 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.935128  1531 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:54.819975  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:54.953356  1602 rpcz_store.cc:276] 0709 13:01:53.648052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.649474 (+  1422us) service_pool.cc:224] Handling call
0709 13:01:54.843049 (+1193575us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400100254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:54.843203 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933497088}
I20260709 13:01:54.968672  2735 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:55.023363  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 163829us
W20260709 13:01:54.960711  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.022042  1608 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:55.023629  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.025949  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:55.026340  1610 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:55.026933  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.027477  2735 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.918857  3419 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:55.029598  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:54.928079  3362 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.031625  1532 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:55.034236  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:55.034399  2735 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.930357  3469 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:55.057583  2735 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:55.046072  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 116777us
I20260709 13:01:55.041473  1679 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
W20260709 13:01:55.065475  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 144173us
I20260709 13:01:54.894711  3165 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.031844  3476 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:01:54.956449  3351 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:55.121275  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.947876  2987 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:54.955292  3420 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:55.033447  3419 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:54.954656  3411 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.036535  2857 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.933107  3422 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 13:01:55.047346  3362 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:55.047241  3465 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:55.062713  3328 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:55.066885  3454 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.141206  1682 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:01:55.119745  1601 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:55.127393  3423 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.068181  3472 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.146374  2990 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:55.127586  3392 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:01:55.149171  2957 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:01:55.650286  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.007s	sys 0.006s
W20260709 13:01:55.656744  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.011s
W20260709 13:01:55.657106  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.008s
W20260709 13:01:55.657379  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.011s
W20260709 13:01:55.659178  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.017s
W20260709 13:01:55.659623  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.001s	sys 0.017s
I20260709 13:01:55.163447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.661814  1533 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:55.664088  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.012s
W20260709 13:01:55.664449  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.664621  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.011s	sys 0.062s
W20260709 13:01:55.649909  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.000s	sys 0.041s
W20260709 13:01:55.665228  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.012s	sys 0.062s
W20260709 13:01:55.666028  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.010s
W20260709 13:01:55.666591  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.008s	sys 0.010s
W20260709 13:01:55.666996  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.264503  2930 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:01:55.669315  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.669597  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.669934  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.262781  2987 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:55.665495  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.001s	sys 0.044s
I20260709 13:01:55.672609  2990 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.657950  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.005s
W20260709 13:01:55.664754  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.012s
W20260709 13:01:55.683957  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.012s	sys 0.006s
I20260709 13:01:55.681557  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:55.684585  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 623484us
I20260709 13:01:55.680663  2988 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.686512  3241 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.687100  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.687203  2836 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:55.685974  2988 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.688542  3189 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.677047  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.680804  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.690111  1531 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:55.687493  3241 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.688560  2836 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.691589  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:55.683686  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 656877us
I20260709 13:01:55.692535  1531 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:55.693213  3241 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.693703  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:55.694995  1534 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:55.689862  3189 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.246011  3165 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.697052  3165 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.697850  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:55.698145  3189 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.607838  3328 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:55.699033  3189 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.700498  3189 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.701225  3328 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:55.703575  3189 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.338464  3352 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:55.704977  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:55.162685  3362 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.454401  3382 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.706241  1681 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.707897  3361 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.708875  3361 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.693701  2836 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.711130  2836 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:55.697803  3165 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.143977  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 326363us
I20260709 13:01:55.247160  3411 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.742549  3506 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.225020  3419 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.744216  3506 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.219318  3420 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.349854  3504 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:55.747184  3506 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.750597  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:55.751848  1677 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:55.754580  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.757223  3514 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.450409  3500 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.676s	user 0.004s	sys 0.010s
I20260709 13:01:55.758149  3514 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:55.760509  3503 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:55.703799  3321 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:01:55.761528  3503 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.699016  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:55.358373  3391 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.675870  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:55.712265  2836 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.737605  1526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.006s	sys 0.013s
I20260709 13:01:55.676844  2990 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.835573  3503 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.835600  3514 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:55.606787  2857 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
W20260709 13:01:55.231173  3502 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:55.170233  3454 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.232507  3444 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.858800  3440 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:55.860818  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:55.863963  3361 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.864574  3422 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:55.868543  2988 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:55.877974  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.154229  3431 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.885304  1526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.007s	sys 0.014s
W20260709 13:01:55.612533  3446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.011s	sys 0.033s
I20260709 13:01:55.149171  3439 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.879598  3503 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:55.587877  3156 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:01:55.459056  3451 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:55.347399  3498 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.590s	user 0.004s	sys 0.010s
I20260709 13:01:55.899372  1681 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:55.249248  3433 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.902184  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:55.902644  3503 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.903215  1682 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:55.904170  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:01:55.905048  3446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.011s	sys 0.034s
I20260709 13:01:55.905419  3503 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.908586  3472 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.904654  3422 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.911310  3472 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.924389  3439 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.924579  3444 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.927088  3439 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.927170  3444 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.932919  1684 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.907771  3165 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.937530  3454 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.937844  2836 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.152284  3447 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.941938  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1125) took 1193 ms. Trace:
I20260709 13:01:55.942301  3447 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.938582  3321 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.163582  3460 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.949069  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1017) took 1120 ms. Trace:
W20260709 13:01:55.948659  1529 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.029s	sys 0.053s
W20260709 13:01:55.950443  1529 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.030s	sys 0.054s
I20260709 13:01:55.951297  3460 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:54.849885   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:55.953454  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:55.954712  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 256098us
I20260709 13:01:55.930560  2988 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.955626  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:55.956108  2988 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.957042  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:55.959082  2988 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.959537  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:55.918377  3410 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:55.911926  3422 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.938345  3386 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.960119  3352 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.960345  3511 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.960821  3513 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.987159  3513 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.988098  3460 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.988885  3460 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.989531  3513 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:55.946857  3321 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:55.990607  1677 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:55.991067  3460 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:55.990178  3513 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:55.963721  2932 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:55.992002  3513 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:55.992755  2932 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:55.992483  3362 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.993196  2932 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:55.993352  3513 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.994323  2932 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.995357  3362 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:55.934321  3506 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.965478  3392 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.996430  3506 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.996567  3392 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.997920  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 814) took 1738 ms. Trace:
I20260709 13:01:55.999423  3392 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:55.967526  2857 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:56.000646  2857 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:56.001132  2857 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:56.002417  2857 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.003165  3460 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:55.969183  3361 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:56.004477  3361 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:56.004187  3460 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.005671  3361 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.970060  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:55.970557  3440 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:55.931020  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.574s (SENT) [suppressed 27 similar messages]
I20260709 13:01:55.986042  3511 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.961059  3516 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:55.961951  3381 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:55.962924  3355 raft_consensus.cc:2764] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:55.998317  1680 rpcz_store.cc:276] 0709 13:01:54.258970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.259143 (+   173us) service_pool.cc:224] Handling call
0709 13:01:54.432699 (+173556us) spinlock_profiling.cc:243] Waited 916 us on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:01:54.432859 (+   160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.433203 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.433237 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.433705 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.703786 (+270081us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:54.703836 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.703905 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.346643 (+642738us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:01:55.997497 (+650854us) raft_consensus.cc:1685] finished
0709 13:01:55.997536 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.997745 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1128,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9474,"spinlock_wait_cycles":12543744,"thread_start_us":269716,"threads_started":1,"wal-append.queue_time_us":306099}
I20260709 13:01:55.949620  1526 rpcz_store.cc:276] 0709 13:01:54.829230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.832219 (+  2989us) service_pool.cc:224] Handling call
0709 13:01:54.832732 (+   513us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:54.833284 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:54.833838 (+   554us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.046266 (+212428us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:55.061544 (+ 15278us) log.cc:844] Serialized 78 byte log entry
0709 13:01:55.061781 (+   237us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:55.933278 (+871497us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.948135 (+ 14857us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.948490 (+   355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.948630 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.948706 (+    76us) raft_consensus.cc:1685] finished
0709 13:01:55.948724 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.948990 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1276,"prepare.queue_time_us":285129,"prepare.run_cpu_time_us":190,"prepare.run_wall_time_us":9939,"raft.queue_time_us":5456,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":302,"spinlock_wait_cycles":1777024,"thread_start_us":1042932,"threads_started":2,"wal-append.queue_time_us":291746}
I20260709 13:01:56.037294  1527 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:55.942461  1604 rpcz_store.cc:276] 0709 13:01:54.748541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.749680 (+  1139us) service_pool.cc:224] Handling call
0709 13:01:54.750035 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.755556 (+  5521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.755586 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.756327 (+   741us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.888600 (+132273us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:54.911777 (+ 23177us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.911992 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.912089 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.921342 (+1009253us) raft_consensus.cc:1685] finished
0709 13:01:55.934264 (+ 12922us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.941635 (+  7371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5129,"prepare.queue_time_us":32155,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":13215,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":13868,"thread_start_us":131074,"threads_started":1,"wal-append.queue_time_us":301765}
I20260709 13:01:56.012809  2932 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.906252  3431 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.998855  3506 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.012971  2857 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.973091  3439 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.980996  3352 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.047889  1684 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:56.045254  1528 consensus_meta.cc:287] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.129s	user 0.020s	sys 0.000s
W20260709 13:01:56.054484  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 84618.4us
I20260709 13:01:55.219084  3469 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:55.991394  3321 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.061540  2957 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.062256  3321 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.062991  2930 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.064114  1528 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:56.064760  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1022) took 1156 ms. Trace:
I20260709 13:01:56.065012  3423 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:56.066156  3423 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.068126  3506 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:56.068914  3506 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:56.070268  3352 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.070076  3506 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.052601  3381 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:56.071712  3381 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.076231  3439 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.078958  3439 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.088714  3420 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.089473  3511 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.090070  3516 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.093037  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1145) took 1378 ms. Trace:
I20260709 13:01:56.093590  3431 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.035236  3503 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.094427  3503 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.097214  3503 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.100416  1534 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:56.093508  1675 rpcz_store.cc:276] 0709 13:01:54.715557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.735214 (+ 19657us) service_pool.cc:224] Handling call
0709 13:01:54.754968 (+ 19754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.154022 (+399054us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:01:55.161965 (+  7943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.669141 (+507176us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.723455 (+ 54314us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:55.723527 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.092429 (+368902us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400032ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:01:56.092476 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.092525 (+    49us) raft_consensus.cc:1685] finished
0709 13:01:56.092537 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.092865 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3662,"raft.queue_time_us":17423,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4654,"spinlock_wait_cycles":644239616,"thread_start_us":53554,"threads_started":1,"wal-append.queue_time_us":54151}
I20260709 13:01:56.065056  1528 rpcz_store.cc:276] 0709 13:01:54.908741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.908929 (+   188us) service_pool.cc:224] Handling call
0709 13:01:56.064659 (+1155730us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:56.111493  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.063632  2930 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:56.119552  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.985337  3410 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:56.113071  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54521.1us
I20260709 13:01:56.013586  3386 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:56.131480  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 202907us
W20260709 13:01:56.142628  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.145327  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.167757  1531 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:56.154387  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:56.157922  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.138479  3516 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.192291  3446 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.193250  3446 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.194937  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:56.195703  3446 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.146584  3460 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.196198  3522 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.154707  3156 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.205438  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1028) took 1172 ms. Trace:
I20260709 13:01:56.204838  3156 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.205880  1529 rpcz_store.cc:276] 0709 13:01:55.033072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.040380 (+  7308us) service_pool.cc:224] Handling call
0709 13:01:55.090972 (+ 50592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.091371 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:56.046931 (+955560us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.180700 (+133769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.189792 (+  9092us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:56.205030 (+ 15238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.205165 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.205368 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64,"prepare.queue_time_us":280606,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":5427,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":904204,"threads_started":2}
I20260709 13:01:56.170673  3241 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.208536  3241 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.210350  3433 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.211042  3433 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.212728  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.164573  3419 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.214125  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.214740  1534 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.215633  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.221843  3440 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.222620  3447 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.223342  3447 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:56.224758  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.225447  3447 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.225926  3447 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.226372  3447 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.227154  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:56.198323  3328 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.229449  3522 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.229791  3328 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:56.231580  3522 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.165876  3410 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.236202  3530 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.236835  3530 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.239290  3530 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.239463  3446 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.167459  3386 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.239732  3422 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.240203  3440 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.240461  3422 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.240855  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.240912  3440 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.241673  1526 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.242060  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.242542  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.242704  3422 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.243147  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.243876  1528 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.244338  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 777) took 2318 ms. Trace:
I20260709 13:01:56.244619  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.245051  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.245494  1607 raft_consensus.cc:2368] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:56.246162  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:56.246923  1533 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:56.228725  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.228837  3451 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.244700  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:56.227303  2836 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:56.243722  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.243888  1526 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:56.249996  1684 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.248100  3444 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:56.258853  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.239781  3530 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.261742  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96172.5us
I20260709 13:01:56.261693  3530 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.263612  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.264092  3530 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.264312  3156 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.264727  1528 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.265727  1603 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:56.267241  2930 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.269062  1607 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:01:56.269778  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.270296  2836 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:56.271355  2836 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.272181  3451 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.274057  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 173) took 6595 ms. Trace:
W20260709 13:01:56.269799  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 75050.4us
I20260709 13:01:56.281488  1528 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:56.283186  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.284461  1528 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.286269  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.288254  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.267813  3518 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.291512  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:56.292071  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.288877  1529 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.292596  1601 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:56.298856  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.203372  3439 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:56.255041  3433 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.274474  3451 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.244726  1535 rpcz_store.cc:276] 0709 13:01:53.925420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.926466 (+  1046us) service_pool.cc:224] Handling call
0709 13:01:53.926759 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.937024 (+ 10265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.937062 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.388669 (+451607us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b4800002958. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:01:54.895894 (+507225us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b1800328d20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a
0709 13:01:55.966426 (+1070532us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:01:55.967239 (+   813us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.069393 (+102154us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:56.142074 (+ 72681us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.146892 (+  4818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.170023 (+ 23131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.243939 (+ 73916us) raft_consensus.cc:1685] finished
0709 13:01:56.243959 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.244140 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61674,"prepare.queue_time_us":112976,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":16634,"raft.run_cpu_time_us":4480,"raft.run_wall_time_us":444730,"spinlock_wait_cycles":97791360,"thread_start_us":89283,"threads_started":1,"wal-append.queue_time_us":171412}
I20260709 13:01:56.289529  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:56.301306  1528 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
W20260709 13:01:56.312502  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56844.5us
I20260709 13:01:56.313571  1526 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.317246  1534 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.253554  3446 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.318132  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.318751  1529 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:56.287572  3516 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.334281  1533 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:56.320935  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:56.338760  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.346781  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.310632  3440 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.350790  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.351850  1528 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.310345  3410 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.298496  3444 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:56.361096  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.363407  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.343026  3328 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.373472  1604 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:56.369822  1528 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:01:56.375588  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.375962  1681 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.344194  3386 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.377720  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.379673  1531 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
I20260709 13:01:56.380586  1679 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:56.388770  1526 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:01:56.364979  3447 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.389957  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:56.380599  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.321617  3518 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:56.375056  3506 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:56.393831  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72473.2us
I20260709 13:01:56.392642  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.398821  2930 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.368498  3440 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.356844  3454 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.413300  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.403697  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.362116  3439 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:56.414865  1610 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:56.415231  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.416100  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.416934  1610 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:56.417747  3381 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.414808  1603 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:01:56.419442  3533 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:01:56.374876  3410 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.420811  3444 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:56.421757  3518 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.422183  3410 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.423044  2211 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:56.422729  1430 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 4 to 5, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.423877  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:56.424695  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.425509  1531 raft_consensus.cc:2368] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 4. Current term is 5.
I20260709 13:01:56.428423  2930 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.429359  3469 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.430532  1601 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:01:56.431074  2930 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.432735  3446 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.433650  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.434082  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.434984  1610 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.438419  1679 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:56.440567  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.440918  1679 pending_rounds.cc:85] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 5
I20260709 13:01:56.441394  1679 pending_rounds.cc:107] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:56.441361  1678 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.442027  3439 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:56.422276  3241 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.438552  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.443326  1682 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:56.443631  1683 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:56.444257  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.444418  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.444626  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.445139  1682 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.445469  1683 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.435361  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.446060  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.446394  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.446657  1682 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.446847  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.447202  1610 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:56.442569  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.433688  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.448868  1679 raft_consensus.cc:2889] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.434520  1607 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:56.450891  1682 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:56.451694  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59157.9us
I20260709 13:01:56.453774  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.453878  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.381407  3516 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.454569  3241 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:56.455175  3241 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:56.454990  3381 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.455536  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.456504  1679 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
I20260709 13:01:56.435108  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.413537  3506 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:56.442373  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.458112  3381 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.456310  3241 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.413021  1608 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:56.466768  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.476042  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.476385  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.476847  1682 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:56.477826  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.467434  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.445465  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:56.469846  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65599us
I20260709 13:01:56.471153  1676 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:56.489301  1604 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.494269  1681 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
I20260709 13:01:56.413367  3530 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.497291  3386 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.497972  3386 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.500473  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.500597  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:56.501158  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.501929  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.502341  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.503099  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.503545  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.507051  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.526743  1608 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
W20260709 13:01:56.512589  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57142.4us
I20260709 13:01:56.514304  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:56.516342  3313 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.517304  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:56.517645  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.518491  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.519630  1528 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.520376  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.520558  3506 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.526840  1603 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.476285  3522 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:56.513271  3381 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.531812  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.536250  1675 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.503855  1606 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:56.556107  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.560878  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.493854  3392 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.563383  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.274493  1431 rpcz_store.cc:276] 0709 13:01:49.678281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.678879 (+   598us) service_pool.cc:224] Handling call
0709 13:01:56.273854 (+6594975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:51.241645 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:51.242345 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:51.242380 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:51.242400 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:51.417419 (+175019us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:51.417509 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:51.417538 (+    29us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:01:51.419247 (+  1709us) tablet.cc:701] Row locks acquired
0709 13:01:51.419269 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:51.419423 (+   154us) write_op.cc:270] Start()
0709 13:01:51.419533 (+   110us) write_op.cc:276] Timestamp: P: 1783602111419377 usec, L: 0
0709 13:01:51.419554 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:51.513963 (+ 94409us) log.cc:844] Serialized 9077 byte log entry
0709 13:01:52.176562 (+662599us) op_driver.cc:464] REPLICATION: finished
0709 13:01:52.363262 (+186700us) write_op.cc:301] APPLY: starting
0709 13:01:52.366858 (+  3596us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:52.382173 (+ 15315us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:52.382387 (+   214us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:52.454719 (+ 72332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:52.455365 (+   646us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:01:52.455412 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:52.455876 (+   464us) log.cc:844] Serialized 157 byte log entry
0709 13:01:52.465516 (+  9640us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.479709 (+ 14193us) write_op.cc:454] Released schema lock
0709 13:01:52.505944 (+ 26235us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:52.512789 (+  6845us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.512834 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27815,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":175160,"apply.run_cpu_time_us":6758,"apply.run_wall_time_us":153535,"num_ops":23,"prepare.queue_time_us":195090,"prepare.run_cpu_time_us":12829,"prepare.run_wall_time_us":502917,"raft.queue_time_us":197682,"raft.run_cpu_time_us":14000,"raft.run_wall_time_us":102942,"replication_time_us":756875,"thread_start_us":593250,"threads_started":4,"wal-append.queue_time_us":355250,"wal-append.run_cpu_time_us":28390,"wal-append.run_wall_time_us":1576167}]]}
I20260709 13:01:56.570749  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.495046  3440 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.555881  3361 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.587371  1527 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:56.521685  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:56.589222  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.562556  3516 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.557945  3522 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:56.562388  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48281us
I20260709 13:01:56.594956  1606 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:56.540637  3444 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:56.591646  1605 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:56.565217  3381 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.601447  3391 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.557588  3530 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.602303  3391 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.581809  3392 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.604465  1678 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:56.600704  3516 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.605630  3516 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.576817  3542 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:56.609205  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.609823  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.611064  1433 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.610314  1527 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.615072  3518 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.615538  3518 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.615975  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.617221  1433 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.615916  3518 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.620827  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.547663  3313 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.626582  1608 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:56.629511  1433 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.606480  3439 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.634675  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.606238  3392 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.637516  3530 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.608421  3361 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.639568  3522 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.644728  2990 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.645308  3381 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.667436  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.656008  3361 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.669052  1603 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:56.645471  3313 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.608744  3542 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.648643  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.670091  3542 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.652915  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.670346  3391 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.651808  3440 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.657035  1532 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.671523  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:56.670581  1678 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:56.658946  3392 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.672768  3527 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.661787  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.672680  3392 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.673722  3527 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.674149  3527 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.662705  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.674948  3392 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.675184  1526 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.664305  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:56.631739  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 141851us
I20260709 13:01:56.648654  3419 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.662014  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.675743  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.679551  1533 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
W20260709 13:01:56.677852  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.680560  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.680930  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.681237  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.682036  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.684448  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.684298  1433 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.685165  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.687193  1433 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.688171  3454 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.689235  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:56.696319  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.696455  1529 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.689965  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:56.691061  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.691717  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:56.691747  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.695883  1608 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:56.702060  1604 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.681689  3419 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.709851  1533 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.712210  3460 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.711376  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:56.714690  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.657546  3439 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.717697  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.719712  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.721647  1606 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:56.723057  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.723811  1605 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:56.724876  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.723057  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.725512  1605 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:01:56.727931  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.728331  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.728499  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:56.729332  1608 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:01:56.729574  3548 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:56.730247  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.730983  1608 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:56.730266  1526 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:56.729529  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:56.733007  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.734782  1603 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:56.734777  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.735214  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:56.683188  2990 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.742415  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.736099  1433 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:56.745313  3551 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:56.747155  2176 leader_election.cc:400] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 4. Current term is 5.
I20260709 13:01:56.753198  1607 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:56.755740  1608 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:56.757534  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.757319  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.759442  3444 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.730373  3433 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.752569  1433 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 5, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.764849  1605 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:56.738170  3313 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.766410  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.770668  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:56.759864  3444 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.774356  3444 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.775696  3328 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:56.772692  3313 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.778060  3313 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.782755  2836 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.781637  1433 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.789476  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.783427  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.791626  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.766935  3433 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.798667  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:01:56.808736  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51445.4us
I20260709 13:01:56.813301  1681 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:56.788375  2930 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.814429  2930 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.788177  3451 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.814790  2930 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.815186  3451 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.815806  3451 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.814778  1498 leader_election.cc:400] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5.
I20260709 13:01:56.818636  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:56.823925  1601 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:56.824667  1433 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.825390  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.830070  1608 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:56.817829  3433 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.810667  3516 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.827000  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.836350  1602 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:56.838640  1609 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:56.833081  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:56.824533  3440 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.789135  2836 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.831503  3460 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.839793  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.840437  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:56.847424  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.824215  3328 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:01:56.859157  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.853434  1433 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.875345  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.845598  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:56.893100  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:56.851500  3516 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:56.894716  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49192.1us
I20260709 13:01:56.894819  3516 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.895332  3516 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.842445  3460 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:56.896896  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:56.899978  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.837538  3386 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.905265  3522 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:56.867002  3446 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.906579  2930 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.906985  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:56.907146  3361 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:56.909281  1433 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 2 to 5, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.912532  3446 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:56.918196  1604 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:56.900676  3460 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.895831  2836 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.844213  3440 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:56.867981  3518 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:56.923585  3241 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.911115  3419 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.925545  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.935798  1678 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:56.926595  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.926870  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.927757  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:56.927759  1676 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:56.930192  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.936851  1433 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.913781  3382 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:56.933319  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.930964  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.938192  1675 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 2.
I20260709 13:01:56.939831  1682 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:56.917193  3381 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:56.916934  3446 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.941401  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.942943  1682 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:01:56.944779  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:56.933012  3550 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:01:56.937358  1680 raft_consensus.cc:2376] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5. Re-sending same reply.
I20260709 13:01:56.949767  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.950558  1682 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:56.946534  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:56.952354  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:56.954689  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.955878  1678 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:56.957803  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.959013  1684 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:01:56.962574  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69007.7us
I20260709 13:01:56.964242  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:56.965205  1680 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:56.953229  1676 raft_consensus.cc:2376] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6. Re-sending same reply.
W20260709 13:01:56.966922  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60049.3us
I20260709 13:01:56.960896  1433 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 3, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 3 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:56.941833  3382 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:56.969018  1433 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.921238  3527 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.030820  3527 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.977080  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:56.980145  3552 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.160s	user 0.004s	sys 0.000s
I20260709 13:01:56.985785  1678 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.033083  1679 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:56.988262  2836 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:57.034255  2836 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:57.034648  2836 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:57.035494  2836 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.036011  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.019409  3440 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:56.991976  3419 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.992846  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:57.038244  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45490.3us
I20260709 13:01:57.039495  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.040395  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:57.040807  2990 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.041353  2990 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.041445  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.042248  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.043694  3469 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.044101  3469 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.044574  3469 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.045200  2930 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:56.993904  3386 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.001210  3444 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.004328  1433 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.008153  3382 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.009585  3516 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.020371  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.028064  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.028735  3518 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.036688  2836 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.988251  3439 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:57.032655  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56146us
W20260709 13:01:57.048097  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 151981us
I20260709 13:01:57.041751  2990 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.059549  3556 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.063789  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.067457  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.075577  1679 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:57.049182  3419 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.068245  1607 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:57.076642  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.077332  1683 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:57.077988  1680 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:01:57.043710  3313 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.077068  3460 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.050642  3440 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.079430  3440 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:57.079839  3440 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.080336  1675 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:01:57.080984  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 204377us
I20260709 13:01:57.081982  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.082297  3516 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.082536  3446 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.083142  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.083752  1529 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.084378  3444 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:57.084550  3446 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.072804  1433 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 5, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:57.082094  3460 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.085708  1433 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.058605  3451 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.087368  1433 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.068954  2990 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.074309  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.090142  1534 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.094954  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.097659  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.098587  3530 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.100816  3516 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:57.101464  3516 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.101737  3460 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.102240  3460 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.102595  3460 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.103205  3386 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.105229  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.105574  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.106269  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.107028  1676 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.107122  1677 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.107483  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.107769  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.108165  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.108599  1676 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.109524  1675 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:57.109901  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.109452  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.110939  1679 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.111289  1684 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:57.111193  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.110241  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.102722  3516 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.112381  1682 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:57.087958  3556 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.113283  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.113632  3556 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.113987  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:57.108105  3518 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:57.116878  3518 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:57.117010  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.117273  3518 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:57.117409  3451 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.118185  3518 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.119411  3518 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.120007  2990 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.121152  3433 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.121376  3469 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.122816  1681 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:57.123934  3557 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.124354  3557 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:57.124707  3557 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.124737  3433 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.128327  3386 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.130300  3313 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.132884  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.136945  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.137987  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.112555  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.136787  1433 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:57.138880  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96691.9us
I20260709 13:01:57.133744  3460 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.148468  1529 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 6.
I20260709 13:01:57.149420  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.151298  1433 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 5, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.153996  1433 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:01:57.156205  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43721.8us
I20260709 13:01:57.157707  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.159996  2857 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.160595  2857 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.160933  3381 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.161140  2857 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.161899  3381 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.166918  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:57.167102  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.155962  3386 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.129180  3469 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.171463  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:01:57.172869  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.175240  1675 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:57.148557  2990 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.157336  3506 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.164968  3241 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.168181  3555 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:57.180938  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.174149  3451 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.176245  3542 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.004s
I20260709 13:01:57.196964  3542 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.199219  3542 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.200555  2212 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:57.200955  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.201447  3433 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:57.201964  3433 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.202667  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.203233  1676 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:57.204720  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.205072  3440 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.205691  3557 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.206063  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.207123  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.207314  3440 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.207774  3557 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.208370  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.209128  1683 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:57.209846  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.210134  1684 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.182611  1675 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:57.174086  3386 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.213214  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.213853  3386 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.119889  3382 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.178568  3506 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.184831  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:01:57.183596  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:57.173771  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:57.187443  3460 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.171916  3522 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:01:57.181994  3555 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:57.177255  3361 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:01:57.189463  3530 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.174045  3392 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.221531  3392 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:57.192797  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.222194  3392 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.222373  1680 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
W20260709 13:01:57.222539  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53522.2us
I20260709 13:01:57.193008  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.193782  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.223320  3542 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:57.223807  1679 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.223937  3542 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:57.196123  3451 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.190780  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.180642  3241 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:57.224987  3542 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.225522  1681 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:57.225581  3241 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.179320  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:57.186117  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62513.8us
I20260709 13:01:57.208393  3433 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.220422  2211 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:57.223286  1677 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:57.219717  3555 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.214649  3506 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.229049  3391 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.229516  3391 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.229960  3391 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.235316  3451 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.235232  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.237919  3530 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:57.237588  2857 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.238432  3530 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.236531  3433 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.221575  3382 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.239099  3433 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.239498  3530 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:57.240146  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59432.8us
I20260709 13:01:57.239521  3433 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.243999  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.244836  3451 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.244944  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.246028  1604 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:57.246091  3313 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.246606  1604 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:57.246714  3313 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.247180  3313 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.247575  1604 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.245378  3451 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.249147  3451 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.238366  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:57.236012  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56781.6us
I20260709 13:01:57.344827  3460 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.344913  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.345729  3460 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:57.345867  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.346146  3460 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.346531  3460 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:57.300758  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.347548  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.249827  3561 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:57.348240  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.348320  3382 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:57.348989  3382 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.349594  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:57.334678  1601 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:57.350283  1603 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:57.343487  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.351163  1682 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.334262  1675 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:57.349915  3382 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.351333  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.356388  1603 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.334554  2857 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.356976  2836 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.351891  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:57.346500  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 108211us
I20260709 13:01:57.352397  1677 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:57.358444  1601 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:57.359997  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.219795  3440 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:01:57.336680  3522 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.364754  2836 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.370641  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.376783  1601 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.380853  1676 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
I20260709 13:01:57.342648  3469 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.381682  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.382261  1677 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.393029  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.399935  1606 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:57.401314  1603 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:57.401461  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.402882  1601 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:57.403828  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:57.404932  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:57.408530  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46563.8us
I20260709 13:01:57.409165  1601 raft_consensus.cc:2368] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:57.405230  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.410058  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.410378  1603 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.411284  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.412065  1601 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:57.413318  1607 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:57.416213  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.415729  3440 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:57.368546  3561 consensus_queue.cc:1243] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:57.366088  3556 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.420094  3440 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:57.421763  3518 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:57.438607  1677 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:01:57.423818  3444 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.448132  2836 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.446154  3571 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.397174  3522 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.443008  3572 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:57.422173  3469 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.480557  1682 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:57.468575  1610 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:57.457717  3361 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.481139  1610 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:57.459537  3444 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.482041  1610 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.482944  1610 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.483723  3444 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.458561  3439 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:57.486047  1604 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.480861  3572 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:57.488449  3572 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.489601  3361 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.490932  2930 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.491659  3361 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.491446  2930 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.495616  3469 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.459122  3518 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:57.496938  3518 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.497659  3556 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.498482  1606 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:57.471788  1603 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:57.466473  3570 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.469677  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.501552  1605 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.476058  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:57.470794  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.508383  1610 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:57.520112  1610 pending_rounds.cc:85] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
I20260709 13:01:57.523577  1610 pending_rounds.cc:107] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:57.483523  3391 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.507380  1604 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 13:01:57.503243  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.531466  1604 pending_rounds.cc:85] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
I20260709 13:01:57.526505  1610 raft_consensus.cc:2889] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.532658  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.540798  1604 pending_rounds.cc:107] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:57.541188  1604 raft_consensus.cc:2889] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.541640  1682 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.463915  3433 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.545522  3433 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.503165  3570 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.556309  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80390.4us
I20260709 13:01:57.559010  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.559254  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.560066  1677 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.561352  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.562256  1676 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:57.562170  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.564157  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:57.564378  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:57.566018  1676 raft_consensus.cc:2368] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:01:57.555058  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.537055  3556 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.573390  2836 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:01:57.567931  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47681.2us
I20260709 13:01:57.573361  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:57.479729  3571 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.576349  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.610848  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.501339  3241 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:57.615175  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44414.6us
I20260709 13:01:57.616418  3381 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.617051  3381 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.617177  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.617277  3460 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.618988  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.619060  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.619863  1528 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 2.
I20260709 13:01:57.555408  3570 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.621733  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.622367  1529 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:57.623237  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.616483  3241 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.624089  3569 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.568981  3446 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.624922  3446 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:57.625301  3446 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.629141  3522 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.630059  3460 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.534574  3392 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.634498  3392 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.616314  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.636072  3361 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:57.636686  1527 raft_consensus.cc:2410] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:57.611814  1677 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:57.616288  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:57.620012  1526 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:01:57.642889  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69655.8us
I20260709 13:01:57.643872  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:57.645710  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.536631  3506 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.571012  3444 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.658885  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.659078  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.628820  3555 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.614084  1534 raft_consensus.cc:2376] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8. Re-sending same reply.
I20260709 13:01:57.570881  2930 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.606367  2990 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.651633  3439 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.653177  3361 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.663282  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.666800  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.678367  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:57.679833  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 286878us
I20260709 13:01:57.679965  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.680594  2836 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.680967  2836 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.681330  2836 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.547962  3451 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.635421  3572 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:57.650862  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48803.4us
I20260709 13:01:57.681476  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.682000  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.685619  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.687938  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.688184  1527 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:57.689390  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.697101  1608 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.697355  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.699741  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.700238  1526 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:57.701450  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.702410  1532 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:57.703310  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.704629  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:57.705304  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.705919  1607 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.705317  1601 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:57.707052  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.707573  1601 raft_consensus.cc:2368] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:01:57.709955  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.711233  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.712224  1533 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:57.701421  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.713604  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.711509  1531 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.714408  1527 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:57.700457  1535 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:57.686774  3444 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.720100  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.676779  3556 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:01:57.742223  1647 leader_election.cc:400] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:57.690827  2857 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.742841  1647 leader_election.cc:403] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:57.745837  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.744613  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.754001  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.753949  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.689600  3313 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.720481  3469 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:57.758270  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.717155  3382 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:57.762144  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:57.769798  2836 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.772715  1526 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.738592  3454 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:57.738916  3444 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:57.756528  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.777390  1601 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:57.768209  2930 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:01:57.718344  3381 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.785579  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.786557  1530 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:57.780493  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:01:57.778473  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 96545.5us
I20260709 13:01:57.788781  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.786168  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.749742  3578 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.791399  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:57.791637  2836 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.768817  3392 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.718807  3522 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:01:57.772854  3577 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.797094  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:57.781306  3444 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.786307  3241 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.804126  3573 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:57.803773  3386 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.002s
I20260709 13:01:57.804675  3451 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.807783  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.794302  3454 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.813424  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.790241  3469 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:57.803134  3447 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.821677  1530 raft_consensus.cc:2368] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:01:57.827149  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.828984  1610 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.830929  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.807538  3568 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.818101  3382 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.834517  3469 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.834669  3382 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.837126  3313 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.840874  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.842360  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.810887  3590 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.846276  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:57.846778  1605 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:01:57.828099  3447 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:57.848721  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:57.839437  3564 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:57.810765  3386 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.855420  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.853636  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.845888  3577 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.860886  3440 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:57.822489  3583 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:57.885706  1610 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.848173  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.838346  3530 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:57.832888  3506 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.892057  3506 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:57.880906  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:57.877414  3587 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:01:57.891878  3454 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.893215  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.853011  3469 raft_consensus.cc:2764] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:01:57.893797  1530 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.850664  3578 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:57.856297  3555 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.848930  3522 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:57.875983  3562 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:01:57.912257  1608 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
W20260709 13:01:57.912120  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 85055.8us
I20260709 13:01:57.895164  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.858057  3579 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.916286  3579 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:57.916683  3579 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.918648  3446 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.919698  1603 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.921442  3446 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.944934  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.946107  1527 raft_consensus.cc:2368] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:57.946945  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.851135  3571 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.876322  3440 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.923007  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:57.925123  3585 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:01:57.928678  3584 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:57.928433  3579 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.929543  3573 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:57.929704  2857 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.931378  1605 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:57.932106  1610 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:57.933004  3569 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.896335  3564 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:57.893103  3572 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:57.937155  3570 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:57.851999  3392 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.939038  3386 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.858939  3447 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.915611  3578 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.976917  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.009855  3577 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:58.015151  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.015946  3392 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.016726  3392 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.001390  3361 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:01:58.001811  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 43) took 1773 ms. Trace:
I20260709 13:01:58.018831  1606 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.976143  3410 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:57.985998  3391 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.013289  3573 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:01:58.024856  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 101911us
I20260709 13:01:58.021816  1528 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:01:57.948786  2211 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:58.025952  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.023092  1609 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:58.027206  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:57.976193  3568 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:01:58.028762  3564 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.029563  3579 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:57.948249  1607 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:57.965770  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:57.999470  3586 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
I20260709 13:01:58.027705  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.953778  1678 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.024639  3419 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.032723  1678 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.023830  3578 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.033831  1678 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:58.034940  1678 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.951576   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:58.032867  1528 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:57.961138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:57.995117  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.960929  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:57.947984  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.911952  3530 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.041899  3530 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.048010  2930 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.048413  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.012418  1526 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:58.052556  1602 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:01:58.053341  1602 pending_rounds.cc:85] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 3
I20260709 13:01:58.053817  1602 pending_rounds.cc:107] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:58.054128  1602 raft_consensus.cc:2889] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.040673  1534 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:58.053298  1608 pending_rounds.cc:85] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 3
I20260709 13:01:58.056298  1608 pending_rounds.cc:107] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:58.056517  1601 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:57.954195  1676 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:57.997069  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:57.990907  1532 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:57.996608  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.057170  1608 raft_consensus.cc:2889] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:58.066882  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70362.9us
I20260709 13:01:58.067875  1498 leader_election.cc:400] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:01:58.014652  1610 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.054666  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.058660  1535 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:01:58.016749  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.061050  1607 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.057456  1601 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:58.068579  1498 leader_election.cc:403] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:01:58.129843  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.152979  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.107672  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.110666  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:58.153682  1528 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.100871  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:01:58.156934  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88362.3us
W20260709 13:01:58.156457  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 303589us
W20260709 13:01:58.157496  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56731.5us
I20260709 13:01:58.158207  1533 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:58.160557  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.158183  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.161372  1534 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:58.161476  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.153913  1526 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.143783  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.164202  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:58.164410  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:58.163221  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 95492.8us
I20260709 13:01:58.153060  3568 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:58.151499  3561 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:58.170028  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.062969  3444 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.019169  1430 rpcz_store.cc:276] 0709 13:01:56.232635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.233130 (+   495us) service_pool.cc:224] Handling call
0709 13:01:58.000975 (+1767845us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:56.685985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:56.686724 (+   739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:56.686779 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:01:56.686797 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:56.687267 (+   470us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:56.687357 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:56.687381 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:56.687731 (+   350us) tablet.cc:701] Row locks acquired
0709 13:01:56.687772 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:01:56.687923 (+   151us) write_op.cc:270] Start()
0709 13:01:56.688090 (+   167us) write_op.cc:276] Timestamp: P: 1783602116687866 usec, L: 0
0709 13:01:56.688383 (+   293us) op_driver.cc:348] REPLICATION: starting
0709 13:01:56.689165 (+   782us) log.cc:844] Serialized 535 byte log entry
0709 13:01:57.015968 (+326803us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4694f6f0ac 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b
0709 13:01:57.432191 (+416223us) op_driver.cc:464] REPLICATION: finished
0709 13:01:57.805025 (+372834us) write_op.cc:301] APPLY: starting
0709 13:01:57.815381 (+ 10356us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:57.838042 (+ 22661us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:57.848772 (+ 10730us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.925414 (+ 76642us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.925695 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:57.925762 (+    67us) write_op.cc:312] APPLY: finished
0709 13:01:57.926073 (+   311us) log.cc:844] Serialized 22 byte log entry
0709 13:01:57.926259 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.926342 (+    83us) write_op.cc:454] Released schema lock
0709 13:01:57.926401 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:57.926832 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.926859 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40198,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":328044,"apply.run_cpu_time_us":2566,"apply.run_wall_time_us":132928,"num_ops":1,"prepare.queue_time_us":183673,"prepare.run_cpu_time_us":27882,"prepare.run_wall_time_us":487615,"raft.queue_time_us":191642,"raft.run_cpu_time_us":43128,"raft.run_wall_time_us":265098,"replication_time_us":735820,"spinlock_wait_cycles":7008640,"thread_start_us":903699,"threads_started":4,"wal-append.queue_time_us":511047}]]}
I20260709 13:01:58.175082  3576 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.151448  3516 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.171442  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.151690  3361 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.178134  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.125656  3392 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.156204  3469 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.184321  3410 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:58.138849  3578 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.181447  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.184289  3561 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:58.163914  3439 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:58.190542  3361 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.166837  3446 raft_consensus.cc:2764] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:58.195894  3581 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:58.166067  3579 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:01:58.205300  3575 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.205700  3410 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.207077  3410 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.207719  3577 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:58.211560  3577 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.212317  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.212599  3577 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.152824  3522 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:01:58.215418  3602 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:58.180910  1532 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
W20260709 13:01:58.189049  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.216490  3569 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.216864  3569 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.217684  3569 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.218374  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.220467  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.220739  1682 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:58.221238  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.221467  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.221781  1676 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.222110  1675 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:58.222347  1528 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:01:58.222602  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.223114  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.224902  1681 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:58.225720  3596 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:58.223942  1683 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:58.227479  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.228528  3460 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.228915  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.229588  1680 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.194085  2211 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.231009  3361 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.059206  3542 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:01:58.166641  3391 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:58.232604  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.233768  1677 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:58.181274  1530 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:58.228932  3460 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.194360  1604 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.179581  3600 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:58.236137  3460 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.236546  3576 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.237025  3600 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.237576  3460 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.237542  3576 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:58.237984  3600 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.241140  1534 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.241605  3382 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.242162  3382 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.165102  1576 leader_election.cc:400] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:01:58.245371  1576 leader_election.cc:403] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.061956  3241 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.196090  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.190352  3582 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:58.188740  3516 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.155871  3583 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:58.202214  1531 raft_consensus.cc:2368] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
W20260709 13:01:58.262300  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 99534.7us
I20260709 13:01:58.204317  1608 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.263213  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.195706  3433 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:58.199918  3561 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.173930  1527 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:58.272383  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.272578  1532 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.273097  1527 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:58.153848  3419 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:58.247108  1606 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:58.249878  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:58.256008  1681 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:01:58.261163  1533 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.202489  3439 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.267122  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.282313  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.185954  3568 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.284529  1676 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:58.244220  3579 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.259310  3582 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.109980  3573 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.259878  3581 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:58.312798  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.312418  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93090.4us
I20260709 13:01:58.315433  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.282079  3596 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.288236  3313 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.329921  2857 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:58.277278  3599 raft_consensus.cc:2764] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:01:58.287952  3439 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:58.358770  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 164408us
I20260709 13:01:58.359529  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.277217  3571 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:01:58.362569  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 99435.3us
I20260709 13:01:58.308166  3582 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.292935  3241 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:58.281620  3391 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:01:58.365382  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.369558  1606 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:01:58.374064  1576 leader_election.cc:400] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:01:58.374751  1576 leader_election.cc:403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.371371  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.304733  3572 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:01:58.382373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.277943  3583 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.308205  3579 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.385300  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.391812  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:01:58.361584  3386 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.386274  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.358250  3576 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.329737  3575 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:01:58.397156  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 89591.3us
I20260709 13:01:58.366458  3382 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:58.376796  3440 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.400475  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.409065  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.385437  3593 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:01:58.413626  1535 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:01:58.394471  3596 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.393924  3313 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:01:58.395035  3564 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:58.367142  3447 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.393674  3573 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.436017  1530 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:58.399792  3591 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.438459  1648 leader_election.cc:400] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6.
I20260709 13:01:58.449424  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.451273  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.440208  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.406040  3446 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.356972  3516 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.459195  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.452530  1676 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:01:58.462955  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.463694  1682 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.435695  3419 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.455673  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.413475  3392 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.458149  1678 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:01:58.487812  1678 pending_rounds.cc:85] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 5
I20260709 13:01:58.415745  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:01:58.488260  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:01:58.472278  3607 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:58.410190  3576 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.474159  3569 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.477830  1528 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.419763  3440 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.454483  3557 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.481284  3361 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.481922  3446 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:58.440656  3382 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.485571  1530 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:58.441351  3564 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.453521  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.509065  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:58.510061  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56659us
I20260709 13:01:58.468263  3447 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.482901  3570 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:58.503659  3578 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.490602  1679 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:58.515755  3599 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.538128  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.538355  3583 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:58.539367  3611 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:01:58.465149  3433 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.511240  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.542670  1648 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:01:58.542991  1648 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.544306  3433 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:58.502375  3601 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:58.492694  3592 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.545604  3592 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.546031  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.515280  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.547192  3570 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.546854  3592 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.548975  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.549997  3570 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:58.550581  3570 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.553071  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.555358  3527 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.551558  3570 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.559275  3599 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.488896  1678 pending_rounds.cc:107] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:01:58.560204  1676 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:58.560412  1678 raft_consensus.cc:2889] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.513630  1682 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:01:58.515374  3564 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.518311  3440 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.555907  3527 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:58.518786  3575 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.520704  3361 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.521428  1532 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.522043  3582 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.522189  3446 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.417405  3581 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.445578  3386 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.540392  3568 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.545053  3433 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:01:58.561451  1676 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.516659  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:58.568637  3575 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.543660  3576 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:58.569387  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.639813  3592 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.582204  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.588201  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.602411  3381 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.606978  3444 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:58.599646  3579 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:58.623507  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.565541  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 248571us
I20260709 13:01:58.630101  1601 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.696782  1601 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:58.648313  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131749us
I20260709 13:01:58.642598  1683 raft_consensus.cc:2368] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:58.626818  3557 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:01:58.670679  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 101346us
I20260709 13:01:58.578317  3542 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.649655  3575 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.678253  1608 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:58.715415  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.715658  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.716135  1526 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:01:58.716166  1535 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.717401  1534 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:58.717818  1534 pending_rounds.cc:85] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 3
I20260709 13:01:58.718098  1534 pending_rounds.cc:107] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:58.718461  1534 raft_consensus.cc:2889] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.674038  3460 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.723162  1608 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:58.725301  1608 pending_rounds.cc:85] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 5
I20260709 13:01:58.725582  1608 pending_rounds.cc:107] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:58.725824  1608 raft_consensus.cc:2889] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.630103  3599 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.676756  3381 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:01:58.732478  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 64078.2us
W20260709 13:01:58.732499  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet e7f600ce14224412994ac233d95d67d1: Illegal state: Replica 36f53e9bfce749bbba4a4b34829f563d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:58.723181  3391 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:01:58.736835  3572 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:58.737350  3391 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:58.729451  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.732586  3614 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:58.766604  1601 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:01:58.771034  1531 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:58.774044  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.778571  1610 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.782076  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:58.782707  1682 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.774767  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.784173  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.784759  1603 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.775416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.792575  1609 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:58.810851  3622 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:01:58.811872  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.812214  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.812785  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.737881  3594 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:58.719720  3542 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:58.814220  1532 raft_consensus.cc:2368] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:58.812348  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.816875  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.818385  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:58.826960  1527 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:58.820868  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:58.829991  1682 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:58.830631  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:58.830432  3594 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.830792  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:01:58.839075  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:58.839695  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.738843  3392 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:01:58.847569  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.844377  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:58.850446  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.851284  1604 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:58.824703  1601 pending_rounds.cc:85] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
I20260709 13:01:58.852876  1601 pending_rounds.cc:107] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:01:58.852598  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.854360  1601 raft_consensus.cc:2889] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.854298  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:58.855671  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 187937us
I20260709 13:01:58.856693  1610 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:58.859978  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:58.840618  3579 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:58.864120  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:01:58.855783  3561 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:01:58.809151  3583 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:01:58.868887  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.868708  3633 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:58.874056  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.894068  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.895220  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.739593  3386 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.875550  1604 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:58.852702  3614 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.904794  1609 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:01:58.887575  1603 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.897202  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.857404  3391 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:58.865422  3578 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:58.860812  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 124582us
I20260709 13:01:58.917976  1574 leader_election.cc:400] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:01:58.927338  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:58.919754  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:01:58.930914  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66995.3us
I20260709 13:01:58.929474  1603 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:01:58.931936  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.935201  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.935420  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.930712  3447 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.937443  3568 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.939019  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.873903  3582 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:58.904292  3451 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:58.940846  3602 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:58.942876  3632 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:01:58.943702  3625 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:58.943811  1607 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.947670  3542 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:58.877998  3579 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:58.912087  3440 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.872907  3570 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:01:58.966123  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:58.995765  1682 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:01:58.969704  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.969360  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:58.981287  1604 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.949472  3446 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.959177  3444 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.911221  3561 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.001368  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.004088  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:01:58.911589  3593 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:01:58.869786  3381 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:58.978161  3469 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.994423  3392 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:58.994654  3568 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:59.012370  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:01:59.001629  3439 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.632s	user 0.003s	sys 0.009s
I20260709 13:01:59.000160  3602 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:59.019330  3469 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:59.021504  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:01:59.016523  3444 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:59.036557  1609 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.999761  3542 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:01:59.073568  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 312654us
I20260709 13:01:59.068759  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
W20260709 13:01:59.080711  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59323us
I20260709 13:01:59.051026  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.082469  1574 leader_election.cc:400] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:01:59.082864  1574 leader_election.cc:403] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.978968  3632 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:59.145895  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63567.8us
I20260709 13:01:59.069437  3469 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.156056  1574 leader_election.cc:400] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:59.065843  3590 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:59.149511  1535 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:01:59.187580  1574 leader_election.cc:403] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.084004  3381 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.052314  3392 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:59.079830  3618 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:59.142791  3621 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.318s	user 0.007s	sys 0.000s
I20260709 13:01:59.124780  3446 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.200688  3618 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:59.022748  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 303344us
I20260709 13:01:59.203161  3392 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:59.207842  3624 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:59.124572  3451 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:01:59.065860  3439 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:59.209231  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53393.7us
I20260709 13:01:59.210595  1682 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:59.191012  3590 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:59.086778  3241 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.193845  3601 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:59.195242  3516 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.214722  3568 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.216096  3313 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:59.075317  3579 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.209831  3446 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:01:59.204095  3638 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:59.189992  3570 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:59.211630  3618 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.270124  1602 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:59.269377  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.277195  1527 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:59.257459  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 172128us
I20260709 13:01:59.264269  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.280665  1534 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.153318  3447 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:01:59.281656  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:59.283968  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:59.267051  3569 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.003s
W20260709 13:01:59.285310  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.285648  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:59.273801  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:59.290020  1526 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:59.070669  3614 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.267443  3446 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.278589  3579 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.292631  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:01:59.287947  3575 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:01:59.293913  1682 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:59.260398  3601 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.257922  3241 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:59.299363  1530 raft_consensus.cc:2376] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8. Re-sending same reply.
I20260709 13:01:59.291086  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:01:59.301517  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.290982  3572 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.286116  2930 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:59.290324  3561 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.314006  1533 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:59.314482  1527 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:01:59.272517  3444 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.319751  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:59.319700  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.262624  3602 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.324151  1528 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:59.317939  3648 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:59.326232  3641 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:59.326812  3641 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.326875  3648 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:59.327304  3641 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.327867  3648 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.329771  3646 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:01:59.331414  3635 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:01:59.331923  3439 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:59.333243  3631 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:01:59.316154  2930 consensus_queue.cc:1243] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:59.336858  3632 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.337553  3615 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.338075  3615 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:59.338792  3564 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.002s
I20260709 13:01:59.339178  3564 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.340286  1683 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:59.306222  3575 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:01:59.304885  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46082.8us
I20260709 13:01:59.308948  3590 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.295056  3555 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:01:59.293466  3454 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:59.318910  3447 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.368253  1675 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:59.314980  3572 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:59.376518  3592 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.004s
I20260709 13:01:59.306044  3636 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.219s
I20260709 13:01:59.431310  3615 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:01:59.433048  3643 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:01:59.434130  3647 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:59.438606  1529 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.411979  3447 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.426819  3572 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.438361  3590 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.471501  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.479992  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.480793  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.463788  3447 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.481583  1527 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:59.483006  3241 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:01:59.480149  3439 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:59.485312  3564 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.486300  3575 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.497407  1679 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
W20260709 13:01:59.504981  3649 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:01:59.510067  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.546428  1680 raft_consensus.cc:606] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:01:59.549242  1680 raft_consensus.cc:614] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.435602  3641 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:59.550439  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1204) took 1326 ms. Trace:
I20260709 13:01:59.554001  1684 rpcz_store.cc:276] 0709 13:01:58.218774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.222861 (+  4087us) service_pool.cc:224] Handling call
0709 13:01:59.545089 (+1322228us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002e90d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:59.545235 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057096064}
W20260709 13:01:59.518049  3647 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:59.513096  3646 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.569540  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.550143  3439 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:59.574456  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.577767  1528 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.565188  3386 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.584499  3386 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.585196  3641 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.586896  3386 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.588639  3469 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.589468  3439 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.590811  3469 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.552385  3618 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.592975  3618 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.570816  3646 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:59.553093  3446 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.594118  3646 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.595101  3446 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.597234  1605 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.598632  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 4 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.600317  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:59.601632  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.602046  3381 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:59.602706  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.600540  1601 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:59.605921  3391 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.606434  3391 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:59.606060  1682 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:01:59.607332  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:59.608770  3657 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:01:59.600342  1431 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 5 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.617708  1534 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:59.603848  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.621070  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:01:59.607309  3391 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.626523  1531 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:59.618111  1431 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 5, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:59.632153  1431 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 7, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.631256  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.641157  1531 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.642328  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:01:59.645514  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.646188  3381 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:59.646960  3381 consensus_queue.cc:1243] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:59.639407  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 5 to 7, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.656237  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.649011  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.614337  3572 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.666756  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.630277  3641 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:59.629987  3446 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.655730  1431 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 7, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:01:59.665423  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.674909  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.676687  1682 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:01:59.683449  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.685001  1610 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:59.688182  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.692296  1603 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:59.693470  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 155) took 4981 ms. Trace:
I20260709 13:01:59.673058  3469 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:59.698760  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.705812  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.707755  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.662904  3672 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:59.717422  1684 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:01:59.718242  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:01:59.718844  1683 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.720026  1682 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.720721  3669 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:59.672802  3386 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:01:59.732396  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46310.8us
I20260709 13:01:59.688326  3561 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.693985  1433 rpcz_store.cc:276] 0709 13:01:54.712750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.714877 (+  2127us) service_pool.cc:224] Handling call
0709 13:01:59.693390 (+4978513us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:57.433011 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:57.433589 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:57.433656 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:01:57.433672 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:57.498560 (+ 64888us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:57.498607 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:57.498656 (+    49us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:57.500180 (+  1524us) tablet.cc:701] Row locks acquired
0709 13:01:57.500198 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:57.500355 (+   157us) write_op.cc:270] Start()
0709 13:01:57.500458 (+   103us) write_op.cc:276] Timestamp: P: 1783602117500310 usec, L: 0
0709 13:01:57.500480 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:57.759609 (+259129us) log.cc:844] Serialized 8293 byte log entry
0709 13:01:57.934096 (+174487us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698074e28 00007f469baaf581 00007f469baaed58 00007f469bab39f1 00007f469bab39a9 00007f469bab3939 00007f469bab3901 00007f469bab2b2d 000000000038f354 000000000038f199
0709 13:01:57.943813 (+  9717us) op_driver.cc:464] REPLICATION: finished
0709 13:01:57.944295 (+   482us) write_op.cc:301] APPLY: starting
0709 13:01:57.944371 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:57.944799 (+   428us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:57.944823 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.947236 (+  2413us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.947568 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:01:57.947626 (+    58us) write_op.cc:312] APPLY: finished
0709 13:01:58.046747 (+ 99121us) log.cc:844] Serialized 144 byte log entry
0709 13:01:58.047798 (+  1051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.049365 (+  1567us) write_op.cc:454] Released schema lock
0709 13:01:58.049434 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.056431 (+  6997us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.056468 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1089340,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":4624,"apply.run_wall_time_us":112061,"num_ops":21,"prepare.queue_time_us":335,"prepare.run_cpu_time_us":10688,"prepare.run_wall_time_us":501279,"replication_time_us":443154,"spinlock_wait_cycles":370850688}]]}
I20260709 13:01:59.728750  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 905) took 1284 ms. Trace:
I20260709 13:01:59.738483  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.731448  1531 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:01:59.732522  1683 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:01:59.740765  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.734611  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.674575  3614 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:59.745985  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.747658  1605 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.736418  3670 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:59.736824  3594 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.721010  1684 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.741910  1610 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:59.738545  1679 rpcz_store.cc:276] 0709 13:01:58.444579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.537795 (+ 93216us) service_pool.cc:224] Handling call
0709 13:01:59.728592 (+1190797us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54003cb4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:59.728696 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162770304}
I20260709 13:01:59.755200  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.756651  3601 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.746876  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.762562  1526 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.774313  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:59.777993  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1206) took 1192 ms. Trace:
I20260709 13:01:59.780732  1610 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.781992  1608 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.778579  1602 rpcz_store.cc:276] 0709 13:01:58.574144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.581807 (+  7663us) service_pool.cc:224] Handling call
0709 13:01:59.765841 (+1184034us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54003093d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:59.766021 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355501824}
I20260709 13:01:59.785008  1604 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 3: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:01:59.786543  1608 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:59.784018  3594 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:01:59.804913  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:59.770491  3439 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:59.816114  3439 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.816547  3439 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:01:59.817534  3439 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.821820  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:59.823098  1610 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:59.809895  3601 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.823974  3601 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:01:59.824236  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:59.824625  3581 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.824997  3581 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:01:59.824851  3601 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.824651  3594 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.826229  3601 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.825965  3581 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.827523  3581 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.811394  3660 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:59.812762  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.813169  3572 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.784727  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:01:59.803018  3447 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.823845  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58454 (request call id 10) took 1425 ms. Trace:
I20260709 13:01:59.844805  1680 rpcz_store.cc:276] 0709 13:01:58.398051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.399013 (+   962us) service_pool.cc:224] Handling call
0709 13:01:59.823647 (+1424634us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003cb4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698073853 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:01:59.823753 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432771456}
W20260709 13:01:59.845561  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.831741  1684 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:59.836073  3381 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:59.841907  3660 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.856202  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:01:59.857365  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:01:59.858119  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.858469  3660 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:01:59.859232  3381 consensus_queue.cc:1243] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:59.862649  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:01:59.877859  1605 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.886842  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.887959  1602 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:01:59.848896  3594 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:01:59.894109  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:01:59.898000  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:01:59.861531  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99794.2us
I20260709 13:01:59.900317  3672 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:01:59.916949  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.920434  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:01:59.921118  1601 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.923283  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:59.920463  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:01:59.929286  1576 leader_election.cc:400] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 2 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 2. Current term is 3.
I20260709 13:01:59.930830  1684 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:59.930369  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.932654  1680 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.934072  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.916780  3670 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:59.938805  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:01:59.916564  3614 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:01:59.942850  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.945448  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.948463  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:59.952191  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.952910  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:59.955657  3361 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.956333  3361 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:01:59.956853  3361 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.960474  3628 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:59.961172  3628 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:01:59.962175  3628 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:01:59.964352  3573 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.964922  3682 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:59.935201  2930 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.968652  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:01:59.941171  3561 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.985487  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.989741  3685 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.992378  3469 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.995344  3313 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:00.009254  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.950335  3590 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.021442  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:01:59.954722  3447 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:00.012274  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43755.9us
I20260709 13:01:59.953303  3593 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.942190  3614 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.013954  3668 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.979619  3684 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.014760  3386 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.062011  1526 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:00.063568  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78198.2us
I20260709 13:02:00.070752  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:01:59.931205  3672 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:01:59.952666  3527 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.009773  2930 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.083007  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 130889us
I20260709 13:01:59.943153  3670 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.102490  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.074524  3382 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:00.124724  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:00.086794  3447 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.114243  3614 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.116765  3669 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:00.163635  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.155997  3577 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.060817  3684 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:00.163098  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 870) took 1351 ms (client timeout 1608 ms). Trace:
I20260709 13:02:00.114622  3668 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:02:00.172586  1533 rpcz_store.cc:269] 0709 13:01:58.811551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.812118 (+   567us) service_pool.cc:224] Handling call
0709 13:02:00.162916 (+1350798us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54000dc354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:00.163042 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076986624}
I20260709 13:02:00.161731  3581 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.157351  3593 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:02:00.185546  1680 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:00.184443  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:00.161968  3382 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.187707  3646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.020s	sys 0.045s
I20260709 13:02:00.183557  3561 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.176779  3381 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:00.169700  3669 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.203919  3381 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.196557  3646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.020s	sys 0.045s
I20260709 13:02:00.186061  3614 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:00.191742  3469 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:00.220067  3469 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.217618  3672 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.218051  2930 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.217674  3561 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:00.174183  3699 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:02:00.179292  3683 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:00.219365  3684 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:00.210952  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86330.1us
I20260709 13:02:00.178977  3581 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.237378  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.196096  3593 consensus_queue.cc:1243] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:00.238942  1684 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:00.239135  3581 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.232291  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:00.234513  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:00.223062  3381 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.235625  3561 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.236562  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:00.223330  3703 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:00.227931  3694 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:00.245136  3669 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:00.247036  3696 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:02:00.243455  3593 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.249596  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.250260  3382 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.251477  3670 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.255450  3447 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:00.265038  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.252835  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1223) took 1469 ms. Trace:
I20260709 13:02:00.266999  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.254266  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.254954  3684 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.269670  3381 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.259825  1602 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:00.261108  3593 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:00.261314  3704 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:00.275877  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.279429  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:00.281456  1430 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.276520  3711 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:00.277323  2930 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:00.283798  3419 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.284103  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:00.286353  3577 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.266410  1676 rpcz_store.cc:276] 0709 13:01:58.783230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.010955 (+227725us) service_pool.cc:224] Handling call
0709 13:01:59.015504 (+  4549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.046073 (+ 30569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.046124 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.921825 (+875701us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:01:59.929015 (+  7190us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.111037 (+182022us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:00.151786 (+ 40749us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.155347 (+  3561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.158845 (+  3498us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.252576 (+ 93731us) raft_consensus.cc:1685] finished
0709 13:02:00.252674 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.252783 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13117,"prepare.queue_time_us":40476,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":2396,"raft.queue_time_us":37886,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":34607,"spinlock_wait_cycles":46375808,"thread_start_us":160933,"threads_started":1,"wal-append.queue_time_us":236508}
I20260709 13:02:00.289460  3642 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:00.336529  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.292203  2857 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:00.337800  2857 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.293212  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80559.3us
I20260709 13:02:00.293111  1678 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:00.270566  3381 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.298177  3610 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:00.297161  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:00.311585  3695 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:02:00.317222  3527 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.322664  3701 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.326845  1604 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.328197  3669 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:02:00.350730  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:00.272058  3593 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.359351  1604 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:00.331974  1430 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.345091  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:00.346925  1679 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:00.347927  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:00.272526  3361 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.348083  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:00.354498  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57428.7us
I20260709 13:02:00.355783  2857 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.349907  3555 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.365135  2857 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:00.365641  2857 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:00.365891  3662 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.782s	user 0.004s	sys 0.000s
I20260709 13:02:00.365979  2857 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.366628  3361 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.368857  1679 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.369410  1679 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:00.369832  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.370314  1679 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.373255  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.375978  1679 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.337348  3577 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.374267  3716 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.385682  3392 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.344199  3419 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.374706  3711 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.387380  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:00.358500  3701 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.371073  3381 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.374058  3715 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.397989  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:00.397507  1604 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.387957  3241 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:00.407606  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:00.411305  1683 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:00.408349  3717 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:02:00.413383  3530 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.413818  3530 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.388181  3581 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.414178  3530 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.415829  1604 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.405618  3469 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:00.418859  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.371997  3646 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:00.396871  3392 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:00.379181  3555 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:00.408676  3381 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:00.449108  3577 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.427326  2857 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.461709  3444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.022s	sys 0.059s
I20260709 13:02:00.457620  1679 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:00.465183  1679 pending_rounds.cc:85] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 3
I20260709 13:02:00.465428  1679 pending_rounds.cc:107] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:00.465647  1679 raft_consensus.cc:2889] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:00.468784  2857 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.449844  3581 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.471479  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:00.480149  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.482511  1604 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:00.483785  2857 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.484246  2857 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.462275  3444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.022s	sys 0.059s
I20260709 13:02:00.462893  3573 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.487516  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:00.429112  3715 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.490248  3601 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:00.493495  3601 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.488734  3440 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:00.489439  3381 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.490545  1499 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:00.477298  3392 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.501411  2857 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.471263  3610 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:00.500223  3381 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.485743  3581 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.536927  3419 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:00.538127  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 47672us
W20260709 13:02:00.540421  3719 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 13:02:00.557585  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:00.558465  1531 raft_consensus.cc:606] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.541512  3720 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.563726  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1217) took 2278 ms. Trace:
I20260709 13:02:00.564303  3601 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.564196  1681 rpcz_store.cc:276] 0709 13:01:58.285802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.285929 (+   127us) service_pool.cc:224] Handling call
0709 13:01:58.308476 (+ 22547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:58.313882 (+  5406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.313935 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:58.475521 (+161586us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:01:58.488361 (+ 12840us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.636721 (+148360us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:58.679490 (+ 42769us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.679712 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.679793 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.468174 (+1788381us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18002b6d20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:00.541651 (+ 73477us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b18002b6d20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:00.563443 (+ 21792us) raft_consensus.cc:1685] finished
0709 13:02:00.563466 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.563638 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4860,"prepare.queue_time_us":37807,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3512,"raft.queue_time_us":7059,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":31773,"spinlock_wait_cycles":72437632,"thread_start_us":107949,"threads_started":1,"wal-append.queue_time_us":208993}
I20260709 13:02:00.560564  3392 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.558620  3701 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.624704  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.625799  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:00.626706  1682 raft_consensus.cc:606] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:00.620820  3663 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.001s	user 0.003s	sys 0.000s
I20260709 13:02:00.629570  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.636942  1601 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:00.639838  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.689994  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1180) took 1912 ms. Trace:
I20260709 13:02:00.687850  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.694983  1604 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:00.630007  3577 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.690446  1609 rpcz_store.cc:276] 0709 13:01:58.777767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.906398 (+128631us) service_pool.cc:224] Handling call
0709 13:01:58.931991 (+ 25593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.080194 (+148203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.689722 (+1609528us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b540003b6d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:00.689931 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212226944}
I20260709 13:02:00.697372  1601 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:00.700385  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.703121  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:00.703790  1533 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.696516  3460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.045s	sys 0.077s
I20260709 13:02:00.639600  3715 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:00.692879  3569 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.693653  3578 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.722698  3578 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:00.723675  3590 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.001s
I20260709 13:02:00.724189  3590 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.725014  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:00.725732  1678 raft_consensus.cc:606] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:00.726114  1678 raft_consensus.cc:614] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:00.710397  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:00.712237  1609 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:00.698516  3610 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.721722  3569 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.728194  1602 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:00.713457  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.713063  1531 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:00.730258  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.730551  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:00.745368  1601 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:00.711223  3460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.045s	sys 0.077s
I20260709 13:02:00.725025  3578 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:00.720852  3728 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:00.711566  3581 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.738168  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:00.751783  1682 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:00.752146  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.752427  1682 raft_consensus.cc:614] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:00.739702  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1112) took 1160 ms. Trace:
I20260709 13:02:00.739975  1528 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:00.742547  3439 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.742873  3530 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.744089  3721 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:00.744542  3718 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 13:02:00.727420  3610 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.750242  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:00.749409  3712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.009s
I20260709 13:02:00.774484  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:00.753379  1530 rpcz_store.cc:276] 0709 13:01:59.578858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.616568 (+ 37710us) service_pool.cc:224] Handling call
0709 13:01:59.617003 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:59.617364 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.617391 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:59.618085 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 13:01:59.647333 (+ 29248us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:59.671286 (+ 23953us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.732692 (+ 61406us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.283281 (+550589us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b1800239da0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:00.739254 (+455973us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800239da0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287
0709 13:02:00.739382 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.739460 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.739498 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:00.739510 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.739647 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217130,"prepare.queue_time_us":19161,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":78,"raft.queue_time_us":73074,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":16996,"spinlock_wait_cycles":22428288,"thread_start_us":56967,"threads_started":2,"wal-append.queue_time_us":58072}
I20260709 13:02:00.761337  1609 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:00.775676  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:00.765667  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.746842  1533 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:00.769784  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:00.776683  1604 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:00.776877  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:00.778157  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:00.779057  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.779933  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.756044  3386 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.785317  1533 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:00.787079  1684 raft_consensus.cc:2368] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
I20260709 13:02:00.788194  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:00.789548  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.790302  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:00.774999  3712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.010s
I20260709 13:02:00.762626  3527 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:00.792640  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:00.788614   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:00.799104  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:00.799695  1530 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:00.781549  3672 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.800598  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:00.797593   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:00.785427  3661 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.784650  3720 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:02:00.806268  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1203) took 1185 ms. Trace:
I20260709 13:02:00.784794  3583 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:02:00.805759  3712 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:00.808133  3720 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:00.791361  3581 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:00.808476  3720 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:00.793527  3241 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:00.806655  1603 rpcz_store.cc:276] 0709 13:01:59.620568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.620843 (+   275us) service_pool.cc:224] Handling call
0709 13:01:59.621132 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.693004 (+ 71872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.806033 (+1113029us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b5400085554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:00.806214 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162378624}
I20260709 13:02:00.795014  3381 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.795981  3599 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.800226  3527 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.810952  3720 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.813208  3527 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:00.813467  3564 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:00.801007  3721 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.774109  3578 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:00.810412  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:00.804384  3667 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.208s	user 0.001s	sys 0.003s
I20260709 13:02:00.813953  3564 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:00.808947  3581 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.820115  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 71) took 1343 ms. Trace:
I20260709 13:02:00.808491  3712 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.886428  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:00.928239  3658 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.343s	user 0.000s	sys 0.007s
I20260709 13:02:00.818256  3381 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:00.820160  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 55) took 1608 ms. Trace:
W20260709 13:02:01.027931  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 217579us
I20260709 13:02:00.853710  3720 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.828339  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:01.070693  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 901) took 2627 ms. Trace:
I20260709 13:02:00.824806  3602 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:01.093684  3602 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:01.093945  3660 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:01.095876  3644 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 1.804s	user 0.000s	sys 0.004s
I20260709 13:02:01.094807  3602 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.096638  3602 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.098191  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1231) took 1229 ms. Trace:
I20260709 13:02:01.098546  1605 rpcz_store.cc:276] 0709 13:01:59.868889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.869019 (+   130us) service_pool.cc:224] Handling call
0709 13:01:59.869307 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.878714 (+  9407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.097969 (+1219255us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5400309dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:01.098130 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19035520}
I20260709 13:02:01.100875  3610 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:01.102877  3575 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:01.103518  3572 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:01.104902  3702 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:01.105306  3702 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:01.071455  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1097) took 2356 ms. Trace:
I20260709 13:02:01.106070  3702 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.107103  3702 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:01.072660  1530 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:01.096649  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.110152  1531 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:01.072490  1677 rpcz_store.cc:276] 0709 13:01:59.476639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.476829 (+   190us) service_pool.cc:224] Handling call
0709 13:01:59.477292 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.477646 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.477673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.478092 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.566604 (+ 88512us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:59.566653 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.566735 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.803821 (+1237086us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:00.819810 (+ 15989us) raft_consensus.cc:1685] finished
0709 13:02:00.819830 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.820056 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":667,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6824,"spinlock_wait_cycles":44894976,"thread_start_us":86249,"threads_started":1,"wal-append.queue_time_us":118198}
I20260709 13:02:01.082374  1535 rpcz_store.cc:276] 0709 13:01:59.211844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.212016 (+   172us) service_pool.cc:224] Handling call
0709 13:01:59.212481 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.469267 (+256786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.469525 (+   258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.473594 (+  4069us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.561542 (+ 87948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:59.561585 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.819757 (+1258172us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540017ff54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:00.819802 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.819846 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:00.819858 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.820086 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52432,"raft.queue_time_us":106931,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":26402,"spinlock_wait_cycles":248315136,"thread_start_us":173307,"threads_started":2,"wal-append.queue_time_us":196081,"wal-append.run_cpu_time_us":2121,"wal-append.run_wall_time_us":1023491}
I20260709 13:02:01.090653  1675 rpcz_store.cc:276] 0709 13:01:58.443230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.554335 (+111105us) service_pool.cc:224] Handling call
0709 13:01:58.554726 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.422588 (+867862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.962299 (+1539711us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b5400140854. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:01.070628 (+108329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818763008}
I20260709 13:02:01.106679  1529 rpcz_store.cc:276] 0709 13:01:58.714726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.716243 (+  1517us) service_pool.cc:224] Handling call
0709 13:01:58.729610 (+ 13367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.444749 (+715139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.963972 (+1519223us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54000fad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:01.071382 (+107410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629533952}
I20260709 13:02:00.905721  3652 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.141053  3577 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:01.147645  3392 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 13:02:01.161115  3530 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:01.159592  3721 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:01.494858  3733 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.656s	user 0.000s	sys 0.002s
I20260709 13:02:01.256115  3564 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:01.699203  1675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.010s
W20260709 13:02:01.720010  1675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.001s	sys 0.011s
W20260709 13:02:01.717998  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 889713us
I20260709 13:02:01.725661  3564 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.719018  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1120) took 2045 ms. Trace:
I20260709 13:02:01.734040  1528 rpcz_store.cc:276] 0709 13:01:59.673442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.823272 (+149830us) service_pool.cc:224] Handling call
0709 13:02:00.739632 (+916360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.753420 (+ 13788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.718797 (+965377us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54000dd750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:01.718956 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106778496}
I20260709 13:02:01.744532  3712 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:01.773725  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 894) took 1068 ms. Trace:
W20260709 13:02:01.774259  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.775074  1528 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:01.820129  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 59) took 1046 ms. Trace:
I20260709 13:02:01.820770  1528 rpcz_store.cc:276] 0709 13:02:00.773525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.735381 (+961856us) service_pool.cc:224] Handling call
0709 13:02:01.774670 (+ 39289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.819704 (+ 45034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.820045 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.771672  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 663010us
I20260709 13:02:01.835186  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:01.780206  1534 rpcz_store.cc:276] 0709 13:02:00.705328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.101613 (+396285us) service_pool.cc:224] Handling call
0709 13:02:01.101918 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.102112 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:01.102464 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.773245 (+670781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.773416 (+   171us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:01.773464 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.773535 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.773666 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":585,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":392517,"threads_started":1,"wal-append.queue_time_us":639720}
W20260709 13:02:01.767351  3736 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.679s	user 0.001s	sys 0.001s
I20260709 13:02:01.702637  3381 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:01.760386  3628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.002s
I20260709 13:02:01.859273  3527 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:01.847750  3581 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:01.859936  3527 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.848943  1534 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:01.863695  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1130) took 1089 ms. Trace:
I20260709 13:02:01.863325  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:01.864114  1534 rpcz_store.cc:276] 0709 13:02:00.774052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.847246 (+1073194us) service_pool.cc:224] Handling call
0709 13:02:01.848472 (+  1226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.863420 (+ 14948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.863634 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.866000  1534 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:01.858423  3577 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:01.866772  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1131) took 1092 ms. Trace:
I20260709 13:02:01.866677  3577 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.867223  1534 rpcz_store.cc:276] 0709 13:02:00.774327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.865335 (+1091008us) service_pool.cc:224] Handling call
0709 13:02:01.865671 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.866506 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.866722 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.868844  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1132) took 1094 ms. Trace:
W20260709 13:02:01.869485  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.869256  1534 rpcz_store.cc:276] 0709 13:02:00.774581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.868023 (+1093442us) service_pool.cc:224] Handling call
0709 13:02:01.868365 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.868538 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.868565 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.868606 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.868633 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.868680 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.868795 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.870883  1534 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:01.871498  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1138) took 1078 ms. Trace:
I20260709 13:02:01.871953  1534 rpcz_store.cc:276] 0709 13:02:00.793113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.870424 (+1077311us) service_pool.cc:224] Handling call
0709 13:02:01.870729 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.871249 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.871450 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.860792  3628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.010s	sys 0.002s
I20260709 13:02:01.851432  3530 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:01.857919  3241 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.862676  3702 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.008s
I20260709 13:02:01.877609  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:01.863998  3381 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:01.876608  3581 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:01.899536  1530 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:01.901695  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 897) took 1195 ms. Trace:
I20260709 13:02:01.902297  1530 rpcz_store.cc:276] 0709 13:02:00.706576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.752023 (+1045447us) service_pool.cc:224] Handling call
0709 13:02:01.898998 (+146975us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:01.899291 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.901322 (+  2031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.901611 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33753984}
I20260709 13:02:01.888923  3712 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.879828  3530 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.881757  3241 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.893635  3591 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.896304  3652 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.902523  3581 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.951020  3527 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:01.953495  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75975.9us
I20260709 13:02:01.931660  3591 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.972929  3381 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:01.982466  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.973012  3527 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.977028  3710 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.949805  3577 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:01.985982  3746 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:01.958845  3712 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.973227  3652 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.979516  3716 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.048512  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1215) took 1412 ms. Trace:
I20260709 13:02:01.979879  3747 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.050598  1607 rpcz_store.cc:276] 0709 13:02:00.636166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.636654 (+   488us) service_pool.cc:224] Handling call
0709 13:02:00.636907 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.637096 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:00.637326 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.047997 (+1410671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.048091 (+    94us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.048152 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.048257 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.048433 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1347871,"prepare.queue_time_us":973,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":62355,"threads_started":1,"wal-append.queue_time_us":164721}
I20260709 13:02:01.985397  3685 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:02.065404  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.067773  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.036430  3577 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:02.074810  3577 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:02.069797  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:01.989405  3444 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:01.990152  3381 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:01.989085  3527 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.061622  3742 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:01.990886  3710 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.048203  3712 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.079571  3753 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.084372  3460 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:02.082144  3561 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.048470  3652 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.037621  3746 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:02.086400  3713 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.739s	user 0.008s	sys 0.019s
I20260709 13:02:02.062599  3716 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.082363  3444 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.129097  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1129) took 1355 ms. Trace:
W20260709 13:02:02.129236  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 59597.9us
I20260709 13:02:02.073573  3439 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.069809  3748 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.066674  3745 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.145823  3447 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.110689  3715 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:02.153867  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 171405us
I20260709 13:02:02.150694  1528 rpcz_store.cc:276] 0709 13:02:00.773806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.822221 (+1048415us) service_pool.cc:224] Handling call
0709 13:02:01.822662 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.823073 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:01.953483 (+130410us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.128623 (+175140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.128725 (+   102us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:02.128791 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.128895 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.129036 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149216,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"thread_start_us":289270,"threads_started":3,"wal-append.queue_time_us":117173}
I20260709 13:02:02.180712  1601 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:02.067070  3747 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.264629  3759 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.154318  3451 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.264848  3756 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.181294  3745 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.080161  3754 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:02:02.146831  3753 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.154454  3446 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.156579  3752 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.266955  3712 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.071993  3685 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.149752  3755 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.285552  3460 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.285517  3451 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:02.286851  3750 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:02:02.093546  3742 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.289861  3746 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.280618  3759 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.151075  3701 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:02.284909  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 123492us
I20260709 13:02:02.152635  3590 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.155109  3241 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.160466  3748 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.154204  3646 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:02.152971  3714 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.150967  3439 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.298931  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1123) took 2566 ms. Trace:
I20260709 13:02:02.181684  3530 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.148437  3561 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.295701  3581 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.291107  3577 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:02.269013  3447 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.279234  3715 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.325591  1605 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:02.308563  3712 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.306185  3752 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.321370  1607 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:02.335482  1603 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:02.369174  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:02.369782  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.370543  1605 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.372278  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.372424  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.373942  1680 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:02.370270  1676 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:02:02.329811  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.622s (SENT) [suppressed 20 similar messages]
I20260709 13:02:02.311712  3469 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.331557  3241 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.331498  3591 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.319548  3593 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.331422  3590 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.309854  3761 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.319804  3684 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.381245  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.479519  1676 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:02.319841  3702 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.331764  3760 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:02.330929  3564 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:02:02.331933  1527 rpcz_store.cc:276] 0709 13:01:59.732164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.045285 (+313121us) service_pool.cc:224] Handling call
0709 13:02:00.045684 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.053281 (+  7597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.053336 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.061847 (+  8511us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.195692 (+133845us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:00.195735 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.195806 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.085786 (+1889980us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:02.292254 (+206468us) raft_consensus.cc:1685] finished
0709 13:02:02.292277 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.298841 (+  6564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7090,"raft.queue_time_us":14346,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3768,"spinlock_wait_cycles":3309440,"thread_start_us":73984,"threads_started":1,"wal-append.queue_time_us":251845}
I20260709 13:02:02.395524  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.384490  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.383913  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.530128  1683 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:02:02.410499  3712 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.319756  3762 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:02.411721  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86742.2us
I20260709 13:02:02.423275  1681 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:02.412127  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.313560  3460 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.300170  3756 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.332152  1601 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:02.334980  3748 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.336480  3439 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.480908  1605 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:02.582357  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.583209  1605 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:02.584975  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.585976  1609 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:02.412379  3469 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:02.424834  3241 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.336697  3714 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.621428  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.622229  1605 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:02.504092  3684 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.632789  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:02.335311  3753 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.331561  3646 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:02.349937  3747 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.334338  3451 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.427000  3530 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.382434  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1127) took 2519 ms. Trace:
I20260709 13:02:02.538942  3771 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.412290  3764 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:02.336916  3628 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:02:02.468262  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:02.330302  3701 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.627858  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.469043  3593 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.304522  3446 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.321741  3757 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:02.636891  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 102939us
I20260709 13:02:02.529191  3702 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.635391  1526 rpcz_store.cc:276] 0709 13:01:59.862892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.100105 (+237213us) service_pool.cc:224] Handling call
0709 13:02:00.153361 (+ 53256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.179047 (+ 25686us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:00.179305 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.186808 (+  7503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.186860 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:00.186905 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.284360 (+ 97455us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18000f2920. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:00.286146 (+  1786us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b18000f2920. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:02.382189 (+2096043us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:02.382239 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.382373 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15948,"prepare.queue_time_us":2610,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":7683,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3684,"spinlock_wait_cycles":86237056}
I20260709 13:02:02.309701  3755 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.666136  3746 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:02.666996  3742 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.666901  3746 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:02.669489  3460 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.671409  3561 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.673707  3684 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.628939  3710 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.635628  3618 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.680342  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.638322  1675 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:02.618891  3591 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.643544  1601 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:02.503305  3761 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.619045  3652 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.540107  3760 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.640578  3530 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.651921  3766 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.653414  3745 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.654858  3752 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.655435  3716 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.656059  3469 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:02.619709  3527 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.658042  3685 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.659575  3712 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.704149  1602 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:02.734128  1607 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:02.639051  3764 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:02.823565  3391 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.699591  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:02.846246  3591 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.823899  3593 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.845810  3618 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.848327  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.927241  1609 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
W20260709 13:02:02.851436  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 206928us
I20260709 13:02:02.929538  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:02.930311  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.016s	sys 0.090s
W20260709 13:02:02.930639  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.016s	sys 0.090s
I20260709 13:02:02.822404  3714 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.846607  3776 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.696089  3241 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.703328  3446 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:02.853858  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 312395us
I20260709 13:02:02.813457  3646 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:02.813849  3768 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.697263  3746 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:02.752785  3444 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.684334  3759 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.859162  3652 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:02.876873  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.841637  3755 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.650729  3757 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.859750  3702 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.896317  3439 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.857672  3381 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:02.863209  3451 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:02.918385  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.046s	sys 0.065s
I20260709 13:02:02.862313  3419 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.967103  3419 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.867614  3684 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.968302  3451 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.968859  3684 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.969396  3530 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:02.922564  1648 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.001s	sys 0.034s
W20260709 13:02:02.970211  1648 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.001s	sys 0.034s
I20260709 13:02:02.867609  3440 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.970257  3779 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.970417  3451 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:02.921576  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 436097us
I20260709 13:02:02.930610  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:02.923885  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.848397  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.971058  3451 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.970793  3440 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.860759  3564 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:02:02.935103  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.972195  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.896023  3561 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.923663  3716 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.943994  3685 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.919165  3742 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.950522  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:02.924465  3469 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:02.938841  3460 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:02.971590  3451 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.951848  3701 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.961455  3652 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.952962  3446 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:02.953285  3756 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:02.965462  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.047s	sys 0.065s
I20260709 13:02:02.954195  3646 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.969518  3419 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.859274  3766 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:02.972922  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 643078us
I20260709 13:02:03.008471  1601 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 2.
I20260709 13:02:03.018571  3469 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.037768  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:02.965134  3439 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.017668  3760 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.017102  3742 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.009148  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44518.4us
I20260709 13:02:02.938587  3754 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:02.965987  3764 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.016057  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65648.6us
I20260709 13:02:02.682016  3771 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.970916  3779 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.014755  3787 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:02:03.018644  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88094.7us
I20260709 13:02:02.970846  3684 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:02.940116  3776 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.027900  3761 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.014068  3561 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.017592  3716 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:02.962046  3768 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.012519  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.341729  3451 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:03.353976  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.163899  3440 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.355477  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:03.384159  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1246) took 1058 ms. Trace:
I20260709 13:02:03.037031  3714 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.337s
W20260709 13:02:03.162588  3791 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:03.356765  1601 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:03.158638  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 895) took 2452 ms. Trace:
I20260709 13:02:03.042158  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.036440  3446 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.400218  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 358097us
I20260709 13:02:03.034236  3786 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:03.367305  1609 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:03.404975  3716 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.405268  3592 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:03.405611  3573 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:03.406853  3561 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.030164  3530 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.017287  3784 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.371335  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:03.352419  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 319266us
I20260709 13:02:03.340502  3591 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.030848  3460 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:03.373569  1610 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:02:03.039784  3757 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.149816  3792 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.080107  3618 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.379397  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1242) took 1057 ms. Trace:
I20260709 13:02:03.415895  1602 rpcz_store.cc:276] 0709 13:02:02.322085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.322258 (+   173us) service_pool.cc:224] Handling call
0709 13:02:02.322527 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.919806 (+597279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.379048 (+459242us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54003093d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:03.379315 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876345728}
I20260709 13:02:03.406775  3786 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.046599  3752 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.363799  3764 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.384729  1608 rpcz_store.cc:276] 0709 13:02:02.325664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.325791 (+   127us) service_pool.cc:224] Handling call
0709 13:02:02.326128 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:02.326580 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.326618 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:02.386806 (+ 60188us) log.cc:844] Serialized 52 byte log entry
0709 13:02:02.817511 (+430705us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:02.817558 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.817640 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.383899 (+566259us) raft_consensus.cc:1685] finished
0709 13:02:03.383923 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.384071 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5827,"raft.queue_time_us":249434,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":27933,"thread_start_us":311327,"threads_started":1,"wal-append.queue_time_us":404963}
I20260709 13:02:03.422973  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.017401  3685 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.393504  3419 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:03.426079  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:03.067512  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 443ffcfd9be74d9891a8cb9596947ca3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:03.401189  3690 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:03.402122  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:03.402462  3771 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.403028  3766 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.403213  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:03.384873  3440 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:03.403687  3652 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.040191  3646 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.408844  1604 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:03.408778  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.427870  3690 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.411514  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.410745  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.399505  1531 rpcz_store.cc:276] 0709 13:02:00.705926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.106955 (+401029us) service_pool.cc:224] Handling call
0709 13:02:01.109709 (+  2754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.110619 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.158310 (+2047691us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b54000fb750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:03.158542 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5585792}
I20260709 13:02:03.385753  3760 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.417474  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.379793  3768 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.418385  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.407601  3530 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.409538  3784 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:03.394104  3779 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.426528  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:03.483039  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56624.1us
I20260709 13:02:03.484679  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:03.427057  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 390330us
W20260709 13:02:03.490657  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.491252  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.431318  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.433935  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.492195  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:03.439249  3685 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.440474  3440 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:03.441576  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1261) took 1063 ms. Trace:
I20260709 13:02:03.442221  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.456296  3776 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.416878  3788 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:02:03.451236  1602 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:03.452035  3444 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.452930  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:03.454144  3391 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
I20260709 13:02:03.419976  3752 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:03.458911  3530 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.417371  3792 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.525679  1532 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:02:03.037025  3593 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.341s
I20260709 13:02:03.443816  3241 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.528417  3241 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.527894  3440 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.528935  3241 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:03.495167  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53049.7us
I20260709 13:02:03.445597  3690 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.532605  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:03.494877  1675 rpcz_store.cc:276] 0709 13:02:02.378434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.835786 (+457352us) service_pool.cc:224] Handling call
0709 13:02:02.836299 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.862102 (+ 25803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.862151 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.900557 (+ 38406us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.962297 (+ 61740us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.962336 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.962403 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.441359 (+478956us) raft_consensus.cc:1685] finished
0709 13:02:03.441388 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.441520 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21923,"raft.queue_time_us":22218,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":95,"thread_start_us":23839,"threads_started":1,"wal-append.queue_time_us":103606}
I20260709 13:02:03.514866  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.522248  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.543975  1605 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:03.547827  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:01.861159   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:03.560645  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45878us
I20260709 13:02:03.495474  3768 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.485837  3784 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.498610  3757 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.577015  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.581173  1604 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:03.513906  3564 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.513522  3766 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.521546  3444 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.588018  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 55528.2us
I20260709 13:02:03.591746  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:03.593734  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.595796  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.485321  3760 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.558013  3391 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:03.598213  3792 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.598389  3661 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.598829  3661 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.582187  3768 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.599375  3661 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.444379  3460 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.598266  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1260) took 3104 ms (client timeout 2075 ms). Trace:
I20260709 13:02:03.546353  3527 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.606295  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 946) took 1229 ms. Trace:
W20260709 13:02:03.607287  1684 rpcz_store.cc:269] 0709 13:02:00.470961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.486215 (+ 15254us) service_pool.cc:224] Handling call
0709 13:02:03.575189 (+3088974us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003cafd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:03.575376 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678494464}
W20260709 13:02:03.611217  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1134) took 2828 ms (client timeout 2048 ms). Trace:
I20260709 13:02:03.611449  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:03.611649  1533 rpcz_store.cc:269] 0709 13:02:00.775457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.776657 (+  1200us) service_pool.cc:224] Handling call
0709 13:02:03.603506 (+2826849us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b540003fa54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:03.603673 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17914112}
I20260709 13:02:03.609436  1678 rpcz_store.cc:276] 0709 13:02:02.376960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.551134 (+174174us) service_pool.cc:224] Handling call
0709 13:02:03.605336 (+1054202us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:03.605614 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.605870 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.605907 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.605961 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:03.606005 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.606080 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.606216 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6989696}
I20260709 13:02:03.614192  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.612988  1529 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:03.580232  3757 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.585178  3564 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.585453  3766 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:03.601563  3444 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.618623  1684 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:03.622392  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1266) took 1242 ms. Trace:
I20260709 13:02:03.622918  1684 rpcz_store.cc:276] 0709 13:02:02.379860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.615948 (+1236088us) service_pool.cc:224] Handling call
0709 13:02:03.618321 (+  2373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.622141 (+  3820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.622330 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.624179  1533 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.616516  1610 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:03.619443  1678 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:03.639462  1531 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:03.639912  1531 pending_rounds.cc:85] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 2
I20260709 13:02:03.639539  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1267) took 1259 ms. Trace:
I20260709 13:02:03.640319  1531 pending_rounds.cc:107] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:03.640601  1531 raft_consensus.cc:2889] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.640323  1678 rpcz_store.cc:276] 0709 13:02:02.380176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.615030 (+1234854us) service_pool.cc:224] Handling call
0709 13:02:03.619235 (+  4205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.639285 (+ 20050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.639483 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.610055  3469 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.645576  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.646286  1531 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:03.614285  3742 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.648186  3591 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.649425  3591 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.649830  3591 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:03.649881  3768 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.620003  3564 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.655485  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 44) took 5381 ms. Trace:
I20260709 13:02:03.656685  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.620249  3757 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.659454  3530 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.676901  1682 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.660084  3575 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:03.660930  3752 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:03.664741  1529 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:03.657984  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 100) took 1334 ms. Trace:
I20260709 13:02:03.666117  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1243) took 1343 ms. Trace:
I20260709 13:02:03.622063  3766 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.687824  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.661567  1430 rpcz_store.cc:276] 0709 13:01:58.274219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.281829 (+  7610us) service_pool.cc:224] Handling call
0709 13:02:03.655363 (+5373534us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:00.367259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:00.405273 (+ 38014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:00.405307 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:00.405331 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:00.413297 (+  7966us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:00.413352 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:00.413383 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:00.413735 (+   352us) tablet.cc:701] Row locks acquired
0709 13:02:00.413758 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:00.413915 (+   157us) write_op.cc:270] Start()
0709 13:02:00.414031 (+   116us) write_op.cc:276] Timestamp: P: 1783602120413871 usec, L: 0
0709 13:02:00.414057 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:02:00.447400 (+ 33343us) log.cc:844] Serialized 918 byte log entry
0709 13:02:00.632498 (+185098us) op_driver.cc:464] REPLICATION: finished
0709 13:02:00.852236 (+219738us) write_op.cc:301] APPLY: starting
0709 13:02:00.886217 (+ 33981us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.943383 (+ 57166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:01.126053 (+182670us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:01.307756 (+181703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:01.338176 (+ 30420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:01.349127 (+ 10951us) write_op.cc:312] APPLY: finished
0709 13:02:01.409077 (+ 59950us) log.cc:844] Serialized 28 byte log entry
0709 13:02:01.494955 (+ 85878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:01.522770 (+ 27815us) write_op.cc:454] Released schema lock
0709 13:02:01.540994 (+ 18224us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:01.677094 (+136100us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:01.702537 (+ 25443us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2390936,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":184748,"apply.run_cpu_time_us":10272,"apply.run_wall_time_us":727533,"mutex_wait_us":57822,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":3782,"prepare.run_wall_time_us":94053,"replication_time_us":208052,"thread_start_us":82051,"threads_started":1}]]}
I20260709 13:02:03.675603  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.689263  1528 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:03.683599  1606 rpcz_store.cc:276] 0709 13:02:02.323900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.324069 (+   169us) service_pool.cc:224] Handling call
0709 13:02:02.324319 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.676632 (+352313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.676678 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.676748 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.676793 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.657643 (+980850us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400100754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:03.657722 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.657905 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809639808}
I20260709 13:02:03.655866  1533 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:03.679798  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.681293  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.684240  1603 rpcz_store.cc:276] 0709 13:02:02.322381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.322883 (+   502us) service_pool.cc:224] Handling call
0709 13:02:02.323128 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.369322 (+ 46194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.665902 (+1296580us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400101154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:03.666063 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28010880}
I20260709 13:02:03.687530  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.695039  1534 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:03.614965  3527 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.700248  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.701154  1606 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:03.703038  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.691406  1526 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 3.
I20260709 13:02:03.705698  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.706367  1529 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:03.707278  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.707906  1530 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:03.710176  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.713277  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.714186  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.714426  1604 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:03.713497  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.715294  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.715806  1534 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:03.678682  3768 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:03.715927  1606 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:03.719871  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1253) took 1390 ms. Trace:
I20260709 13:02:03.745904  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1260) took 1394 ms. Trace:
I20260709 13:02:03.746363  1606 rpcz_store.cc:276] 0709 13:02:02.351710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.715093 (+1363383us) service_pool.cc:224] Handling call
0709 13:02:03.745841 (+ 30748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.746032  1604 rpcz_store.cc:276] 0709 13:02:02.329013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.712978 (+1383965us) service_pool.cc:224] Handling call
0709 13:02:03.719793 (+  6815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.747884  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.749002  1604 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:03.758630  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.758904  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.759383  1604 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:02:03.759579  1529 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:03.760465  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.761173  1534 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:03.762492  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.765192  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.765792  3760 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.767297  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.767449  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.769634  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.763334  1604 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:03.771317  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1250) took 1443 ms. Trace:
I20260709 13:02:03.771763  1604 rpcz_store.cc:276] 0709 13:02:02.327963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.762191 (+1434228us) service_pool.cc:224] Handling call
0709 13:02:03.771242 (+  9051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.772993  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.773860  1604 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:03.777827  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.779148  1606 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:03.713053  3752 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:03.712375  3652 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.782260  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.801167  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.740245  3569 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.720631  3646 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.809811  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.768827  3786 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.817401  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.819599  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.768289  3768 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:03.837620  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.808460  3652 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.840111  1530 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:03.808799  3752 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.846781  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.847838  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.847481  1530 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:03.850941  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.850886  3742 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.852980  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.862490  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.863255  1528 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:03.871277  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.872203  1528 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:03.878782  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.854620  3734 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:03.880561  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 318815us
I20260709 13:02:03.857142  3530 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.858558  3760 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:03.884281  1530 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:03.858752  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 243890us
I20260709 13:02:03.860249  3742 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:03.902298  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.905164  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.873397  3460 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:03.891013  3440 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:03.906764  3527 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.922950  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:03.963821  1530 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:03.932873  3564 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.933745  3799 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:03.935611  3798 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:03.893945  3734 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.938681  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.977222  1601 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:03.978179  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.978819  1601 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:03.941746  3742 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.898630  3530 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:03.946915  3591 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.948129  3715 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.948586  3752 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.948860  3768 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:03.989239  1684 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.950754  3652 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:03.893251  3760 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.951958  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1262) took 1541 ms. Trace:
I20260709 13:02:03.991557  1609 rpcz_store.cc:276] 0709 13:02:02.410157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.928253 (+518096us) service_pool.cc:224] Handling call
0709 13:02:03.951788 (+1023535us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54001c7ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:03.951899 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907366272}
I20260709 13:02:03.954043  3790 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:03.944465  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:03.993229  1605 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.954793  3618 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:03.956147  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1126) took 4106 ms (client timeout 1622 ms). Trace:
I20260709 13:02:03.976552  3720 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:03.958086  3444 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.959137  3690 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.959579  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 947) took 1582 ms. Trace:
I20260709 13:02:03.959345  3784 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:03.961273  1526 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:03.962476  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:03.966742  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 618030us
I20260709 13:02:04.001681  1602 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:03.979774  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:03.987987  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95933.6us
I20260709 13:02:03.903506  3801 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:03.994379  1532 rpcz_store.cc:269] 0709 13:01:59.850091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.893773 (+ 43682us) service_pool.cc:224] Handling call
0709 13:02:03.955943 (+4062170us) spinlock_profiling.cc:243] Waited 3.63 s on lock 0x7b5400440a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:03.956080 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8349619456}
I20260709 13:02:04.007069  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:03.981050  3440 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:03.996582  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.998854  1681 rpcz_store.cc:276] 0709 13:02:02.377266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.541437 (+164171us) service_pool.cc:224] Handling call
0709 13:02:03.958820 (+1417383us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:03.959082 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.959278 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.959304 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.959341 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.959368 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.959419 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.959527 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6091008}
I20260709 13:02:04.007822  1532 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.985646  3763 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.985299  3686 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:04.003669  1601 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:04.005369  1501 leader_election.cc:400] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
I20260709 13:02:04.014997  1501 leader_election.cc:403] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:04.010174  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:03.983091  3798 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.059058  1535 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:03.994232  3618 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:03.983219  3241 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.067339  1527 raft_consensus.cc:2368] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:02:04.068526  3241 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.053634  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.071038  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1255) took 1741 ms. Trace:
I20260709 13:02:04.076367  3786 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:04.081897  3440 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:04.085155  3591 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.002656  3720 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.013221  3661 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.090574  3661 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.091886  1529 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:04.054235  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.018517  1602 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:04.071480  1609 rpcz_store.cc:276] 0709 13:02:02.329543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.070034 (+1740491us) service_pool.cc:224] Handling call
0709 13:02:04.070430 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.070634 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.070671 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.070728 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.070779 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.070848 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.070974 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.994221  3790 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:04.055840  1528 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.974969  3460 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:04.061249  1603 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:04.062956  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46454.2us
I20260709 13:02:04.090605  3690 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.056252  3801 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.094861  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1256) took 1765 ms. Trace:
I20260709 13:02:04.102797  1601 raft_consensus.cc:2410] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:02:04.153874  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 253991us
I20260709 13:02:04.110332  1605 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:04.152463  1602 rpcz_store.cc:276] 0709 13:02:02.329771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.093973 (+1764202us) service_pool.cc:224] Handling call
0709 13:02:04.094281 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.094450 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.094489 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.094548 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.094588 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.094659 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.094795 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.156535  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.157289  1605 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:04.111114  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1248) took 1783 ms. Trace:
I20260709 13:02:04.112499  3766 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.158129  1606 rpcz_store.cc:276] 0709 13:02:02.327384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.808013 (+1480629us) service_pool.cc:224] Handling call
0709 13:02:03.808389 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.812318 (+  3929us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.812366 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.817165 (+  4799us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.964926 (+147761us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.964965 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.965027 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.110900 (+145873us) raft_consensus.cc:1685] finished
0709 13:02:04.110920 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.111059 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3294,"raft.queue_time_us":7303,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5733,"thread_start_us":104910,"threads_started":1,"wal-append.queue_time_us":223429}
I20260709 13:02:04.161092  1532 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:04.162386  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.163179  1532 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:04.163236  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.164402  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.165170  1677 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:04.166349  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.167059  1677 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:04.113092  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1265) took 1733 ms. Trace:
I20260709 13:02:04.169656  1675 rpcz_store.cc:276] 0709 13:02:02.379573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.569276 (+1189703us) service_pool.cc:224] Handling call
0709 13:02:03.569855 (+   579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.862014 (+292159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.862043 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.862496 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.977016 (+114520us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.977055 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.977141 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.112833 (+135692us) raft_consensus.cc:1685] finished
0709 13:02:04.112859 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.113022 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101755,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8183,"thread_start_us":405717,"threads_started":2,"wal-append.queue_time_us":216103}
I20260709 13:02:04.114446  3757 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.117595  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.057068  3763 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.119805  3802 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:04.065482  3686 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.121027  3720 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.133211  3790 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.136245  3760 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.138260  3444 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:03.982427  3799 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:03.991189  3530 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:04.104523  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1257) took 1774 ms. Trace:
I20260709 13:02:04.140023  3784 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.141629  3734 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.146833  3460 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:04.242238  3801 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.177817  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.188441  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.271514  1678 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:04.189625  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 101) took 1704 ms. Trace:
I20260709 13:02:04.189682  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.272312  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:04.153055  3805 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.161s	user 0.004s	sys 0.000s
W20260709 13:02:04.198525  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1259) took 1866 ms (client timeout 1607 ms). Trace:
W20260709 13:02:04.277333  1607 rpcz_store.cc:269] 0709 13:02:02.332016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.372005 (+ 39989us) service_pool.cc:224] Handling call
0709 13:02:04.198276 (+1826271us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400247f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:04.198435 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830247680}
I20260709 13:02:04.192106  3440 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:02:04.188218  3690 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.204103  1534 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:04.204937  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:04.144181  3798 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.228274  1609 rpcz_store.cc:276] 0709 13:02:02.330002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.094880 (+1764878us) service_pool.cc:224] Handling call
0709 13:02:04.103843 (+  8963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.104093 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.104129 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.104185 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.104228 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.104305 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.104450 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.283820  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:04.176887  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.229669  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.288090  1681 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:04.288220  1526 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:02:04.142518  3564 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.172829  3361 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
W20260709 13:02:04.239619  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.171950  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.148437  3575 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:02:04.192322  3768 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:02:04.227105  3765 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:04.148257  3591 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:02:04.268164  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.227721  3720 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:04.306241  3765 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.306514  3720 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:04.273043  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 83428.2us
I20260709 13:02:04.308552  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.308933  3765 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.290107  3778 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:04.310074  3778 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:04.310586  3778 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.310370  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.272750  1602 rpcz_store.cc:276] 0709 13:02:02.485083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.188954 (+1703871us) service_pool.cc:224] Handling call
0709 13:02:04.189196 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.189347 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.189368 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.189406 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:04.189433 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.189481 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.189573 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.312254  3715 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.312757  3715 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.313215  3715 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.314602  3593 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:04.316485  3593 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.316695  1602 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:04.316982  3593 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.317554  3593 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.317585  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1238) took 1360 ms. Trace:
I20260709 13:02:04.318233  1602 rpcz_store.cc:276] 0709 13:02:02.956976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.312048 (+1355072us) service_pool.cc:224] Handling call
0709 13:02:04.316472 (+  4424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.317290 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.317517 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.321274  3720 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.323203  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.323987  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:02:04.324414  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.325008  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.326589  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.327296  1532 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:04.275516  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.328224  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1244) took 1294 ms. Trace:
W20260709 13:02:04.280836  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 76019.9us
I20260709 13:02:04.328713  1602 rpcz_store.cc:276] 0709 13:02:03.033438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.319179 (+1285741us) service_pool.cc:224] Handling call
0709 13:02:04.319522 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.319740 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.319778 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.319833 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.319875 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.319940 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.328160 (+  8220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.289386  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:04.332527  1681 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:02:04.243137  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 243838us
I20260709 13:02:04.292117  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.144948  3618 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.293736  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1247) took 1966 ms. Trace:
I20260709 13:02:04.303869  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.335186  1678 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:04.325218  1533 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:04.335680  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.336656  1526 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:04.336391  1604 rpcz_store.cc:276] 0709 13:02:02.327088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.779565 (+1452477us) service_pool.cc:224] Handling call
0709 13:02:03.779961 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.780227 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.982474 (+202247us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.293306 (+310832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.293373 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.293430 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.293516 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.293664 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3605,"prepare.queue_time_us":102175,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1960,"raft.queue_time_us":104,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":19065,"thread_start_us":476278,"threads_started":2}
I20260709 13:02:04.281090  3444 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.343290  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.345026  1675 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:04.346344  1602 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:04.331780  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:04.278993  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:04.350764  1677 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.351627  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:04.353905  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:04.273110  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 364691us
I20260709 13:02:04.327062  3763 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.296020  3690 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.366775  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.369764  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:04.422855  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:04.497351  1677 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:04.449877  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1231) took 1495 ms. Trace:
W20260709 13:02:04.370990  3805 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:04.351397  3444 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.507476  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.362104  3784 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.508312  1678 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:04.363505  3661 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.509977  3766 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.510054  3661 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:04.510703  3661 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.511484  3814 ts_tablet_manager.cc:933] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.507496  3769 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:02:04.515034  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.515724  1678 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:04.375620  3447 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.516592  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.517611  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.447551  3618 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.508224  3444 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.509240  3784 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.519482  3690 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.521572  3784 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.520457  3686 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.518575  1678 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:02:04.520617  3807 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:04.526674  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.527349  1527 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:04.523784  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.523813  3593 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.529122  1604 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.529278  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.529860  1678 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:04.531626  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1275) took 1157 ms. Trace:
I20260709 13:02:04.532001  1604 rpcz_store.cc:276] 0709 13:02:03.374279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.352926 (+978647us) service_pool.cc:224] Handling call
0709 13:02:04.353342 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.529551 (+176209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.531428 (+  1877us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400171bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:04.531574 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403838720}
I20260709 13:02:04.534478  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:04.534814  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 428440us
I20260709 13:02:04.535195  1676 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
W20260709 13:02:04.537065  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 949) took 2159 ms (client timeout 2432 ms). Trace:
W20260709 13:02:04.537400  1676 rpcz_store.cc:269] 0709 13:02:02.377825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.504147 (+126322us) service_pool.cc:224] Handling call
0709 13:02:04.534322 (+2030175us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:02:04.537006 (+  2684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5083008}
I20260709 13:02:04.537727  3446 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.539445  3439 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.541625  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.542804  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.543316  1527 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:04.363591  3746 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.503830  1605 rpcz_store.cc:276] 0709 13:02:02.954863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.172673 (+1217810us) service_pool.cc:224] Handling call
0709 13:02:04.197489 (+ 24816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.197681 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:04.200411 (+  2730us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.449418 (+249007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.449496 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:04.449553 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.449643 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.449801 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29873,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":40,"raft.queue_time_us":95,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5700,"thread_start_us":248600,"threads_started":1}
I20260709 13:02:04.375622  3590 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.619612  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.621122  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1270) took 2240 ms. Trace:
I20260709 13:02:04.621385  1680 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:04.622836  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1262) took 2244 ms. Trace:
I20260709 13:02:04.623335  1680 rpcz_store.cc:276] 0709 13:02:02.378732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.552546 (+173814us) service_pool.cc:224] Handling call
0709 13:02:04.619404 (+2066858us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:02:04.622758 (+  3354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5435648}
I20260709 13:02:04.625205  1680 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:04.591266  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:04.620064  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1272) took 1261 ms. Trace:
I20260709 13:02:04.629047  1603 rpcz_store.cc:276] 0709 13:02:03.358923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.709916 (+350993us) service_pool.cc:224] Handling call
0709 13:02:04.619786 (+909870us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400101154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:04.619974 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803960192}
W20260709 13:02:04.630308  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.048s
W20260709 13:02:04.632256  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.048s
I20260709 13:02:04.634095  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:04.636143  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 589861us
W20260709 13:02:04.642149  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51020.2us
I20260709 13:02:04.621579  1684 rpcz_store.cc:276] 0709 13:02:02.381066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.623657 (+1242591us) service_pool.cc:224] Handling call
0709 13:02:03.639136 (+ 15479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.991108 (+351972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.620842 (+629734us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:04.621053 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804738816}
I20260709 13:02:04.649361  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.651247  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:04.582034  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.023s	sys 0.018s
W20260709 13:02:04.653311  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.023s	sys 0.018s
I20260709 13:02:04.657769  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:04.658581  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.664650  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.667599  1684 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:04.679936  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.666623  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:04.710790  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 400465us
I20260709 13:02:04.534389  3661 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:04.716190  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.656454  3668 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.713281  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.721021  1605 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:04.534503  3778 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.653908  3690 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.667936  3752 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:04.711596  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:04.725108  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48091.7us
I20260709 13:02:04.666468  3564 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:04.732196  3618 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.732229  3564 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.733026  3618 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.733192  3564 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.733628  3618 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.745682  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:04.744936  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.715694  3734 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:04.749653  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.759011  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.714530  3753 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:04.760972  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.023s	sys 0.038s
I20260709 13:02:04.718786  3670 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:04.751394  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:02:04.762194  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.023s	sys 0.038s
I20260709 13:02:04.763612  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.743870  3618 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.765962  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.766214  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.766875  3439 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.767009  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.719695  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:04.767352  3439 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.750655  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 317872us
I20260709 13:02:04.767323  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.773101  1527 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:04.768510  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.768718  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1233) took 1813 ms. Trace:
I20260709 13:02:04.720099  3668 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.767901  3439 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.746235  3752 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.753657  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.758733  3734 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.757210  3590 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.774521  1601 rpcz_store.cc:276] 0709 13:02:02.955534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.190832 (+1235298us) service_pool.cc:224] Handling call
0709 13:02:04.205263 (+ 14431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.205530 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:04.249038 (+ 43508us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.768376 (+519338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.768439 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:04.768483 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.768551 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.768663 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24557,"prepare.queue_time_us":43773,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":989,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":516176,"threads_started":1}
I20260709 13:02:04.785291  3814 tablet_copy_client.cc:323] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:02:04.743898  3564 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:04.790920  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.793852  3564 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.796788  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1264) took 2417 ms. Trace:
I20260709 13:02:04.797369  1682 rpcz_store.cc:276] 0709 13:02:02.379297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.037475 (+658178us) service_pool.cc:224] Handling call
0709 13:02:03.347810 (+310335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.677289 (+329479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.796399 (+1119110us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540040fe54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:04.796698 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756334464}
I20260709 13:02:04.802680  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:04.804394  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:04.815704  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 922) took 1015 ms. Trace:
I20260709 13:02:04.816341  1534 rpcz_store.cc:276] 0709 13:02:03.800568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.800767 (+   199us) service_pool.cc:224] Handling call
0709 13:02:04.815408 (+1014641us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540003e654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:04.815612 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918249728}
I20260709 13:02:04.818397  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.821774  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.822903  1531 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:04.829133  3799 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:04.838500  3530 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:04.851018  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:04.852283  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.853492  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.854625  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:04.855408  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.855702  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.856097  1529 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:04.856602  1533 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:04.787827  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:04.857390  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.858180  1533 raft_consensus.cc:2410] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:04.858371  3773 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:04.858752  3773 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:04.858984  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.859560  3745 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:04.860421  3745 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:04.861613  3745 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:04.864630  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60324.4us
I20260709 13:02:04.866099  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:04.859128  3773 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.853597  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:04.882396  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 900) took 1287 ms. Trace:
I20260709 13:02:04.882999  1535 rpcz_store.cc:276] 0709 13:02:03.595262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.595496 (+   234us) service_pool.cc:224] Handling call
0709 13:02:04.882137 (+1286641us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54000fad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:04.882320 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062803840}
I20260709 13:02:04.883978  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.869895  3757 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:04.874711  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:04.764550  3670 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.876541  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:04.917233  3819 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:02:04.917476  3670 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:04.877616  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 124049us
I20260709 13:02:04.921440  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 948) took 2543 ms. Trace:
I20260709 13:02:04.922046  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:04.921919  1679 rpcz_store.cc:276] 0709 13:02:02.377544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.542192 (+164648us) service_pool.cc:224] Handling call
0709 13:02:04.539006 (+1996814us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:04.539178 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.539356 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:04.540838 (+  1482us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.921021 (+380183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.921082 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.921124 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.921207 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.921382 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43812,"prepare.queue_time_us":1735,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":43664,"spinlock_wait_cycles":4935424,"thread_start_us":337159,"threads_started":1}
W20260709 13:02:04.923523  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 128758us
W20260709 13:02:04.924350  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.925678  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.857127  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.819866  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.770565  3714 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.884583  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:04.767376  3618 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:04.885636  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.887269  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.859715  1533 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:04.890580  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:04.777091  3446 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:04.901078  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:04.777400  3668 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.876958  3590 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.924284  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.042133  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.108403  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 945) took 2732 ms. Trace:
I20260709 13:02:05.487460  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:04.959481  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:05.488421  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 564170us
I20260709 13:02:05.489001  1528 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:05.489600  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1163) took 1422 ms. Trace:
I20260709 13:02:05.489661  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:04.876762  3734 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.281308  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:05.494006  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1234) took 2537 ms. Trace:
I20260709 13:02:05.488555  1675 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:05.025400  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:05.136854  1648 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.622s (SENT)
W20260709 13:02:05.209682  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.013s
I20260709 13:02:05.491811  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1140) took 1510 ms. Trace:
I20260709 13:02:05.508420  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1145) took 1525 ms. Trace:
I20260709 13:02:05.041316  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1288) took 1105 ms. Trace:
W20260709 13:02:05.489909  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.301023  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1236) took 2344 ms. Trace:
I20260709 13:02:05.050449  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1235) took 2094 ms. Trace:
I20260709 13:02:05.509670  1535 rpcz_store.cc:276] 0709 13:02:03.981544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.884122 (+902578us) service_pool.cc:224] Handling call
0709 13:02:05.491453 (+607331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.509828  1533 rpcz_store.cc:276] 0709 13:02:03.982861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.858737 (+875876us) service_pool.cc:224] Handling call
0709 13:02:05.508354 (+649617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.497408  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 60) took 1532 ms. Trace:
I20260709 13:02:05.511219  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.511992  1535 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:05.512492  3446 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.511512  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:05.016837  3823 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:02:05.513060  3446 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.121866  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1266) took 2589 ms. Trace:
I20260709 13:02:05.513950  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1169) took 1391 ms. Trace:
I20260709 13:02:05.510707  1607 rpcz_store.cc:276] 0709 13:02:02.956190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.278565 (+1322375us) service_pool.cc:224] Handling call
0709 13:02:04.278996 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.281282 (+  2286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.281325 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.292144 (+ 10819us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.714100 (+421956us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.714153 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.714252 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.050135 (+335883us) raft_consensus.cc:1685] finished
0709 13:02:05.050167 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.050366 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1773,"raft.queue_time_us":2483,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9128,"spinlock_wait_cycles":1470848,"thread_start_us":364353,"threads_started":1,"wal-append.queue_time_us":743886}
W20260709 13:02:05.514580  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.002s	sys 0.019s
I20260709 13:02:05.013127  3460 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.515139  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.515339  3460 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.516710  1681 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:05.513363  1533 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:05.496274  3790 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.160444  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.519078  1678 raft_consensus.cc:2368] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:05.519735  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:05.520454  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.521095  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:05.042510  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117067us
I20260709 13:02:05.525395  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.526777  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1295) took 1340 ms. Trace:
I20260709 13:02:05.502394  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:04.783221  3752 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.529064  1526 raft_consensus.cc:2376] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9. Re-sending same reply.
W20260709 13:02:05.308853  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.509924  1603 rpcz_store.cc:276] 0709 13:02:03.936376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.630393 (+694017us) service_pool.cc:224] Handling call
0709 13:02:04.630706 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.630939 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:04.666530 (+ 35591us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.040639 (+374109us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.040882 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.040941 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.040997 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.041091 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.041257 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90811,"prepare.queue_time_us":36993,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":75,"raft.queue_time_us":66879,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"thread_start_us":306841,"threads_started":1,"wal-append.queue_time_us":834191}
I20260709 13:02:05.509199  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.527407  1684 rpcz_store.cc:276] 0709 13:02:04.186279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.668644 (+482365us) service_pool.cc:224] Handling call
0709 13:02:04.677422 (+  8778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.714792 (+ 37370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.714821 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.722694 (+  7873us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.108850 (+386156us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.108939 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.109048 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.526531 (+417483us) raft_consensus.cc:1685] finished
0709 13:02:05.526554 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.526710 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34158,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5187,"thread_start_us":335994,"threads_started":1,"wal-append.queue_time_us":767461}
I20260709 13:02:05.531121  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.490015  1528 rpcz_store.cc:276] 0709 13:02:04.067290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.887640 (+820350us) service_pool.cc:224] Handling call
0709 13:02:05.489543 (+601903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.531364  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:05.529842  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1183) took 1191 ms (client timeout 1526 ms). Trace:
I20260709 13:02:05.530169  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:05.533099  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.526831  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.531431  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.535044  1607 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:05.535137  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.536545  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.536986  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:04.987303  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.536136  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:05.538339  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.523392  1605 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:05.514163  1606 rpcz_store.cc:276] 0709 13:02:02.532476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.188136 (+1655660us) service_pool.cc:224] Handling call
0709 13:02:04.188484 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.192638 (+  4154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.192671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.198304 (+  5633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.691050 (+492746us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.730943 (+ 39893us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.731504 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.731599 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.121632 (+390033us) raft_consensus.cc:1685] finished
0709 13:02:05.121650 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.121802 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3782,"prepare.queue_time_us":39674,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":4379,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":7262,"thread_start_us":423281,"threads_started":1,"wal-append.queue_time_us":684575}
W20260709 13:02:05.532471  1526 rpcz_store.cc:269] 0709 13:02:04.338239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.887885 (+549646us) service_pool.cc:224] Handling call
0709 13:02:05.529780 (+641895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816}
I20260709 13:02:05.522346  1609 rpcz_store.cc:276] 0709 13:02:02.956466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.285814 (+1329348us) service_pool.cc:224] Handling call
0709 13:02:04.290973 (+  5159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.291391 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.291431 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.302097 (+ 10666us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.764654 (+462557us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.764781 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.764862 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.300678 (+535816us) raft_consensus.cc:1685] finished
0709 13:02:05.300708 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.300944 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6202,"raft.queue_time_us":546,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":25259,"thread_start_us":331794,"threads_started":1,"wal-append.queue_time_us":859094}
I20260709 13:02:05.514420  1535 rpcz_store.cc:276] 0709 13:02:04.122432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.513173 (+1390741us) service_pool.cc:224] Handling call
0709 13:02:05.513458 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.513633 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.513656 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.513702 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:05.513734 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.513790 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.513899 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.540174  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.540235  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:05.479020  3824 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:04.912948  3686 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.541478  1684 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:05.284672  3784 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.000s
W20260709 13:02:05.462683  3444 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
I20260709 13:02:05.521248  1678 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:05.541016  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.539104  1607 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.509017  1610 rpcz_store.cc:276] 0709 13:02:02.955836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.249322 (+1293486us) service_pool.cc:224] Handling call
0709 13:02:04.282154 (+ 32832us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.282625 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.282665 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:04.294756 (+ 12091us) log.cc:844] Serialized 52 byte log entry
0709 13:02:04.757713 (+462957us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.783226 (+ 25513us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.826212 (+ 42986us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4800240258. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:02:04.899564 (+ 73352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.899674 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.282791 (+383117us) raft_consensus.cc:1685] finished
0709 13:02:05.493504 (+210713us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.493670 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98175,"prepare.queue_time_us":122975,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":20042,"raft.queue_time_us":135337,"raft.run_cpu_time_us":8036,"raft.run_wall_time_us":534129,"spinlock_wait_cycles":7351040,"thread_start_us":387072,"threads_started":1,"wal-append.queue_time_us":809259}
W20260709 13:02:05.497561  3786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.007s	sys 0.008s
W20260709 13:02:05.018144  3715 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
W20260709 13:02:05.505295  3745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.009s
I20260709 13:02:05.564296  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.130290  3575 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.540982  1606 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:05.487805  1683 rpcz_store.cc:276] 0709 13:02:02.376409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.553147 (+176738us) service_pool.cc:224] Handling call
0709 13:02:04.072558 (+1519411us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:04.072802 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.073047 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:04.654341 (+581294us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.107308 (+452967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.107391 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:05.107464 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.108203 (+   739us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.108335 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395662,"prepare.queue_time_us":79971,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":6804,"raft.run_cpu_time_us":16046,"raft.run_wall_time_us":395806,"spinlock_wait_cycles":6526720,"thread_start_us":1001959,"threads_started":2,"wal-append.queue_time_us":844821}
W20260709 13:02:05.040141  3820 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:02:05.572047  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1171) took 1449 ms. Trace:
I20260709 13:02:05.575564  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1252) took 1603 ms. Trace:
I20260709 13:02:05.511771  1531 rpcz_store.cc:276] 0709 13:02:03.965282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.895429 (+930147us) service_pool.cc:224] Handling call
0709 13:02:04.895763 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.895946 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.895979 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.497104 (+601125us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.497161 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.497250 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.497357 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.279573  3661 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:05.575743  1528 rpcz_store.cc:276] 0709 13:02:04.122990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.531888 (+1408898us) service_pool.cc:224] Handling call
0709 13:02:05.571354 (+ 39466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.571604 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.571628 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.571692 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.571744 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.571856 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.571977 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.576088  1606 rpcz_store.cc:276] 0709 13:02:03.972141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.574734 (+1602593us) service_pool.cc:224] Handling call
0709 13:02:05.575045 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.575209 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.575232 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.575277 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.575306 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.575374 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.575501 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.578882  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.580188  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.580801  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.551647  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.582226  1680 raft_consensus.cc:2368] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:02:05.582815  1534 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:05.581180  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 444348us
I20260709 13:02:05.583437  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1142) took 1601 ms. Trace:
I20260709 13:02:05.497723  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1299) took 1310 ms. Trace:
I20260709 13:02:05.130534  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet 443ffcfd9be74d9891a8cb9596947ca3 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:02:05.584913  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet 443ffcfd9be74d9891a8cb9596947ca3 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-443ffcfd9be74d9891a8cb9596947ca3
I20260709 13:02:05.585402  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.585479  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.584331  1682 rpcz_store.cc:276] 0709 13:02:04.187358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.799854 (+612496us) service_pool.cc:224] Handling call
0709 13:02:04.867771 (+ 67917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.868111 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:05.494721 (+626610us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.497404 (+  2683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.497459 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.497503 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.497566 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.497669 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206028,"prepare.queue_time_us":232698,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":3259,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":408958,"threads_started":2,"wal-append.queue_time_us":4215}
I20260709 13:02:05.587848  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:05.583648  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56926.5us
I20260709 13:02:05.588883  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.583922  1534 rpcz_store.cc:276] 0709 13:02:03.982128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.928002 (+945874us) service_pool.cc:224] Handling call
0709 13:02:05.582443 (+654441us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:05.582654 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.583220 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.583387 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7602944}
I20260709 13:02:05.528173  3469 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.590409  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:05.507944  3593 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:05.580848  1683 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:05.589460  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:05.590039  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.597939  1601 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.508443  3590 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.600069  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.604312  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:05.607617  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.536227  3768 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:05.571974  3786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.008s	sys 0.011s
I20260709 13:02:05.601282  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.602856  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:05.571108  3686 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.570425  3618 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.583463  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.528615  3778 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:05.625989  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.604921  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.605731  1535 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:05.596539  3469 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.630221  3469 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.601533  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.631844  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.594506  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.548503  3530 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:04.933729  3646 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.645s
W20260709 13:02:05.573916  3745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.009s
I20260709 13:02:05.610385  1681 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:05.651319  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.610810  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.651950  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.611605  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.501610   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:05.652848  1528 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:05.497099  3753 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:02:05.615640  1433 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.603231  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:05.618521  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.549463  3849 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:05.580510  3564 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.573686  3784 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.574026  3715 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.642380  1607 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:05.597044  3801 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.648564  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.652182  1678 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:05.611423  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.609216  3527 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.617815  3757 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.609103  3768 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.662110  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.664700  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.573892  3444 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.621973  3686 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.638386  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.669840  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:05.673483  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 186116us
I20260709 13:02:05.673717  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.625855  3593 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.621788  3618 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:05.675231  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:05.633423  3786 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.646942  3530 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:05.691454  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 798807us
I20260709 13:02:05.691535  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.692021  1681 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:05.692230  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.692993  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:05.674017  3825 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.307s	user 0.005s	sys 0.000s
I20260709 13:02:05.694291  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.694975  1601 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
W20260709 13:02:05.849373  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 141067us
I20260709 13:02:05.851059  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:05.850733  1680 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:05.851238  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.852219  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1258) took 1092 ms. Trace:
I20260709 13:02:05.714918  1602 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:05.853049  1601 rpcz_store.cc:276] 0709 13:02:04.760344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.589242 (+828898us) service_pool.cc:224] Handling call
0709 13:02:05.852159 (+262917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.708418  1684 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:05.861399  1534 raft_consensus.cc:2393] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:05.874023  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:05.874686  1534 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.709419  1532 raft_consensus.cc:2368] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:05.870463  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.677675  3801 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:05.871932  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:05.874101  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:05.692444  3527 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.695003  3714 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.670539  3753 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.688735  3849 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:05.693408  3757 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:05.878906  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:05.889307  1678 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.693221  3460 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:05.694314  3768 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.880326  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:05.886404  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1278) took 2475 ms. Trace:
I20260709 13:02:05.847378  3742 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:05.860692  3618 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.855340  1683 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:05.891990  1534 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:05.908171  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.869985  3593 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.893821  3715 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:05.937136  1529 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:05.872610  3530 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.941334  3745 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:05.937775  3469 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.901300  3784 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:05.901127  3849 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:05.902789  1680 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:05.904711  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 937) took 1983 ms. Trace:
I20260709 13:02:05.891499  1602 rpcz_store.cc:276] 0709 13:02:03.410957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.347522 (+936565us) service_pool.cc:224] Handling call
0709 13:02:04.348126 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.853311 (+1505185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.885967 (+ 32656us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400248954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:05.886322 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142175616}
I20260709 13:02:05.910094  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:05.975122  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:05.891418  3757 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.888916  3527 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.051255  1534 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:05.974077  1530 rpcz_store.cc:276] 0709 13:02:03.921503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.964683 (+ 43180us) service_pool.cc:224] Handling call
0709 13:02:03.988206 (+ 23523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.988419 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.988450 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.995622 (+  7172us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.653926 (+658304us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:05.515187 (+861261us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.884306 (+369119us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800011ce0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287
0709 13:02:05.884493 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.884595 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.884656 (+    61us) raft_consensus.cc:1685] finished
0709 13:02:05.904501 (+ 19845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.904652 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13063,"prepare.queue_time_us":12058,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":129638,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":15883,"spinlock_wait_cycles":7235456,"thread_start_us":1584418,"threads_started":3,"wal-append.queue_time_us":715905}
I20260709 13:02:05.935529  3851 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.876884  3778 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:02:05.937474  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 63456.6us
I20260709 13:02:05.940945  1694 tablet_copy_source_session.cc:215] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:05.880756  3801 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:05.949800  3773 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.055s	user 0.012s	sys 0.000s
I20260709 13:02:05.888722  3714 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.951092  3444 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:05.900265  3460 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:06.010787  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.024648  1678 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:06.052501  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:06.062450  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 212246us
W20260709 13:02:06.056439  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.028s
W20260709 13:02:06.063084  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.017s	sys 0.028s
W20260709 13:02:06.057291  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 454147us
W20260709 13:02:05.961251  3439 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.081s	user 0.016s	sys 0.000s
W20260709 13:02:06.065512  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1147) took 2082 ms (client timeout 1917 ms). Trace:
W20260709 13:02:06.067907  1532 rpcz_store.cc:269] 0709 13:02:03.983397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.366425 (+383028us) service_pool.cc:224] Handling call
0709 13:02:06.065268 (+1698843us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400070dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:06.065436 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2873847168}
I20260709 13:02:06.069264  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:06.070003  1532 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:06.071285  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:06.063406  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:06.074105  1532 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:06.076503  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:06.081473  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:06.083002  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:06.087103  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.089375  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:06.090255  1532 raft_consensus.cc:606] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.066563  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:06.112962  1606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.026s
I20260709 13:02:05.916944  3446 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.088480  1576 connection.cc:256] RPC call timeout handler was delayed by -1.5619591949999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2432s for a response
W20260709 13:02:06.124614  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2768101970000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:02:06.119180  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52675us
W20260709 13:02:06.125170  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2759101970000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:02:06.125763  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2435101970000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:02:06.126147  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2201101969999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:02:06.119644  1648 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.526s (SENT)
W20260709 13:02:06.126541  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2102101970000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:02:06.126962  1576 connection.cc:256] RPC call timeout handler was delayed by -1.149910196999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:02:06.121506  3869 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.132403  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:05.952843  3742 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.067123  3714 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.134706  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.137907  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:06.116148  1606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.018s	sys 0.026s
W20260709 13:02:06.294004  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 232429us
W20260709 13:02:06.314565  1603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.007s	sys 0.015s
W20260709 13:02:06.315243  1603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.007s	sys 0.015s
I20260709 13:02:06.316955  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:06.302235  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.013s	sys 0.044s
W20260709 13:02:06.322813  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.013s	sys 0.045s
I20260709 13:02:06.325055  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1141) took 2343 ms. Trace:
I20260709 13:02:06.303061  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:06.326920  1530 raft_consensus.cc:2376] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8. Re-sending same reply.
I20260709 13:02:06.325799  1527 rpcz_store.cc:276] 0709 13:02:03.981863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.917933 (+936070us) service_pool.cc:224] Handling call
0709 13:02:05.503203 (+585270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:05.549829 (+ 46626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.549991 (+   162us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:05.550894 (+   903us) log.cc:844] Serialized 52 byte log entry
0709 13:02:06.324085 (+773191us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:06.324226 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.324407 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.324492 (+    85us) raft_consensus.cc:1685] finished
0709 13:02:06.324517 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.324912 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110138,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":9071,"spinlock_wait_cycles":1545344,"thread_start_us":818212,"threads_started":2,"wal-append.queue_time_us":652988}
I20260709 13:02:06.329559  1530 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:06.305181  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1176) took 2113 ms (client timeout 2586 ms). Trace:
I20260709 13:02:06.307367  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:06.330999  1529 rpcz_store.cc:269] 0709 13:02:04.191573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.856885 (+665312us) service_pool.cc:224] Handling call
0709 13:02:06.304618 (+1447733us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400440554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:06.304982 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322141440}
I20260709 13:02:06.331568  1532 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:06.309151  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:06.127348  1576 connection.cc:256] RPC call timeout handler was delayed by -1.1256101970000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:02:06.313936  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.015s	sys 0.031s
W20260709 13:02:06.300802  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 237301us
I20260709 13:02:06.321518  1608 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:02:06.333915  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:06.334103  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0851101970000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 13:02:06.334972  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0680101970000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 13:02:06.336199  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.016s	sys 0.031s
W20260709 13:02:06.337000  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 772778us
W20260709 13:02:06.335798  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0635101970000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:02:06.339962  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0257101970000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:02:06.160991  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 437640us
I20260709 13:02:06.094269  3439 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.220611  3446 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.066874  3460 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:06.163671  3469 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:06.176092  3564 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.003s
I20260709 13:02:06.401961  3564 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:06.143193  3590 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:02:06.402830  3852 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.403403  3852 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:06.403187  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:06.403887  3590 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.164557  3575 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:06.179543  3618 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.174484  3668 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.003s
W20260709 13:02:06.236779  3670 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.319s	user 0.014s	sys 0.000s
I20260709 13:02:06.222645  3686 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.238924  3734 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.005s
I20260709 13:02:06.234391  3742 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:06.227768  3752 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.002s
I20260709 13:02:06.225448  3768 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.071079  3773 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.168686  3838 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:02:06.079453  3855 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.429329  3768 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.429293  3855 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.428874  3752 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.419986  3590 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.218544  3862 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.432561  3862 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:06.433176  3862 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.434116  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1282) took 3008 ms. Trace:
I20260709 13:02:06.435158  1534 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:06.435242  3686 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:06.347883  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0185101970000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 13:02:06.432590  1526 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:06.436071  1576 connection.cc:256] RPC call timeout handler was delayed by -1.003210197000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 13:02:06.338603  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.434578  1604 rpcz_store.cc:276] 0709 13:02:03.425502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.532989 (+1107487us) service_pool.cc:224] Handling call
0709 13:02:04.533290 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.533898 (+   608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.533934 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.534638 (+   704us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.882030 (+347392us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.882075 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.882143 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.433517 (+1551374us) raft_consensus.cc:1685] finished
0709 13:02:06.433573 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.433907 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":338190,"threads_started":1,"wal-append.queue_time_us":1085745}
I20260709 13:02:06.373467  1694 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50950 (request call id 78) took 1368 ms. Trace:
I20260709 13:02:06.438587  1694 rpcz_store.cc:276] 0709 13:02:05.129659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.130191 (+   532us) service_pool.cc:224] Handling call
0709 13:02:06.373045 (+1242854us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:06.382578  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44086.5us
W20260709 13:02:06.382031  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 231121us
I20260709 13:02:06.387099  3786 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:06.443382  3668 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.444258  3786 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.446018  1533 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.446210  3814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443ffcfd9be74d9891a8cb9596947ca3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:06.389489  1677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.028s	sys 0.028s
W20260709 13:02:06.390189  3557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.000s	sys 0.003s
I20260709 13:02:06.396431  3745 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.400568  3460 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.404495  1680 raft_consensus.cc:606] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:06.172206  3593 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.411697  1675 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:02:06.407687  3852 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:06.481765  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143502us
I20260709 13:02:06.482213  3801 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.483460  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.424490  3734 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.425542  3575 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:06.169466  3864 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:02:06.522323  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.404398  3851 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.168889  3866 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.526242  3866 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:06.526573  3734 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.251071  3869 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:06.528501  1676 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:06.200605  3868 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
I20260709 13:02:06.373466  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1253) took 2400 ms. Trace:
I20260709 13:02:06.438024  3773 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.423847  3618 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:06.441037  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 327798us
I20260709 13:02:06.440263  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:06.457070  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.028s	sys 0.029s
I20260709 13:02:06.460879  3752 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.464150  3855 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.467664  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1173) took 2344 ms. Trace:
I20260709 13:02:06.469627  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1170) took 2346 ms. Trace:
I20260709 13:02:06.473875  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1291) took 1835 ms. Trace:
I20260709 13:02:06.474468  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.478516  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 145) took 9732 ms. Trace:
I20260709 13:02:06.421955  3670 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:06.541181  1682 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.543668  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 125440us
I20260709 13:02:06.540544  1608 rpcz_store.cc:276] 0709 13:02:04.638901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.587755 (+948854us) service_pool.cc:224] Handling call
0709 13:02:05.588098 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.377823 (+789725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.473397 (+ 95574us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003093d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:06.473764 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684061440}
I20260709 13:02:06.544868  1531 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:06.546205  3851 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.547174  3851 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:06.484548  3768 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.548072  3768 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:06.548014  3882 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:06.452070  3745 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.548986  3768 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.549430  3745 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.550356  3850 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.550803  3850 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:06.540095  1526 rpcz_store.cc:276] 0709 13:02:04.123566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.575060 (+1451494us) service_pool.cc:224] Handling call
0709 13:02:05.615653 (+ 40593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.436450 (+820797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.467141 (+ 30691us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:06.467541 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877457280}
I20260709 13:02:06.494928  1576 leader_election.cc:400] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
W20260709 13:02:06.455569  3557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.000s	sys 0.004s
I20260709 13:02:06.456727  3784 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.496930  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.451748  3668 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:06.505901  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 372359us
W20260709 13:02:06.456372  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 315714us
I20260709 13:02:06.504000  3757 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.483878  1681 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:06.488862  3439 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.553577  1576 leader_election.cc:403] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.534180  1603 rpcz_store.cc:276] 0709 13:02:03.973157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.578558 (+1605401us) service_pool.cc:224] Handling call
0709 13:02:05.579284 (+   726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.316447 (+737163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.316517 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.317296 (+   779us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.353934 (+ 36638us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:06.354001 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.354171 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.360899 (+  6728us) raft_consensus.cc:1685] finished
0709 13:02:06.360930 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.373255 (+ 12325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":265092,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12637,"thread_start_us":772002,"threads_started":2,"wal-append.queue_time_us":34485}
I20260709 13:02:06.540176  1533 rpcz_store.cc:276] 0709 13:02:04.122713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.517976 (+1395263us) service_pool.cc:224] Handling call
0709 13:02:05.518288 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.446566 (+928278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.469147 (+ 22581us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400221354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:06.469544 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132409600}
W20260709 13:02:06.532683  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49445us
I20260709 13:02:06.561880  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 958) took 1543 ms. Trace:
I20260709 13:02:06.549015  3686 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:02:06.564782  3784 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.565402  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1307) took 1678 ms. Trace:
I20260709 13:02:06.565639  3686 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:06.566123  3686 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:06.566710  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69968.8us
I20260709 13:02:06.564109  1676 rpcz_store.cc:276] 0709 13:02:05.018015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.648180 (+630165us) service_pool.cc:224] Handling call
0709 13:02:06.556512 (+908332us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540044fcd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:06.561820 (+  5308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957129088}
I20260709 13:02:06.527716  3866 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.572853  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.551751  3869 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.577549  3801 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.577845  3439 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.572602  3712 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.588682  3849 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:06.567328  3784 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.590533  3712 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:06.598382  1574 leader_election.cc:400] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:02:06.599092  1574 leader_election.cc:403] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.567291  3686 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.597473  3712 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.551810  3850 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.565878  1677 rpcz_store.cc:276] 0709 13:02:04.886777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.936668 (+ 49891us) service_pool.cc:224] Handling call
0709 13:02:04.937115 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.937374 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:05.543727 (+606353us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.564782 (+1021055us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.564908 (+   126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:06.565032 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.565137 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.565316 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177932,"prepare.queue_time_us":632782,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":20895,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":120,"thread_start_us":993413,"threads_started":1,"wal-append.queue_time_us":662894}
I20260709 13:02:06.593979  3670 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:06.611719  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.613531  3801 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.613970  3801 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:06.614395  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.614352  3801 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.612170  3778 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:06.622689  3530 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.006s
I20260709 13:02:06.622712  3855 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
W20260709 13:02:06.623670  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48132.3us
I20260709 13:02:06.626428  3446 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.631291  3446 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:06.631788  3446 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.601636  3862 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.635519  3686 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.623391  3530 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.637161  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 143803us
I20260709 13:02:06.641121  3874 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:06.643043  3865 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.647423  3714 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.661435  1682 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:06.632815  3784 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.660668  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1254) took 2611 ms. Trace:
I20260709 13:02:06.674571  3714 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.674944  3745 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.658026  3855 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:02:06.676855  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:06.677464  3855 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.677980  3855 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:06.678252  3745 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.665916  1606 rpcz_store.cc:276] 0709 13:02:03.974045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.578919 (+1604874us) service_pool.cc:224] Handling call
0709 13:02:05.579229 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.315395 (+736166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.315472 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.316972 (+  1500us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.380978 (+ 64006us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:06.554376 (+173398us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.559111 (+  4735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.569797 (+ 10686us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.569834 (+    37us) raft_consensus.cc:1685] finished
0709 13:02:06.569841 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.585496 (+ 15655us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211199,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1162,"raft.queue_time_us":151007,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":126005,"thread_start_us":954950,"threads_started":3,"wal-append.queue_time_us":158783}
I20260709 13:02:06.684758  3882 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.685420  3882 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:06.686754  3527 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.619s	user 0.016s	sys 0.005s
I20260709 13:02:06.686604  3882 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.679102  3855 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.704094  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.704645  3882 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.705813  3530 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.705986  3855 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.553565  1431 rpcz_store.cc:276] 0709 13:01:56.745454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.745810 (+   356us) service_pool.cc:224] Handling call
0709 13:01:57.193283 (+447473us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:02:06.478152 (+9284869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:59.878991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:59.879827 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:59.879875 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:01:59.879902 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:59.881015 (+  1113us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:59.881120 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:59.881160 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:59.881896 (+   736us) tablet.cc:701] Row locks acquired
0709 13:01:59.881921 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:59.882116 (+   195us) write_op.cc:270] Start()
0709 13:01:59.882264 (+   148us) write_op.cc:276] Timestamp: P: 1783602119882052 usec, L: 0
0709 13:01:59.882294 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:01:59.883258 (+   964us) log.cc:844] Serialized 2481 byte log entry
0709 13:02:00.310441 (+427183us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:00.537336 (+226895us) op_driver.cc:464] REPLICATION: finished
0709 13:02:00.700643 (+163307us) write_op.cc:301] APPLY: starting
0709 13:02:00.702723 (+  2080us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.745282 (+ 42559us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:00.745316 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:00.819175 (+ 73859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:00.819384 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:02:00.819436 (+    52us) write_op.cc:312] APPLY: finished
0709 13:02:00.819676 (+   240us) log.cc:844] Serialized 52 byte log entry
0709 13:02:00.819859 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.819958 (+    99us) write_op.cc:454] Released schema lock
0709 13:02:00.820006 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:01.093821 (+273815us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:01.100080 (+  6259us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1111900,"reported_tablets":49,"spinlock_wait_cycles":886314752,"child_traces":[["op",{"apply.queue_time_us":104202,"apply.run_cpu_time_us":31462,"apply.run_wall_time_us":386007,"num_ops":6,"prepare.queue_time_us":167197,"prepare.run_cpu_time_us":9745,"prepare.run_wall_time_us":69804,"raft.queue_time_us":130843,"raft.run_cpu_time_us":53650,"raft.run_wall_time_us":253295,"replication_time_us":654895,"spinlock_wait_cycles":7376256,"thread_start_us":345549,"threads_started":4,"wal-append.queue_time_us":131008,"wal-append.run_cpu_time_us":26385,"wal-append.run_wall_time_us":2483866}]]}
W20260709 13:02:06.708853  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45540.6us
I20260709 13:02:06.708168  3527 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.713850  3714 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.666675  3786 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.667567  3460 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.711390  3850 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.700758  3894 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.720403  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.670290  3852 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.732439  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.733493  3866 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.734303  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.734838  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.735162  1602 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:06.736625  1604 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:06.736773  3527 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.726315  3439 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:06.740746  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.743094  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.743789  1602 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.745164  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:06.732673  3884 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:02:06.748502  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.741174  3768 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.749476  1604 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8.
I20260709 13:02:06.721870  3757 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.749800  1608 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:06.750298  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62189.5us
I20260709 13:02:06.750700  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 983) took 1154 ms. Trace:
I20260709 13:02:06.751106  1684 rpcz_store.cc:276] 0709 13:02:05.596190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.936791 (+340601us) service_pool.cc:224] Handling call
0709 13:02:05.937161 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.937535 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:06.051314 (+113779us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.474526 (+423212us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.475301 (+   775us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.475530 (+   229us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:06.475588 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.475738 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.750340 (+274602us) raft_consensus.cc:1685] finished
0709 13:02:06.750372 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.750522 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":134390,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":10982,"raft.queue_time_us":141367,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":311,"thread_start_us":297913,"threads_started":1,"wal-append.queue_time_us":520414}
I20260709 13:02:06.752568  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.717238  3885 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:02:06.753561  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.754280  3778 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.754724  3778 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:06.755462  3778 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.755957  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.755249  3439 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.758301  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45883.1us
I20260709 13:02:06.759186  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.760414  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.760658  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.761185  1676 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:06.762199  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.762912  1681 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.763783  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:06.764194  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45982.1us
I20260709 13:02:06.764707  3757 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.765053  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.766026  3557 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.766096  3734 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:06.766618  3734 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:06.766851  3557 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.767664  3734 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.769093  3734 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.769415  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.770762  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:06.771745  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.772401  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.773826  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:06.774384  1675 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:06.757000  3752 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.776233  1684 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.781140  3862 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.783226  1602 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:06.756603  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.784294  3833 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.784906  3833 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:06.782605  3778 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.786662  3833 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:06.723737  3894 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:06.789129  3833 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.789808  3894 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:06.792591  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46005.6us
I20260709 13:02:06.793727  3460 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.794183  3855 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.795524  3778 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.765161  3757 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:06.797114  3801 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.797938  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:06.801585  3852 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.793727  3575 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.835533  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.844064  3752 raft_consensus.cc:993] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:02:06.822674  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.847558  1610 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:06.848737  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51066.8us
I20260709 13:02:06.849372  3869 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.850049  3869 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:06.850764  3869 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.828918  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:06.852887  1606 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:06.847750  3752 raft_consensus.cc:1081] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:02:06.807864  1677 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:06.826872  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63188.9us
I20260709 13:02:06.856958  1684 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:06.857373  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.858824  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.859336  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:06.829783  3712 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.860046  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:06.860329  3784 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:06.861001  3784 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.862021  3712 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.817834  3768 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.830754  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:06.863986  3784 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.863900  3575 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.866560  3882 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.867071  3752 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.867276  3882 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.867825  3894 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.808073  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:06.867928  3752 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.803488  3786 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.869325  3757 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.869349  1676 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.878994  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.805830  3446 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:06.870049  3882 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.881942  3446 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.887496  3752 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:06.829124  1681 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
W20260709 13:02:06.882941  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 126898us
I20260709 13:02:06.883515  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.884569  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:06.886528  3801 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:06.889078  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:06.850183  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.875285  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:06.895691  1676 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:06.882431  3439 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.898101  1682 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
W20260709 13:02:06.901978  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58285us
I20260709 13:02:06.903703  1681 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.904246  1576 leader_election.cc:400] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 3. Current term is 4.
I20260709 13:02:06.905387  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.906059  1680 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:06.906304  1677 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:06.900914  1676 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:06.906175  3446 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.909927  3870 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.913066  3850 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.942363  3882 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:06.898252  3530 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.949724  1498 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8.
I20260709 13:02:06.950196  1498 leader_election.cc:403] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:06.936520  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea2020c26814418b630a447fc961d07"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:02:06.925930  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.954092  3446 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.954643  3446 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.955077  3446 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.961061  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.962523  3768 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:06.964630  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.918565  3869 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:06.923647  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73594.4us
I20260709 13:02:06.966701  3866 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.923101  3855 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.951336  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.938885  1610 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:06.986157  1608 raft_consensus.cc:606] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:06.915162  3757 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:06.992018  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 133273us
I20260709 13:02:06.986719  1608 raft_consensus.cc:614] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:06.995258  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:06.983637  3712 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.001134  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.008234  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 133124us
I20260709 13:02:07.008921  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:06.998113  3686 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:07.007995  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.014432  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.002703  3786 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:07.016252  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:07.018082  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53578.1us
I20260709 13:02:07.012835  3778 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.010905  3590 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.020613  3752 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:07.020969  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.019265  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.023437  3530 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.019513  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.029395  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.030380  1526 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:07.016292  3686 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.018064  3786 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.037295  3786 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.037770  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.038107  1603 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:07.023967  3530 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:07.039278  3869 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:07.039625  3530 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.026787  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.034502  3734 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:07.033836  3784 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.034130  3686 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.036907  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.040303  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.041226  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.050129  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.047107  1676 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.077562  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.056484  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 45) took 2003 ms. Trace:
I20260709 13:02:07.049728  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.043176  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.041241  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.078419  3778 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.082577  3778 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.082777  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:07.084260  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54724.7us
I20260709 13:02:07.085005  3778 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.085759  3469 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.085366  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.086117  3786 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.086802  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.089007  1604 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:07.100644  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.105854  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.108325  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.095176  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.080502  3752 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.093168  3469 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.110929  3752 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.111852  1608 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:07.113933  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.116276  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.117991  1533 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:07.118391  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.119215  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.119626  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.119938  1531 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:07.120482  1526 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.121093  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.121454  1535 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:07.122496  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cee4cb45f7c44278850093451991c78"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:07.123080  1675 raft_consensus.cc:606] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.123417  1675 raft_consensus.cc:614] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.055884  3712 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:02:07.124163  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:02:07.124637  3575 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:07.124682  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.125298  3575 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.125847  1528 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:07.126526  3575 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.094482  3869 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:07.128489  3869 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:07.128901  3869 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.129298  3575 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.042299  3814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41288 (request call id 32) took 3168 ms. Trace:
I20260709 13:02:07.129987  3814 rpcz_store.cc:276] 0709 13:02:03.895356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.900598 (+  5242us) service_pool.cc:224] Handling call
0709 13:02:04.511813 (+611215us) ts_tablet_manager.cc:934] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
0709 13:02:06.443638 (+1931825us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:06.793938 (+350300us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:06.794111 (+   173us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:07.032227 (+238116us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:07.041679 (+  9452us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:07.042093 (+   414us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:07.042196 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":319,"tablet-copy.queue_time_us":550890,"thread_start_us":557226,"threads_started":2}
I20260709 13:02:07.131387  1526 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:07.116371  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79580.3us
I20260709 13:02:07.125376  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.131711  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:07.149137  1528 raft_consensus.cc:606] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.095573  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54372.3us
I20260709 13:02:07.149637  1528 raft_consensus.cc:614] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.132218  3814 tablet_copy_client.cc:806] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:07.132388  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.134977  3786 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.134642  3530 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.137339  3752 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.041204  3446 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.161501  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.164160  1526 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.164428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.137894  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.114646  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.112901  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.079042  1433 rpcz_store.cc:276] 0709 13:02:05.046416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.046599 (+   183us) service_pool.cc:224] Handling call
0709 13:02:07.049540 (+2002941us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.053533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.057139 (+  3606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.057182 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:02:06.057206 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:06.057564 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.057637 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.058325 (+   688us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:06.117300 (+ 58975us) tablet.cc:701] Row locks acquired
0709 13:02:06.123344 (+  6044us) write_op.cc:260] PREPARE: finished
0709 13:02:06.145907 (+ 22563us) write_op.cc:270] Start()
0709 13:02:06.158886 (+ 12979us) write_op.cc:276] Timestamp: P: 1783602126143058 usec, L: 0
0709 13:02:06.162929 (+  4043us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.245033 (+ 82104us) log.cc:844] Serialized 535 byte log entry
0709 13:02:06.773062 (+528029us) op_driver.cc:464] REPLICATION: finished
0709 13:02:07.042645 (+269583us) write_op.cc:301] APPLY: starting
0709 13:02:07.042773 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:07.042904 (+   131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:07.043053 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:07.043356 (+   303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:07.043639 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:07.043687 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:07.044059 (+   372us) log.cc:844] Serialized 22 byte log entry
0709 13:02:07.044258 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:07.044364 (+   106us) write_op.cc:454] Released schema lock
0709 13:02:07.044425 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:07.044958 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:07.044991 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":408277,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":268961,"apply.run_cpu_time_us":2269,"apply.run_wall_time_us":2272,"num_ops":1,"prepare.queue_time_us":380705,"prepare.run_cpu_time_us":14667,"prepare.run_wall_time_us":335982,"raft.queue_time_us":196899,"raft.run_cpu_time_us":156635,"raft.run_wall_time_us":271690,"replication_time_us":601462,"thread_start_us":880989,"threads_started":4,"wal-append.queue_time_us":151529}]]}
W20260709 13:02:07.140645  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.168365  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.140852  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.124785  1607 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:07.042258  3734 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.145525  3866 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8.
I20260709 13:02:07.166800  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.132257  3778 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.170194  1607 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.173473  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.174254  1602 raft_consensus.cc:2368] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:02:07.177186  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:07.180644  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.182849  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.179493  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 3.
I20260709 13:02:07.161492  3894 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:02:07.171377  3590 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.171118  3734 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.167670  3852 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:07.163388  3784 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:02:07.165534  3850 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:02:07.194537  1535 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.196501  3886 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.197160  3670 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:07.197968  1528 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:07.182058  3814 tablet_copy_client.cc:670] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:07.198567  3866 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.199782  1531 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.200001  1610 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.200294  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.201076  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:07.201434  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86904.1us
I20260709 13:02:07.201539  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.218515  1527 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:07.219949  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.202137  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.191227  3778 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:07.212594  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.203254  1430 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.221565  1604 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:07.175132  3575 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:07.192500  3757 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:07.227422  1530 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:07.232954  1608 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.235910  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.241153  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47874.2us
I20260709 13:02:07.242480  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:07.243530  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.244125  1675 raft_consensus.cc:606] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:07.244730  1675 raft_consensus.cc:614] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.242179  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:07.248093  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.242357  3801 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.252123  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.252964  1530 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.253444  3852 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:07.253911  3852 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:07.254333  3852 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.263490  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.264580  1533 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:07.264818  3530 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:07.265586  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.265604  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:07.266505  1528 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.266546  1533 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:07.267722  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.272217  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.272922  1608 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:07.235558  3778 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.274869  3778 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.268142  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.276669  1533 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.279204  3590 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.228178  3866 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:07.280529   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:07.242348  3712 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:07.281769  1529 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.222882  3882 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:02:07.292599  3814 tablet_copy_client.cc:538] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:07.293767  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57944.1us
I20260709 13:02:07.285082  1531 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.241058  3886 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.291399  3786 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.292153  3670 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:07.294387  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48446.9us
I20260709 13:02:07.298518  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.307993  1530 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:07.308506  1609 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.280766  3734 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:07.301561  3786 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.305035   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:07.305555  3886 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.318357  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.306741  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.307266  1605 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.312793  1601 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:07.315913  1526 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:07.320569  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.321774  1535 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:02:07.333949  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.284448  3712 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:07.334911  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.335819  1530 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.307945  3670 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.342459  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.344663  1535 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:07.345280  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.346063  1535 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.348467  1430 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.349174  3757 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:07.340834  3712 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.355557  1606 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:07.356395  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.308816  3784 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.357143  3784 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.357681  1526 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.357756  3757 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:07.360564  3757 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.361866  3850 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.362598  3850 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.361994  3757 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.360591  3786 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.366425  3786 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.367794  3686 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:07.368225  3686 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.369109  3869 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.369066  3686 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.370316  3686 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.370143  1527 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:07.371439  3869 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:07.372256  3446 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.372750  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.373813  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:07.340819  3866 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.378944  1530 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:07.383252  1529 raft_consensus.cc:2410] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:07.351380  1430 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.385203  1531 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:07.307605  3874 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.386794  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.389715  1528 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:07.393211  1526 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:07.411825  1430 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 6, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.309799  3575 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:02:07.318279  3530 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:02:07.421061  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 47310.9us
I20260709 13:02:07.426436  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.429563  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.358093  3784 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.413821  3874 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:07.435756  3874 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:07.437258  3874 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:07.444926  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.449755  3734 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.452621  3530 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:07.453022  3530 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.453779  3530 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.454980  3530 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.457468  1609 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:02:07.459092  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 112562us
I20260709 13:02:07.463719  1533 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:07.466694  1498 leader_election.cc:400] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:02:07.460673  1430 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.430461  3768 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.433908  3446 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:07.483235  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 234142us
I20260709 13:02:07.469063  1607 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:07.481508  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56108.6us
W20260709 13:02:07.483848  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 143644us
I20260709 13:02:07.467128  1498 leader_election.cc:403] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.485883  3852 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.451769  3712 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:07.467926  3590 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:07.465521  3870 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:07.517544  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:07.530918  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64413.8us
I20260709 13:02:07.532444  1607 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.532356  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.493975  3801 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.534781  1430 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.542135  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.521526  3590 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:07.521199  3870 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.464387  3670 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.526077  3768 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.550244  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.542376  3886 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.557765  1430 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.538992  3912 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:07.561103  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46224.2us
I20260709 13:02:07.535204  3882 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:02:07.547348  3590 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.547112  3686 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:07.574383  1682 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.574158  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.527819  3469 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:02:07.577229  1682 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.579380  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:07.555266  3915 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.580780  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:07.582980  1677 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.585183  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:07.585848  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:07.582762  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:07.571816  3686 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.588585  1675 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:07.588963  1607 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.589859  3575 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:07.590448  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:07.592392  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.592551  1606 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.595196  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:07.641845  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.578328  3768 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:07.637929  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 111998us
W20260709 13:02:07.646451  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 104359us
I20260709 13:02:07.637657  3855 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:07.648499  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.649228  3906 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:07.595261  3686 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.648777  3855 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:07.596673  3915 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.657609  1677 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:07.634895  3882 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:07.664811  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:07.654475  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.659824  1609 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:07.660303  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86269us
I20260709 13:02:07.662170  1683 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.666503  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:07.667047  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.572992  3912 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.652387  1430 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:07.667539  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 117369us
I20260709 13:02:07.672020  1430 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.676431  1681 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:07.658699  3469 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.680692  1607 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:07.683375  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.684105  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.596313  3870 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.687079  3870 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.688052  3855 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:07.688916  3855 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.665573  3768 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:07.690629  3768 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.674026  3801 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.692247  3801 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.685878  1430 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.693185  3801 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.693624  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.696066  1430 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.704705  1430 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 2 to 5, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.706049  3670 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.709272  3833 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:07.665251  3882 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:07.681901  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.678920  3575 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.712682  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.679759  3469 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:07.680418  3852 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:07.722416  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50706.7us
I20260709 13:02:07.726758  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:07.728137  1682 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.733117  1430 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.712175  3712 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:07.710382  3446 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:07.738091  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46127.4us
W20260709 13:02:07.739203  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 59894.4us
I20260709 13:02:07.741297  1430 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 4, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.744889  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.748389  1681 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.744472  3469 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.751287  3469 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.751914  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.764837  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 158097us
I20260709 13:02:07.770581  1430 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 2, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:07.781368  1682 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:07.790632  3784 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.771509  3882 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.796353  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:07.796983  1609 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.797395  1601 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:07.782157  3886 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7.
I20260709 13:02:07.786192  3814 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:02:07.769418  3712 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:07.814774  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48899.2us
I20260709 13:02:07.754601  3852 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:02:07.820330  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.827550  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.821584  1609 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:02:07.822948  1606 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:07.829334  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:07.830314  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 89504.6us
I20260709 13:02:07.831187  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.833033  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81202.3us
W20260709 13:02:07.824491  3918 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:07.835844  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.768409  3446 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:02:07.807404  3922 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.770749  3575 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:02:07.824399  3916 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:07.841872  3924 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:07.842334  3921 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:02:07.842953  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:07.843180  3923 raft_consensus.cc:2764] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:07.846508  3469 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.747466  3915 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.842954  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:07.842952  3914 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:07.846882  3768 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:07.857086  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.822253  3925 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.838800  3928 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:07.822240  3908 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:02:07.831529  3757 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:07.868817  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.869547  3852 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.849254  3924 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.851039  3929 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.840746  3920 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:07.893123  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:07.895463  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68018.8us
I20260709 13:02:07.868460  3928 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.896633  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.858496  3712 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:07.872541  3768 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:07.885617  3870 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:07.901240  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58409.1us
I20260709 13:02:07.885070  3924 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.909011  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:07.909296  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:07.895778  3925 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.912473  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:07.913517  1682 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:07.914574  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:07.899925  3852 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.917536  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:07.920275  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:07.896541  3929 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:07.902172  3928 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.936484  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:07.939615  1681 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.942564  3920 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.913393  3907 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.913558  3911 raft_consensus.cc:2764] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:07.913812  3925 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:07.902971  3590 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.942135  3942 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:07.953922  3929 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:07.936784  3910 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:07.907708  3686 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.921309  3850 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:02:07.977399  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68408.7us
I20260709 13:02:07.986831  1610 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:07.986351  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47341us
I20260709 13:02:07.958884  3925 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.977643  3874 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.976496  3910 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:07.974474  3907 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:07.996268  3937 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:07.997586  3590 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:07.977628  3935 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:07.998539  3919 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.359s	user 0.003s	sys 0.000s
I20260709 13:02:08.000496  3894 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:08.004905  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:08.005494  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 95483.7us
I20260709 13:02:08.002101  3874 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:08.008740  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:08.012822  3936 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:02:08.013669  3469 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.014341  3920 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.017779  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:08.020205  3940 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.021525  3907 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.021584  3922 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:08.023329  3926 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
W20260709 13:02:08.023520  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.024209  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:08.033162  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 125472us
I20260709 13:02:08.004245  3850 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:07.986123  3768 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.007364  3894 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:08.027587  1532 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:08.020239  3575 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.024658  3469 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.027925  3590 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.027011  3940 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:08.044219  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.044373  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:08.054631  3943 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:02:08.031793  3921 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.028991  3922 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:08.055956  1608 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:08.041280  3575 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.070679  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:08.072291  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.056377  3940 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.036942  3850 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.065217  3469 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.070192  3575 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.056277  3590 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.084939  3945 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.090657  3469 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:08.092657  3945 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.093297  3469 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.094398  3469 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:08.096341  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.095920  3945 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:08.113207  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.082875  3874 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:08.140803  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68586us
I20260709 13:02:08.141211  3958 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:08.141644  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.141779  3958 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.142522  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.142731  3958 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.147769  3937 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:08.148290  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58213.1us
I20260709 13:02:08.089454  3686 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.064085  3910 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.153523  3590 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.091351  3943 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.151901  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:08.188396  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45951.9us
I20260709 13:02:08.188848  3959 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:08.189484  3959 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.189414  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.137837  3928 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.084468  3894 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:08.190821  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.191479  3814 tablet_bootstrap.cc:700] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent opening tablet: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:02:08.202694  3886 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.199229  3943 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:08.204877  3956 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:08.198016  3778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.010s	sys 0.023s
I20260709 13:02:08.205133  3948 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
W20260709 13:02:08.205962  3947 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:08.206157  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:08.221872  1684 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 6.
I20260709 13:02:08.185086  3784 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.208289  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56462.3us
I20260709 13:02:08.214267  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:08.215341  1606 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.197772  3921 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.210772  3886 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:08.231869  3943 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.235296  3886 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.236506  3886 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.235927  3943 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.224236  1532 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:02:08.212551  3935 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.241232  3935 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.241966  3784 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:08.231937  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.244225  3784 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:08.245206  3670 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.006s
I20260709 13:02:08.246106  3850 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:08.219400  3778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.010s	sys 0.023s
I20260709 13:02:08.194517  3925 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:08.211177  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 144748us
I20260709 13:02:08.218515  3945 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.139155  3922 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.223044  3590 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:08.231602  3874 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.190606  3959 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.263610  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:08.269232  3833 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.269757  3833 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.224232  3956 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.270200  3833 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.282135  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.305393  3928 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.297873  3940 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.288383  3894 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:08.303797  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.322328  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:08.322989  1677 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:08.304894  3924 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.316779  1605 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:08.283918  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:08.324123  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:08.265358  3945 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:08.329428  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 63429.9us
I20260709 13:02:08.330564  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:08.332285  1683 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:08.332710  1683 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:08.334065  1684 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.331259  1675 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:08.280138  3874 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:08.334602  1683 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.340696  1601 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:08.341653  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:08.342846  1676 raft_consensus.cc:2410] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:08.324998  3935 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:08.352145  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68530.7us
W20260709 13:02:08.353772  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.354908  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:08.355132  3956 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.356534   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:08.334067  3734 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:08.362958  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:08.343945  3590 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:08.368527  1680 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:08.365978  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:08.369557  2212 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:08.362257  3935 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:08.372263  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.374188  3965 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.280366  3937 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.374727  3965 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.377765  3874 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:08.373028  3935 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.382939  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.383165  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:08.382606  3734 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:02:08.385620  3590 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.395712  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:08.396454  1532 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:08.387252  3928 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.391316  3929 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.392380  3530 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:08.389598  3921 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:02:08.406528  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43808.3us
I20260709 13:02:08.387404  3882 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.418300  1610 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.404206  3460 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:08.432222  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:08.436652  3932 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:08.437196  3932 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:08.438283  3924 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.438095  3932 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:08.440821  3960 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:08.413996  3530 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:08.450656  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.455161  3912 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.421893  3855 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.457814  3855 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:08.458247  3855 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:08.462734  3963 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:08.465350  3940 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:08.467082  3945 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.469009  1683 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:08.473609  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48932.7us
I20260709 13:02:08.475471  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:08.477713  1605 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:08.450414  3460 consensus_queue.cc:1243] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:08.494336  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:08.495239  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:08.497515  1609 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
W20260709 13:02:08.498175  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.478451  3948 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:08.501381  1608 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:08.501791  1608 pending_rounds.cc:85] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
I20260709 13:02:08.500342  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:08.502461  1603 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:08.503218  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:08.502035  1608 pending_rounds.cc:107] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:02:08.505839  1608 raft_consensus.cc:2889] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.505375  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:08.507464  1604 raft_consensus.cc:2410] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:02:08.529163  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.541070  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.558959  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.623312  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 120191us
I20260709 13:02:08.499426  3945 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.504739  3912 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.639452  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.489943  3575 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.643118  1683 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:08.633978  3942 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:08.644960  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 140466us
I20260709 13:02:08.644063  3786 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:02:08.648357  3757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:02:08.654471  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:08.505007  3530 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.648556  3850 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:08.636487  3945 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.641680  3912 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.735996  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:08.746372  3937 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:08.747342  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92994.2us
I20260709 13:02:08.658502  3850 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.757540  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:08.760344  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 120952us
I20260709 13:02:08.760942  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:08.752826  3530 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.788981  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:08.788868  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:08.754340  3850 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.792301  1529 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:08.790532  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:08.804664  1528 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:08.805015  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:08.774528  3670 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.809031  3670 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.809476  3670 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.812369  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:08.814690  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:08.815408  1531 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:08.819562  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 67452.5us
I20260709 13:02:08.762665  3921 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.823524  1533 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:08.831115  1532 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:02:08.792949  3590 raft_consensus.cc:2764] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:02:08.834627  1531 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:08.811635  3855 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:08.809500  3972 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:08.837288  3855 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:08.840843  3929 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.773635  3942 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:02:08.841264  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:08.846272  1527 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:08.856909  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.841161  3912 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:08.807919  3786 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:08.844799  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.824465  3927 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:08.840878  3575 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:08.830816  3921 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:08.980479  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:08.982074  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:08.931648  3927 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:08.976830  3833 consensus_meta.cc:287] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
W20260709 13:02:09.037940  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.945681  3786 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.017928  3446 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.048914  3446 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:09.050136  3446 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.051362  3446 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:09.084113  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.104194  2211 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
W20260709 13:02:09.105548  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.105983  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.106504  2212 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:09.106681  2210 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:09.107477  3921 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.108124  3921 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.108587  3921 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.112717  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:09.115007  3575 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:09.116853  3575 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:09.040779  3833 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:09.123837  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 275936us
W20260709 13:02:09.125208  3980 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 13:02:09.125522  3981 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:02:09.126439  3978 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:02:09.133469  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:09.135280  3945 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.136371  3833 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.137775  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:09.138399  1683 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.138782  3925 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:09.141743  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.141892  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:02:09.142336  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.142690  2211 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:09.144548  3929 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.144728  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:09.145133  3929 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.137794  3670 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.147624  3929 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.148509  1535 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:09.148650  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.150029  1683 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:09.159164  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:09.161016  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.161912  1609 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:09.161674  1608 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:09.162289  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:09.159963  3971 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:09.155079  3870 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:09.164196  3971 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.165262  3870 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:09.166186  1604 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:09.170137  2212 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:09.158759  3961 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.156666  3962 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.166236  3870 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.181716  3922 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.172447  3927 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.176926  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.172642  1604 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:09.177063  3670 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.181802  3870 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.172865  3784 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.185141  3950 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:09.166869  3575 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:09.160355  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:02:09.361121  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.283274  3460 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.512012  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:09.522454  3460 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.523277  3927 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.185761  3734 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:09.523856  3927 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.336571  3930 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:09.525110  3930 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:09.508936  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 351789us
W20260709 13:02:09.516268  3976 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.006s	sys 0.018s
W20260709 13:02:09.527407  3976 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.007s	sys 0.018s
I20260709 13:02:09.512053  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.209048  3814 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:09.522979  1683 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.528395  1675 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:09.460968  3940 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.225780  3921 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.185467  3752 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:09.529503  3940 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.530083  3752 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:09.531068  3752 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.185526  3786 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.532816  3833 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:09.207621  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:09.533917  1677 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:09.296944  3855 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:09.535869  3855 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.183928  3961 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.293519  3850 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.204447  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:02:09.232249  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.193255  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1335) took 1250 ms. Trace:
W20260709 13:02:09.411332  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.540583  1606 rpcz_store.cc:276] 0709 13:02:07.943202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.943375 (+   173us) service_pool.cc:224] Handling call
0709 13:02:07.952912 (+  9537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.224099 (+271187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.192942 (+968843us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540024aed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:09.193179 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596147456}
I20260709 13:02:09.186589  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.206401  1680 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:09.461215  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.509802  1676 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:09.195806  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1336) took 1235 ms. Trace:
I20260709 13:02:09.207265  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:09.456089  3962 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:09.519927  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 320912us
I20260709 13:02:09.532830  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:09.547170  1601 rpcz_store.cc:276] 0709 13:02:07.960351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.960570 (+   219us) service_pool.cc:224] Handling call
0709 13:02:07.975734 (+ 15164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.341602 (+365868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.195580 (+853978us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540030a2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:09.195746 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838781312}
I20260709 13:02:09.524413  3734 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.548830  1681 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:09.206895  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:09.578496  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.552285  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.562701  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.539970  1604 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:09.393185  3982 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:02:09.173197  3958 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:09.611949  1609 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:09.555639  3927 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:09.556202  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.558374  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.559391  1683 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
W20260709 13:02:09.217514  3985 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:09.673297  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.674340  1527 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:09.621876  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.677094  1532 raft_consensus.cc:2410] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:09.562409  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.681275  1535 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:09.620222  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 415848us
I20260709 13:02:09.673079  3530 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.683506  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.548789  3784 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.562994  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.612262  1526 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:09.560881  1679 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:09.416859  3446 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:09.365170  3712 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.692104  3958 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:09.692420  3712 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.693495  3784 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:09.532938  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 375928us
I20260709 13:02:09.694816  3712 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.684764  3778 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.696367  3778 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.698920  3778 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.685042  3882 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.699846  3882 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.701922  3882 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.702011  3920 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.702627  3920 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.704613  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.705070  3850 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.705425  1527 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:09.508592  3932 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.614286  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.554546  3986 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:09.617645  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.614629  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:09.618750  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.721330  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.721829  1609 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:09.722535  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.722909  1609 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:09.692149  3446 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:09.499699  3910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.014s	sys 0.018s
I20260709 13:02:09.727074  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.609949  3734 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.332180  3686 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.562086  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.510648  3801 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.226344  3971 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.875494  1533 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:09.220958  3965 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.620831  3752 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.621471  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:09.690342  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.893632  1528 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.683674  3530 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:09.693346  3958 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.904116  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.567914  3908 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.713830  1531 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:09.616087  3814 tablet_bootstrap.cc:492] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:02:09.718209  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.603615  3944 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.724246  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:09.910197  1605 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.616976  3886 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.589470  3921 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.875479  3575 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.725244  1676 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:09.725412  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 107838us
I20260709 13:02:09.725562  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.563462  3855 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.918323  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.727900  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.859431  3712 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:02:09.807564  3757 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:02:09.835497  3446 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.714130  3942 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.713830  3909 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.846520  3922 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:09.844432  3993 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:09.822759  1526 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:09.720364  3962 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:09.714815  3786 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.821834  3778 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.902479  3686 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.822860  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:09.821002  3850 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.817480  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.820520  3784 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.821419  3882 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.614923  3460 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.747694  1604 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:09.992244  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 264386us
I20260709 13:02:09.687389  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:10.004101  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.525935  3930 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.905179  1602 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:09.620784  3833 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:09.908186  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.908484  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.705070  3920 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.726382  3979 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.733040  3910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.017s	sys 0.021s
I20260709 13:02:09.807015  3912 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.913549  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:10.016886  1608 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:10.017093  3833 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:10.018260  1608 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:10.019513  3986 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.020120  1534 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:10.016041  3912 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.021872  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 975) took 2116 ms. Trace:
I20260709 13:02:10.022223  1534 rpcz_store.cc:276] 0709 13:02:07.905386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.905528 (+   142us) service_pool.cc:224] Handling call
0709 13:02:07.915436 (+  9908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.020616 (+2105180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.021626 (+  1010us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54000bc7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:10.021796 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4839814912}
I20260709 13:02:10.022837  1603 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:10.023165  3912 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.966549  3909 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.023494  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:10.007386  3784 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.025203  1527 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:10.025213  3909 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.918825  1528 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:09.919016  1535 raft_consensus.cc:2368] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:02:10.026439  3784 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.026952  3940 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.902348  3961 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:09.919890  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:09.734467  3768 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:10.028545  1610 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:10.028693  3768 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:10.009948  3945 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.920257  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:10.029335  3945 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.925215  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:09.931468  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.029706  3768 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.940207  3530 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:09.726642  3670 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.031286  3670 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.813211  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:09.964839  1530 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:09.967893  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:10.028775  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:10.034476  1606 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:09.963990  3942 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.024528  1608 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:10.006703  4001 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:10.008404  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 100307us
I20260709 13:02:10.039978  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.005537  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.008806  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:09.960580  3814 ts_tablet_manager.cc:1403] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 2.175s	user 0.065s	sys 0.063s
I20260709 13:02:09.964828  3993 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.914848  3944 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.917294  3886 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.920230  3921 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.053313  1528 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:09.961727  3855 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.962477  3757 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.012311  3460 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.003931  3962 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.913842  3908 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.035717  3670 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.033466  1609 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.038703  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.017107  3686 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.079164  1531 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:10.009351  3882 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.038525  1608 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:10.046238  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.059422  3912 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.098882  1609 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:10.099618  1533 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:10.057353  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.033735  3920 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:10.100790  1528 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:10.071507  1605 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:10.029747  3945 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.097671  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.105980  1530 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:10.094643  1608 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.107870  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.109333  1608 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.071933  1526 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:10.074774  1532 raft_consensus.cc:2368] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:09.966727  3922 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.967707  3786 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.042049  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:09.998452  3850 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.992460  3778 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:09.964691  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:10.052791  3961 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:09.922452  3575 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.033586  3979 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.120398  1528 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:10.120915  3575 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:10.084983  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.121447  3979 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.121847  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.122087  3979 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.122469  3979 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.122802  3979 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.122879  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.073287  3460 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.091941  3686 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.092412  3929 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.094558  3921 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:10.059967  3855 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.077562  3757 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.055022  3993 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.027920  3940 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.101136  3912 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:10.111881  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69838.5us
I20260709 13:02:10.112160  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.112763  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.112696  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.101006  3920 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:10.044602  3986 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.115020  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.116128  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:10.118053  3778 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.118660  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.114462  3590 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.123006  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.125725  1534 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:10.093835  3908 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.062312  4001 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.491707  3961 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:10.619256  1535 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:10.126642  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 162053us
I20260709 13:02:10.114178   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.621774  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:10.176433  4005 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.562681  3940 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.151965  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.177259  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:10.128247  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.212638  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.644948  1682 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:02:10.266736  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.140014  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.255635  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 129329us
I20260709 13:02:10.624858  1681 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:10.156113  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.212551  1529 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:10.625752  1683 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:10.632730  1528 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:10.642340  1679 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:10.109519  3886 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.595779  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.176462  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.110760  3870 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.674960  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 142695us
I20260709 13:02:10.732295  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:10.732965  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.510214  3752 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.003s
I20260709 13:02:10.131345  3910 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.152398  3670 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.706s
I20260709 13:02:10.566612  3920 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:10.647861  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.903532  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.743649  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:10.647837  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:10.649737  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.677486  3921 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.739787  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.177606  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:10.746874  1680 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:11.129503  1677 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.642158  3855 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.124230  3460 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.879135  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 994) took 1055 ms. Trace:
I20260709 13:02:10.884020  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:11.184644  1526 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.185129  1682 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:11.122090  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.187850  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.608714  3909 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.017s	sys 0.028s
I20260709 13:02:10.737046  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.732926  1528 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:02:10.717391  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:10.884826  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.740389  4012 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.879032  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 220692us
I20260709 13:02:10.651333  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:11.122020  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 474365us
W20260709 13:02:10.666111  1608 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
W20260709 13:02:11.097824  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.596680  2210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.032s
I20260709 13:02:10.509143  3922 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:10.802083  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.641s (SENT) [suppressed 34 similar messages]
W20260709 13:02:11.050899  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.021s	sys 0.051s
I20260709 13:02:10.913269  3959 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:11.129717  1678 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:11.175182  1533 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:10.605958  3945 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.002s
I20260709 13:02:10.394285  3734 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.274471  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.027s	sys 0.056s
W20260709 13:02:11.274909  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.2708e+06us
I20260709 13:02:11.273892  3945 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:10.890751  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:10.733209  3530 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.276189  3530 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.277012  3993 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:02:11.277139  3945 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.277477  3993 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:11.278616  3530 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:10.653204  3940 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.738185  3961 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.269942  3979 consensus_meta.cc:287] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:02:11.280428  3979 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.282377  3979 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.613355  3930 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.745901  4000 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:11.270108  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:10.617411  3686 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.639643  3912 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.284469  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:11.291100  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.291676  1682 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:10.606961  3882 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.724154  3962 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.321277  3944 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.297108  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:11.298861  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:11.299904  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.300699  1682 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:10.746687  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:10.643527  4005 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.574050  3971 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:11.291608  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.301654  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.302338  1682 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:11.302023  3971 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.303158  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.053160  4015 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.283996  1529 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:11.304584  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1234) took 1209 ms. Trace:
I20260709 13:02:11.304334  4015 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:11.304932  1529 rpcz_store.cc:276] 0709 13:02:10.095572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.884485 (+788913us) service_pool.cc:224] Handling call
0709 13:02:11.304529 (+420044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.747960  3870 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.306895  4015 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.925135  3786 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.307433  1676 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.121196  1679 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.308408  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.309165  1529 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:11.292275  3686 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.310621  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1009) took 1085 ms. Trace:
I20260709 13:02:11.310961  1678 rpcz_store.cc:276] 0709 13:02:10.225636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.391021 (+165385us) service_pool.cc:224] Handling call
0709 13:02:11.310562 (+919541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.311995  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.284649  1681 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.315517  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:10.572652  3850 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.284957  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.286154  3752 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.737730  3814 raft_consensus.cc:359] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.317600  3752 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:11.181788  3920 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.318302  3752 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:11.285738  3909 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.017s	sys 0.053s
W20260709 13:02:11.320290  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44654.3us
I20260709 13:02:11.319391  3752 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.321792  2210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.024s	sys 0.039s
I20260709 13:02:11.286687  4000 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:11.286898  1530 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:11.183725  1535 rpcz_store.cc:276] 0709 13:02:09.823325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.028106 (+204781us) service_pool.cc:224] Handling call
0709 13:02:10.618875 (+590769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.619673 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.862888 (+243215us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b540031a950. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:10.879030 (+ 16142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357970304}
I20260709 13:02:11.287710  3993 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:10.643499  3929 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.330091  3940 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.330680  3530 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.331313  1678 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.332569  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.332911  3940 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.333290  3734 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.331650  3929 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.030298  4001 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.288926  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1346) took 1366 ms. Trace:
I20260709 13:02:11.170715  3886 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:11.334702  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.335227  3886 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:11.335985  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.336135  3886 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.336750  1678 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:10.651911  3446 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:11.337291  3446 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.337772  1678 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.338410  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1011) took 1034 ms. Trace:
I20260709 13:02:11.301522  1683 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.288297  1531 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.308995  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.339819  1679 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.310103  3971 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.301370  4005 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.300637  1532 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:11.350575  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.351677  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.273705  3959 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.352360  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.352694  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.146595  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 174) took 6230 ms. Trace:
I20260709 13:02:11.123077  3910 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:11.286463  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 635184us
I20260709 13:02:11.285643  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:11.202443  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1005) took 1062 ms. Trace:
W20260709 13:02:10.739403  3932 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.015s	user 0.011s	sys 0.000s
I20260709 13:02:11.333855  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.382972  1530 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:11.333442  1433 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.373886  1680 rpcz_store.cc:276] 0709 13:02:10.124864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.151555 (+ 26691us) service_pool.cc:224] Handling call
0709 13:02:11.178513 (+1026958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.227286  3921 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.338706  1678 rpcz_store.cc:276] 0709 13:02:10.304414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.337326 (+1032912us) service_pool.cc:224] Handling call
0709 13:02:11.337616 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.338196 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.338362 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:10.573436  3942 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.304747  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1235) took 1209 ms. Trace:
I20260709 13:02:11.150919  3925 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.417873  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.012s	sys 0.060s
I20260709 13:02:11.340531  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.419557  1526 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:11.334491  1608 rpcz_store.cc:276] 0709 13:02:09.922995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.024134 (+101139us) service_pool.cc:224] Handling call
0709 13:02:10.024417 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.288608 (+1264191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.288638 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.288676 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:11.288712 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.288773 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.288873 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7516,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79}
I20260709 13:02:11.341291  1681 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:11.341508  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.342530  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.343148  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.347160  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.419996  1605 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:11.423753  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.347720  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:10.925308  3986 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:10.752254  4006 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:11.348605  3912 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.348416  4012 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:11.349470  1679 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.354143  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.353658  1430 rpcz_store.cc:276] 0709 13:02:04.926563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.952989 (+ 26426us) service_pool.cc:224] Handling call
0709 13:02:11.146494 (+6193505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:07.882654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:07.887851 (+  5197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:07.887920 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:02:07.887949 (+    29us) tablet.cc:662] Decoding operations
0709 13:02:07.890219 (+  2270us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:07.902636 (+ 12417us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:07.906225 (+  3589us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:02:08.054681 (+148456us) tablet.cc:701] Row locks acquired
0709 13:02:08.054755 (+    74us) write_op.cc:260] PREPARE: finished
0709 13:02:08.054936 (+   181us) write_op.cc:270] Start()
0709 13:02:08.055105 (+   169us) write_op.cc:276] Timestamp: P: 1783602128054868 usec, L: 0
0709 13:02:08.055127 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:08.082651 (+ 27524us) log.cc:844] Serialized 6361 byte log entry
0709 13:02:08.745260 (+662609us) op_driver.cc:464] REPLICATION: finished
0709 13:02:09.371936 (+626676us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4694f6f0ac 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f469baafef0
0709 13:02:09.509289 (+137353us) write_op.cc:301] APPLY: starting
0709 13:02:09.509372 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:09.509668 (+   296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:09.509690 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:09.511655 (+  1965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:09.511963 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:02:09.512007 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:09.564546 (+ 52539us) log.cc:844] Serialized 112 byte log entry
0709 13:02:09.565528 (+   982us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.565741 (+   213us) write_op.cc:454] Released schema lock
0709 13:02:09.565792 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:09.566203 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:09.566237 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100501,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":758470,"apply.run_cpu_time_us":4259,"apply.run_wall_time_us":56888,"num_ops":16,"prepare.queue_time_us":68295,"prepare.run_cpu_time_us":37266,"prepare.run_wall_time_us":393635,"raft.queue_time_us":217466,"raft.run_cpu_time_us":34028,"raft.run_wall_time_us":868448,"replication_time_us":604358,"spinlock_wait_cycles":4828928,"thread_start_us":1146716,"threads_started":4,"wal-append.queue_time_us":232693,"wal-append.run_cpu_time_us":55180,"wal-append.run_wall_time_us":2295872}]]}
I20260709 13:02:11.461370  1603 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:11.385330  3910 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.900465  4014 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:11.073207  3590 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:11.354709  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.317667  3814 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:02:11.356362  1682 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.473747  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:11.474336  1532 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:11.380949  1677 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:11.474762  1682 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:11.475212  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1006) took 1323 ms. Trace:
I20260709 13:02:11.475538  1677 rpcz_store.cc:276] 0709 13:02:10.151540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.151677 (+   137us) service_pool.cc:224] Handling call
0709 13:02:11.475159 (+1323482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.387120  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1000) took 1276 ms. Trace:
I20260709 13:02:11.384325  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 3 to 4, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 4 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:11.476202  1676 rpcz_store.cc:276] 0709 13:02:10.110670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.110795 (+   125us) service_pool.cc:224] Handling call
0709 13:02:11.386843 (+1276048us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540037f5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.387037 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587116928}
I20260709 13:02:11.404016  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.401722  1533 rpcz_store.cc:276] 0709 13:02:10.095823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.127784 (+ 31961us) service_pool.cc:224] Handling call
0709 13:02:11.304617 (+1176833us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000deb54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.304700 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177572736}
I20260709 13:02:11.408774  1535 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:11.476186  1527 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:11.445917  3925 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.410418  3870 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.481608  1677 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:11.410810  4000 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.413031  3855 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.413968  3446 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.416590  3959 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:10.652681  3778 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.418675  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.422564  1604 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:11.497910  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 79312.6us
I20260709 13:02:11.347419  1683 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.508229  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1012) took 1148 ms. Trace:
I20260709 13:02:11.425185  1610 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:11.422032  1602 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:11.422173  1609 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:02:11.426551  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.012s	sys 0.061s
I20260709 13:02:11.437427  1531 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:11.446336  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.447302  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.191860  3958 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:11.456180  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.458021  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:11.513646  1528 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:10.738566  3757 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.461439  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1014) took 1010 ms. Trace:
I20260709 13:02:11.478721  3927 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.467293  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:11.467715  1680 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:11.470752  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:11.447834  3930 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.476763  1682 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:11.404832  1678 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:11.480329  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:11.409917  3686 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.489917  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 999) took 1606 ms. Trace:
I20260709 13:02:11.514678  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1244) took 1077 ms. Trace:
I20260709 13:02:11.456180  4006 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.578097  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70345.7us
I20260709 13:02:11.517333  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.635111  1535 rpcz_store.cc:276] 0709 13:02:09.872956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.408127 (+1535171us) service_pool.cc:224] Handling call
0709 13:02:11.408462 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.478472 (+ 70010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.478661 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:11.636987  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119743us
W20260709 13:02:11.579147  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.560559  1603 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:11.514168  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1229) took 1455 ms. Trace:
W20260709 13:02:11.490665  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1231) took 1431 ms (client timeout 1641 ms). Trace:
W20260709 13:02:11.491966  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 169813us
I20260709 13:02:11.511353  1529 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:11.492563  4021 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:11.425002  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1236) took 1328 ms. Trace:
I20260709 13:02:11.634933  1679 rpcz_store.cc:276] 0709 13:02:10.451028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.348967 (+897939us) service_pool.cc:224] Handling call
0709 13:02:11.349291 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.461162 (+111871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.461386 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.642612  1526 rpcz_store.cc:276] 0709 13:02:10.096091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.883579 (+787488us) service_pool.cc:224] Handling call
0709 13:02:11.424923 (+541344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.644268  1526 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:11.645110  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1239) took 1517 ms. Trace:
I20260709 13:02:11.645637  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:11.510572  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.617754  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 815639us
I20260709 13:02:11.460949  2210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41288 (request call id 39) took 1414 ms. Trace:
I20260709 13:02:11.511876  1605 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:11.639201  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1000) took 1766 ms. Trace:
I20260709 13:02:11.510316  1677 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:11.652477  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1255) took 1130 ms. Trace:
I20260709 13:02:11.651991  1529 rpcz_store.cc:276] 0709 13:02:09.873900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.477902 (+1604002us) service_pool.cc:224] Handling call
0709 13:02:11.510939 (+ 33037us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54eee 0000000000375939 00007f469cfc81e0 00007f469d0910c4 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:11.511081 (+   142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.638974 (+127893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.639147 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5379200}
I20260709 13:02:11.653966  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.654735  1680 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:11.655916  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.511932  1683 rpcz_store.cc:276] 0709 13:02:10.359396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.346980 (+987584us) service_pool.cc:224] Handling call
0709 13:02:11.347241 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.507969 (+160728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.508167 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.638147  1528 rpcz_store.cc:276] 0709 13:02:10.058446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.391316 (+1332870us) service_pool.cc:224] Handling call
0709 13:02:11.514114 (+122798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.640599  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:11.641494  1684 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:11.653100  1534 rpcz_store.cc:276] 0709 13:02:10.521864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.743374 (+221510us) service_pool.cc:224] Handling call
0709 13:02:11.652297 (+908923us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54000dd754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.652409 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825751808}
I20260709 13:02:11.544194  1533 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:11.638221  1531 rpcz_store.cc:276] 0709 13:02:10.437463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.179380 (+741917us) service_pool.cc:224] Handling call
0709 13:02:11.514617 (+335237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:11.649184  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.639243  1527 rpcz_store.cc:269] 0709 13:02:10.059348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.097404 (+ 38056us) service_pool.cc:224] Handling call
0709 13:02:11.490492 (+1393088us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000ddc54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.490610 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978365312}
I20260709 13:02:11.645509  1526 rpcz_store.cc:276] 0709 13:02:10.127741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.643620 (+1515879us) service_pool.cc:224] Handling call
0709 13:02:11.644060 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.644795 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.645037 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:11.511741  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1251) took 1072 ms. Trace:
I20260709 13:02:11.658589  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.656464  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.659459  1607 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:11.659636  1682 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:11.638156  1530 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.474776  4014 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:11.655578  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 184912us
I20260709 13:02:11.660774  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.662431  1605 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:11.658291  1532 rpcz_store.cc:276] 0709 13:02:10.439783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.351451 (+911668us) service_pool.cc:224] Handling call
0709 13:02:11.511577 (+160126us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002c01d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.511688 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280335104}
I20260709 13:02:11.671646  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.672417  1605 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 4.
I20260709 13:02:11.655637  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.560634  3670 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.576581  4015 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:11.543840  3814 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:11.794091  3929 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.576002  3850 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.951923  4015 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:11.952505  3929 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.952700  3850 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.953864  1529 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.955503  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1240) took 1711 ms. Trace:
I20260709 13:02:11.718926  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:11.961244  3814 ts_tablet_manager.cc:1434] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 1.886s	user 0.012s	sys 0.040s
W20260709 13:02:11.961916  3814 ts_tablet_manager.cc:1467] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Tablet startup took 1919ms
I20260709 13:02:11.962596  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:11.819900  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 153884us
I20260709 13:02:11.717909  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:11.955924  1529 rpcz_store.cc:276] 0709 13:02:10.243859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.819933 (+1576074us) service_pool.cc:224] Handling call
0709 13:02:11.820269 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.954290 (+134021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.955265 (+   975us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540003f054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:11.955435 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306796416}
W20260709 13:02:11.719568  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1010) took 1474 ms (client timeout 1834 ms). Trace:
I20260709 13:02:11.721916  1676 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:11.964394  1684 rpcz_store.cc:269] 0709 13:02:10.245523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.564109 (+318586us) service_pool.cc:224] Handling call
0709 13:02:11.719421 (+1155312us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400033ed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:11.719516 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665627520}
I20260709 13:02:11.804078  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.965808  1678 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:11.723030  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48027.7us
I20260709 13:02:11.753392  1530 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
W20260709 13:02:11.834623  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.619429  4005 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.799811  3944 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.793888  4001 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.921357  1681 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:11.959173  3932 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:11.915486  4033 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:11.717374  3925 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:11.959687  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 304102us
I20260709 13:02:11.514154  3959 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.719604  1680 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:11.717775  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.913664  1534 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.923067  3912 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:11.822513  3909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.025s
I20260709 13:02:11.509452  4023 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:11.712834  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:11.672693  3927 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.651448  3930 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.982127  3929 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.651507  3778 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:11.615808  3460 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.041767  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:02:12.094705  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53029us
I20260709 13:02:11.682503  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.010442  1678 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:11.873297  1679 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:11.792464  3986 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.880703  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1238) took 1772 ms. Trace:
I20260709 13:02:11.712560  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:11.709518  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69009.4us
I20260709 13:02:11.664749  3882 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.966148  1531 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.055302  1529 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:11.617792  4008 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.475s
I20260709 13:02:11.560863  4000 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:11.941658  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.834277  1682 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.010417  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.111656  1603 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:11.616714  4024 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:11.861989  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:11.836248  1683 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:11.836185  1677 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:12.113123  1604 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:12.055456  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87423.6us
I20260709 13:02:11.865581  1526 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.115312  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1243) took 1678 ms. Trace:
I20260709 13:02:12.115633  1526 rpcz_store.cc:276] 0709 13:02:10.437082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.864875 (+1427793us) service_pool.cc:224] Handling call
0709 13:02:11.865297 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.115098 (+249801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.115262 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.117185  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.117870  1526 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:12.118471  3908 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:12.119071  1526 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:12.119832  3908 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:12.060242  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96278.7us
I20260709 13:02:12.052670  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.879312  3921 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:11.794790  3768 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.819204  4019 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.270s
I20260709 13:02:11.721000  3855 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.016410  3786 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:02:11.651841  3590 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.720690  4012 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.056344  3932 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.665318  3886 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:11.716620  4027 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:02:12.055840  3909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.010s	sys 0.033s
I20260709 13:02:11.955822  4015 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.957284  3850 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.037739  3670 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:11.709980  4021 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:12.015765  3910 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.537s	user 0.001s	sys 0.006s
I20260709 13:02:12.016575  4006 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.073254  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:11.781368  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 108764us
I20260709 13:02:12.087193  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:11.673133  3870 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.052958  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1245) took 1615 ms. Trace:
I20260709 13:02:11.713063  4017 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.843362  3990 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:12.109618  3986 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.103139  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.106482  1528 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.106953  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:12.105597  1533 rpcz_store.cc:276] 0709 13:02:10.108538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.477897 (+1369359us) service_pool.cc:224] Handling call
0709 13:02:11.478219 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.659423 (+181204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.880359 (+220936us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b540020a654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:11.880626 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150866560}
I20260709 13:02:12.103911  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.107668  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1241) took 1717 ms. Trace:
I20260709 13:02:12.054137  1527 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:11.552434  3958 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.109321  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1246) took 1671 ms. Trace:
W20260709 13:02:12.072190  3920 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.005s
I20260709 13:02:11.800060  3784 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.304s
I20260709 13:02:12.076588  4005 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.076757  4014 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:11.720187  3971 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.384s
I20260709 13:02:12.072467  3686 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.120244  1526 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:12.059207  1535 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.093360  3778 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.090152  3925 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.121918  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.069723  3927 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.082392  3930 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.090620  4023 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:12.124881  1604 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.104121  3997 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:12.128429  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.060887  3944 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.125455  3446 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:12.133575  3460 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.061486  3959 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:12.061755  4001 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.140247  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1248) took 1701 ms. Trace:
I20260709 13:02:12.164526  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.356820  4017 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.356860  1530 rpcz_store.cc:276] 0709 13:02:10.438836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.969044 (+1530208us) service_pool.cc:224] Handling call
0709 13:02:12.090265 (+121221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.124336 (+ 34071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.124387 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.124452 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:12.124506 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.139950 (+ 15444us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:12.140019 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.140182 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77704960}
I20260709 13:02:12.357954  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.359184  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.356887  1607 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.360435  3670 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:12.156170  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.361105  1675 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:12.362351  1526 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:12.244594  1603 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:12.210264  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 89230us
I20260709 13:02:12.240953  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:12.365315  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 258412us
I20260709 13:02:12.361672  1534 rpcz_store.cc:276] 0709 13:02:10.437802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.866479 (+1428677us) service_pool.cc:224] Handling call
0709 13:02:11.911495 (+ 45016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.052695 (+141200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.052889 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.362730  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:11.651616  2210 rpcz_store.cc:276] 0709 13:02:10.034872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.035645 (+   773us) service_pool.cc:224] Handling call
0709 13:02:10.036056 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.036479 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.036515 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.037083 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.322221 (+1285138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.322284 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.346728 (+ 24444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.360302 (+ 13574us) raft_consensus.cc:1685] finished
0709 13:02:11.372414 (+ 12112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.439219 (+ 66805us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8575,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":98,"thread_start_us":1284732,"threads_started":1,"wal-append.queue_time_us":559739,"wal-append.run_cpu_time_us":1640,"wal-append.run_wall_time_us":1001657}
W20260709 13:02:12.366211  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 245033us
W20260709 13:02:12.373071  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 285948us
I20260709 13:02:12.361989  1529 rpcz_store.cc:276] 0709 13:02:10.438177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.963984 (+1525807us) service_pool.cc:224] Handling call
0709 13:02:12.055008 (+ 91024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.109071 (+ 54063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.109269 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.374086  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:12.201894  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 149359us
I20260709 13:02:12.375186  1604 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:12.363605  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.366324  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:12.381037  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:12.382634  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1007) took 2196 ms (client timeout 2212 ms). Trace:
I20260709 13:02:12.383286  3768 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:12.383111  1675 rpcz_store.cc:269] 0709 13:02:10.176803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.176964 (+   161us) service_pool.cc:224] Handling call
0709 13:02:12.370594 (+2193630us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540040fe54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:12.372907 (+  2313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948076928}
I20260709 13:02:12.383939  3768 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:12.384446  4000 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.369694  3446 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.384727  4025 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:12.372469  4019 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:02:12.385458  4025 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:12.385872  4025 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.356446  3886 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.386770  3886 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.387691  3446 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.384003  4001 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.396325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.372611  4008 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.373864  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.140929  3932 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.389740  3927 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.388437  3460 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:12.376555  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 254704us
I20260709 13:02:12.423205  1675 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:12.373138  3925 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:12.382628  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 258906us
I20260709 13:02:12.389652  3986 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.384510  3768 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.361671  1532 rpcz_store.cc:276] 0709 13:02:10.390725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.847494 (+1456769us) service_pool.cc:224] Handling call
0709 13:02:11.862515 (+ 15021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.862776 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:11.910218 (+ 47442us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.107155 (+196937us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.107352 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.107393 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:12.107436 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.107499 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.107613 (+   114us) inbound_call.cc:177] Queueing success response
0709 13:02:12.201601 (+ 93988us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180041c500. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:12.240929 (+ 39328us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b180041c500. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:12.269107 (+ 28178us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180041c500. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f
Metrics: {"mutex_wait_us":3275,"prepare.queue_time_us":47676,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2532,"raft.queue_time_us":2201,"raft.run_cpu_time_us":2611,"raft.run_wall_time_us":160034,"spinlock_wait_cycles":42050816,"thread_start_us":139179,"threads_started":1,"wal-append.queue_time_us":212587}
I20260709 13:02:12.401863  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.359515  3870 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.408169  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:12.408358  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.412392  1607 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:12.423749  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:12.424281  1530 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:12.424316  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.425635  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.426925  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.202198  3882 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:12.370227  3778 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.431193  1605 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.431316  1609 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:12.396510  3997 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:12.359200  4017 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.426699  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:12.356578  3990 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.371234  3910 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.428006  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.601651  1679 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.602182  1682 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.584302  4001 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.421362  4000 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:12.603339  4001 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:12.605607  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 203816us
I20260709 13:02:12.487414  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.433794  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:12.603852  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 174348us
I20260709 13:02:12.607412  1684 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:12.545445  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.602669  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.432813  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.608958  1681 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.610807  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.611452  1681 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:12.460088  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.600868  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.510365  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.608911  1679 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:12.606014  1683 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:12.612607  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.615732  1681 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.616097  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.616554  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.617168  1681 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.617350  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:12.614960  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 192253us
I20260709 13:02:12.605257  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.618386  1680 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.618727  1677 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.619436  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:12.620283  1680 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.619997  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.618029  1683 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:02:11.962402  3814 ts_tablet_manager.cc:1469] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Trace:
0709 13:02:03.895356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.900598 (+  5242us) service_pool.cc:224] Handling call
0709 13:02:04.511813 (+611215us) ts_tablet_manager.cc:934] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
0709 13:02:06.443638 (+1931825us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:06.793938 (+350300us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:06.794111 (+   173us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:07.032227 (+238116us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:07.041679 (+  9452us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:07.042093 (+   414us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:07.042196 (+   103us) inbound_call.cc:177] Queueing success response
0709 13:02:07.785691 (+743495us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:02:10.075599 (+2289908us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:02:10.124061 (+ 48462us) tablet_replica.cc:261] Starting instrumentation
0709 13:02:10.561227 (+437166us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":319,"mutex_wait_us":2186,"raft.queue_time_us":2496,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"tablet-copy.queue_time_us":550890,"tablet-download-pool.queue_time_us":32733,"tablet-download-pool.run_cpu_time_us":1424,"tablet-download-pool.run_wall_time_us":39538,"thread_start_us":557226,"threads_started":2}
W20260709 13:02:12.614259  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.624378  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-443ffcfd9be74d9891a8cb9596947ca3 received from {username='slave'} at 127.0.0.1:50950
I20260709 13:02:12.625114  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-443ffcfd9be74d9891a8cb9596947ca3 on tablet 443ffcfd9be74d9891a8cb9596947ca3 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:12.625303  1682 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:12.627215  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.627806  1684 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:12.628521  1675 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.629400  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:12.630107  1675 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.630550  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:12.633127  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 226353us
W20260709 13:02:12.634140  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.615091  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.626332  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.637714  1682 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:12.638808  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:12.639560  1681 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.639355  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:02:12.640192  1607 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:12.555743  3886 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.427960  3460 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.603391  4000 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.641855  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.640709  1607 raft_consensus.cc:614] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:12.643899  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.642948  1680 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.636174  1683 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.429399  3855 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.597178  3959 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:12.657994  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:12.661638  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.661896  1684 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.598297  3958 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.404528  3930 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.233s
I20260709 13:02:12.660593  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.607318  3882 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.604079  3925 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.659732  1678 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.663753  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.693912  1679 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:12.666077  3997 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:12.667768  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1363) took 1010 ms. Trace:
I20260709 13:02:12.671722  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.660010  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.660264  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.677379  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.703490  1604 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.703581  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1007) took 1054 ms. Trace:
I20260709 13:02:12.691229  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.709947  1530 rpcz_store.cc:276] 0709 13:02:11.649034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.358999 (+709965us) service_pool.cc:224] Handling call
0709 13:02:12.359268 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.607483 (+248215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.703388 (+ 95905us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54000df054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:12.703528 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148740992}
I20260709 13:02:12.710495  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.675458  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.422438  4019 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.222s
I20260709 13:02:12.694496  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:12.712172  1682 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:12.636790  3590 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.637223  3961 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:12.638079  4020 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.642131  4008 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:12.703512  1683 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:12.703738  1607 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:12.714421  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 72682.4us
I20260709 13:02:12.714824  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.704630  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.658305  3460 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.660118  4014 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.726166  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:12.711360  1603 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:12.632321  3784 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:12.705229  1605 rpcz_store.cc:276] 0709 13:02:11.657568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.762075 (+104507us) service_pool.cc:224] Handling call
0709 13:02:11.762522 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.604362 (+841840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.667511 (+ 63149us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540024aed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:12.667693 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537159424}
I20260709 13:02:12.641121  4017 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.658530  4000 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.727674  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.740942  1604 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.692248  3752 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.645211  4025 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.690975  4012 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.645364  3686 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:02:12.709147  3958 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:02:12.697170  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:12.739530  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103780us
I20260709 13:02:12.742084  1603 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:12.740754  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.777072  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:12.744993  1684 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.746007  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.746410  1679 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:12.715131  3986 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.724900  3670 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.728559  3921 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:12.829216  1606 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:12.753553  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90093.7us
I20260709 13:02:12.750120  4021 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:12.758986  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.727617  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 70) took 1538 ms. Trace:
I20260709 13:02:12.831718  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.726105  4014 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.762190  1604 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:12.726122  3961 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.732591  3784 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.732335  4005 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.561110  4023 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:12.767515  1609 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:12.732908  4008 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:12.742821  4017 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:12.723562  4020 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.743474  3944 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.832751  1533 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:12.697039  3882 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.835541  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.843129  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:12.846484  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.877375  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.878036  1527 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:12.878553  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 151688us
I20260709 13:02:12.831059  1531 rpcz_store.cc:276] 0709 13:02:11.188868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.110629 (+921761us) service_pool.cc:224] Handling call
0709 13:02:12.126916 (+ 16287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.202329 (+ 75413us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:12.479157 (+276828us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.727284 (+248127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.727331 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:12.727376 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.727437 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.727564 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105107,"prepare.queue_time_us":38640,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":86917,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":14568,"thread_start_us":482145,"threads_started":2,"wal-append.queue_time_us":290082}
I20260709 13:02:12.870671  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:12.837042  4014 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.879388  1604 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.871783  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:12.881613  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 166460us
I20260709 13:02:12.883286  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.884383  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.885363  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.886077  1533 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:12.886793  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.886811  1604 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:12.888118  1605 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:12.891103  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:12.770393  3752 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:12.883991  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.877027  3920 raft_consensus.cc:2764] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:12.966670  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 123671us
I20260709 13:02:12.968461  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:12.971433  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 87505us
W20260709 13:02:12.974216  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 13:02:12.837455  3870 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:12.893112  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:12.981057  1526 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:12.943430  3686 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.878221  3784 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.769857  4012 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:12.975656  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:12.866140  3921 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:12.900358  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.877138  3925 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:02:12.837200  3886 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.876655  4017 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.823222  4001 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:12.987718  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 327655us
I20260709 13:02:12.866748  3971 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 13:02:13.053018  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 152792us
I20260709 13:02:12.979708  2210 raft_consensus.cc:2410] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:12.990083  3686 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.850766  3670 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:12.977573  3927 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 13:02:12.979785  4019 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.984227  4005 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:12.978852  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:12.880362  3590 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
W20260709 13:02:13.033424  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 89140.5us
W20260709 13:02:13.039098  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 205533us
I20260709 13:02:12.991026  4021 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:02:13.050041  1530 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:12.988520  4056 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:13.028597  4045 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:02:13.051925  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.026787  3958 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.027904  3990 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.991671  3910 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.031448  4025 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:12.985818  3855 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:02:12.990890  3912 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:02:12.892691  3930 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
W20260709 13:02:13.220856  1675 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.002s
W20260709 13:02:13.230981  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 200356us
W20260709 13:02:13.151620  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.480916  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 502082us
W20260709 13:02:13.333429  1606 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.005s
W20260709 13:02:13.079808  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.514757  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.510074  1675 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
W20260709 13:02:13.517886  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 463915us
I20260709 13:02:13.521817  1606 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:13.522295  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 470451us
W20260709 13:02:13.577813  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.467154  3932 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.035s	user 0.010s	sys 0.003s
W20260709 13:02:13.510190  3778 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.873s	user 0.004s	sys 0.008s
W20260709 13:02:13.235941  4064 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:02:13.117384  3986 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.578578  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.589367  1603 raft_consensus.cc:2410] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:13.579555  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.592857  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:13.577883  4070 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 13:02:13.205353  4060 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.066628  3686 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:13.583455  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.011s
W20260709 13:02:13.604339  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.003s	sys 0.012s
I20260709 13:02:13.481882  4005 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.594969  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.605994  1603 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:13.516808  3927 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:13.593608  1609 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.234679  4020 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.517704  3909 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:13.518167  3786 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.598784  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.578918  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.615031  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.615801  1606 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:13.564229  3870 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:13.578096  4069 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:13.462968  4012 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.508814  3961 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.261392  3921 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:13.578128  4073 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:02:13.624117  1532 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:13.668371  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.591670  3932 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:13.670356  4067 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:02:13.671916  4063 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:13.622021  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92212.1us
W20260709 13:02:13.606637  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.024s
I20260709 13:02:13.565922  4025 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:02:13.676779  4074 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:02:13.677839  3768 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.038s	user 0.011s	sys 0.000s
I20260709 13:02:13.678306  3768 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.610915  4005 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.615839  1603 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:13.608664  3670 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.683038  1609 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:02:13.667186  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 68506.3us
I20260709 13:02:13.683947  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1374) took 1012 ms. Trace:
I20260709 13:02:13.684106  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.685702  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1401) took 1070 ms. Trace:
I20260709 13:02:13.578030  4058 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:02:13.686106  1682 rpcz_store.cc:276] 0709 13:02:12.615567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.712989 (+ 97422us) service_pool.cc:224] Handling call
0709 13:02:12.735129 (+ 22140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.883138 (+148009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.883167 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.883608 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.050749 (+167141us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.113204 (+ 62455us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.113464 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.113571 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.685488 (+571917us) raft_consensus.cc:1685] finished
0709 13:02:13.685511 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.685644 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529276,"prepare.queue_time_us":514197,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":783470,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":45764,"spinlock_wait_cycles":58403456,"thread_start_us":203083,"threads_started":2,"wal-append.queue_time_us":482061}
I20260709 13:02:13.117857  4008 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.065224  3752 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.684684  1607 rpcz_store.cc:276] 0709 13:02:12.671627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.730162 (+ 58535us) service_pool.cc:224] Handling call
0709 13:02:12.730655 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.730960 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.730997 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.733566 (+  2569us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.978992 (+245426us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:12.979040 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.979150 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.683535 (+704385us) raft_consensus.cc:1685] finished
0709 13:02:13.683562 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.683782 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":179694,"threads_started":1,"wal-append.queue_time_us":720511}
W20260709 13:02:13.693593  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 178894us
I20260709 13:02:13.689651  3990 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:02:13.696171  4068 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.697458  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1352) took 2354 ms. Trace:
I20260709 13:02:13.595813  4062 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:02:13.618456  4060 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.760680  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1376) took 1792 ms. Trace:
I20260709 13:02:13.689798  4069 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:13.718223  4000 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.000s
I20260709 13:02:13.721850  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:13.729882  4057 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.384s	user 0.003s	sys 0.009s
I20260709 13:02:13.730464  1430 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:13.637048  4020 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:13.739630  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55652.5us
W20260709 13:02:13.788177  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.011s	sys 0.015s
W20260709 13:02:13.788578  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.012s	sys 0.015s
I20260709 13:02:13.788985  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:13.746551  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69740.2us
I20260709 13:02:13.748765  1648 leader_election.cc:400] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5.
I20260709 13:02:13.596069  3778 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.753975  1603 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.666759  3927 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.750272  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:13.759263  3942 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:13.759537  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:13.684438  4001 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:13.710951  4076 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:13.640954  3786 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.804538  4076 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:13.761945  1601 rpcz_store.cc:276] 0709 13:02:11.342955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.343083 (+   128us) service_pool.cc:224] Handling call
0709 13:02:11.347296 (+  4213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.408324 (+1061028us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:12.488343 (+ 80019us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.666338 (+177995us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800337c00. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:12.769936 (+103598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.770004 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:12.770049 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.697139 (+927090us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001c84d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:13.697205 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.697363 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7198,"prepare.queue_time_us":79247,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":26201,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":34546,"spinlock_wait_cycles":2505784064,"thread_start_us":77492,"threads_started":1,"wal-append.queue_time_us":335028}
I20260709 13:02:13.800544  3912 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:13.776124  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1361) took 2119 ms. Trace:
I20260709 13:02:13.767649  1610 rpcz_store.cc:276] 0709 13:02:11.968453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.425070 (+456617us) service_pool.cc:224] Handling call
0709 13:02:12.426136 (+  1066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.427803 (+  1667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.427829 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.437074 (+  9245us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.883767 (+446693us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:12.883805 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.883870 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.760368 (+876498us) raft_consensus.cc:1685] finished
0709 13:02:13.760395 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.760606 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1272,"raft.queue_time_us":3227,"spinlock_wait_cycles":62491008,"thread_start_us":315040,"threads_started":1,"wal-append.queue_time_us":487781}
I20260709 13:02:13.760131  4080 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:02:13.675437  3686 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:02:13.767326  4066 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:13.760756  3925 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:02:13.793705  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43508.4us
I20260709 13:02:13.794409  3942 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:13.798429  3784 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.004s
I20260709 13:02:13.799060  3778 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.791067  4020 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.800058  4017 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.004s
I20260709 13:02:13.801065  1529 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:13.769495  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:13.793506  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.049s
I20260709 13:02:13.761603  3886 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:02:13.971689  1606 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:13.971844  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:13.972920  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.014s	sys 0.054s
I20260709 13:02:13.805943  1608 rpcz_store.cc:276] 0709 13:02:11.657084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.722693 (+ 65609us) service_pool.cc:224] Handling call
0709 13:02:11.799703 (+ 77010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.423538 (+623835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.423567 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.429762 (+  6195us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.771268 (+341506us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:12.771572 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.698124 (+926552us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540003d4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:13.698165 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.765291 (+ 67126us) raft_consensus.cc:1685] finished
0709 13:02:13.765312 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.776009 (+ 10697us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4157,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":53529,"spinlock_wait_cycles":1433911552,"thread_start_us":225107,"threads_started":1,"wal-append.queue_time_us":434202}
W20260709 13:02:13.934718  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 145813us
I20260709 13:02:13.975558  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:13.934880  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 144985us
W20260709 13:02:13.958600  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.978192  3971 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:13.973713  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 994239us
I20260709 13:02:13.981921  4023 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:13.982980  4023 consensus_queue.cc:1243] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:13.983446  4023 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:13.984047  4023 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:13.982028  3909 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:13.985268  3909 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.985641  3909 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.979383  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1024) took 1132 ms. Trace:
I20260709 13:02:13.984848  3927 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:13.988724  3927 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:13.989179  3768 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.989909  4087 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:13.989720  3927 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.990461  4087 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:13.988257  1526 rpcz_store.cc:276] 0709 13:02:12.847279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.981841 (+134562us) service_pool.cc:224] Handling call
0709 13:02:12.982208 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.982745 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.982785 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.990482 (+  7697us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.789060 (+798578us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.789098 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.789167 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.979160 (+189993us) raft_consensus.cc:1685] finished
0709 13:02:13.979178 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.979323 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7295,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":17399,"thread_start_us":798148,"threads_started":1,"wal-append.queue_time_us":985537}
I20260709 13:02:13.974735  4058 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:13.904989  3460 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.166s	user 0.010s	sys 0.002s
I20260709 13:02:13.993000  4058 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.993392  3460 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:13.994588  1535 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:13.995074  1677 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:13.767362  4068 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.996251  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1016) took 1150 ms. Trace:
I20260709 13:02:13.996814  3460 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:13.996675  1535 rpcz_store.cc:276] 0709 13:02:12.845442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.845537 (+    95us) service_pool.cc:224] Handling call
0709 13:02:13.996068 (+1150531us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000dd754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:13.996191 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2535981312}
I20260709 13:02:13.806402  3932 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:13.787990  4000 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:13.997874  4068 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:13.791136  3908 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:13.998582  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.998673  1676 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:13.998930  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 250337us
I20260709 13:02:13.999800  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:13.999919  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1381) took 1539 ms (client timeout 1772 ms). Trace:
I20260709 13:02:13.974368  4020 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:14.000527  1676 rpcz_store.cc:269] 0709 13:02:12.460399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.626711 (+166312us) service_pool.cc:224] Handling call
0709 13:02:13.999708 (+1372997us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003cd2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:13.999862 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002204544}
I20260709 13:02:14.003271  4000 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:14.000952  3786 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.004117  3908 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:13.981561  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.005695  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:13.981730  3784 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.011204  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:14.026913  1526 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:14.037341  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
W20260709 13:02:13.818712  3882 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 13:02:14.037461  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:14.039160  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:13.927318  4014 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.048s	user 0.014s	sys 0.000s
I20260709 13:02:14.040979  4014 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.043419  4014 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.023314  3786 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.044576  3786 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:14.012009  4058 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.044924  3686 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.045307  3882 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.047458  3882 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.047951  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1013) took 1214 ms. Trace:
I20260709 13:02:14.048395  1529 rpcz_store.cc:276] 0709 13:02:12.834105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.835162 (+  1057us) service_pool.cc:224] Handling call
0709 13:02:14.047761 (+1212599us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54000f7154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:14.047892 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123792640}
I20260709 13:02:14.048750  3932 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:14.049746  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1010) took 1220 ms. Trace:
I20260709 13:02:13.991523  4087 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.050145  1530 rpcz_store.cc:276] 0709 13:02:12.829770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.829907 (+   137us) service_pool.cc:224] Handling call
0709 13:02:12.880442 (+ 50535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.480807 (+600365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.049522 (+568715us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:14.049689 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365137664}
I20260709 13:02:14.050704  4082 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:13.891566  4001 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.052269  3961 raft_consensus.cc:2764] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:14.053177  4001 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:14.053356  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:13.819583  4069 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.054662  4058 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.055127  4076 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.055331  4005 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.057276  3784 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:14.060727  3958 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:02:13.805758  3912 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:13.975190  3942 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.065653  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:14.066545  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60934.7us
I20260709 13:02:14.076283  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.059654  3909 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.071003  4083 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.070775  4084 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:14.071920  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.038901  3930 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.076857  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.070679  4025 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:14.137480  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.138134  1602 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.974637  4017 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.145200  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1402) took 1529 ms. Trace:
I20260709 13:02:14.076335  3855 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:14.090601  4040 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:14.045056  3786 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.088171  4019 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.074362  4060 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.092342  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1392) took 1482 ms. Trace:
I20260709 13:02:14.148813  1430 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.150238  1677 rpcz_store.cc:276] 0709 13:02:12.610184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.619774 (+  9590us) service_pool.cc:224] Handling call
0709 13:02:14.092086 (+1472312us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002e8bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:14.092262 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158727424}
I20260709 13:02:14.095497  1574 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:14.076282  1605 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.173902  1574 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.036546  4021 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:14.088140  1601 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.098326  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1405) took 1462 ms. Trace:
I20260709 13:02:14.100246  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.188442  1604 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.064931  3870 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:14.101397  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.196761  1607 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:02:14.101531  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 173059us
I20260709 13:02:14.139452  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:14.140691  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:14.145934  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 49) took 2815 ms. Trace:
I20260709 13:02:14.201437  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:14.202136  1527 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:14.098367  3886 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.202323  1535 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:02:14.184593  1681 rpcz_store.cc:276] 0709 13:02:12.635610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.734625 (+ 99015us) service_pool.cc:224] Handling call
0709 13:02:12.734945 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.945058 (+210113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.945103 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.967065 (+ 21962us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.522482 (+555417us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:13.769581 (+247099us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.097921 (+328340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.098000 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.098057 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:14.098075 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.098247 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391193,"prepare.queue_time_us":273737,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":582118,"raft.run_cpu_time_us":2832,"raft.run_wall_time_us":40314,"thread_start_us":769512,"threads_started":3,"wal-append.queue_time_us":598633}
I20260709 13:02:14.073076  3686 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:14.106709  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.148801  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72061.4us
I20260709 13:02:14.211323  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.212304  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.102072  4083 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.076159  3912 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.075253  3958 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:14.087548  4058 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:14.170928  1430 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.149755  3932 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.201241  1433 rpcz_store.cc:276] 0709 13:02:11.330158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.330326 (+   168us) service_pool.cc:224] Handling call
0709 13:02:14.145874 (+2815548us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:11.958891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:11.959454 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:11.959486 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:02:11.959503 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:11.959923 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:11.959976 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:11.960006 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:11.960370 (+   364us) tablet.cc:701] Row locks acquired
0709 13:02:11.960388 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:11.960546 (+   158us) write_op.cc:270] Start()
0709 13:02:11.960667 (+   121us) write_op.cc:276] Timestamp: P: 1783602131960488 usec, L: 0
0709 13:02:11.960691 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:11.961386 (+   695us) log.cc:844] Serialized 918 byte log entry
0709 13:02:12.698021 (+736635us) op_driver.cc:464] REPLICATION: finished
0709 13:02:13.057784 (+359763us) write_op.cc:301] APPLY: starting
0709 13:02:13.062720 (+  4936us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:13.117620 (+ 54900us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:13.218264 (+100644us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:13.358809 (+140545us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:13.363598 (+  4789us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:13.363656 (+    58us) write_op.cc:312] APPLY: finished
0709 13:02:13.363889 (+   233us) log.cc:844] Serialized 28 byte log entry
0709 13:02:13.364148 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:13.364274 (+   126us) write_op.cc:454] Released schema lock
0709 13:02:13.364351 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:13.378253 (+ 13902us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:13.378284 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4325,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":329232,"apply.run_cpu_time_us":3247,"apply.run_wall_time_us":339597,"num_ops":2,"prepare.queue_time_us":394307,"prepare.run_cpu_time_us":14979,"prepare.run_wall_time_us":179755,"raft.queue_time_us":408121,"raft.run_cpu_time_us":10518,"raft.run_wall_time_us":259744,"replication_time_us":683274,"thread_start_us":893707,"threads_started":4,"wal-append.queue_time_us":238496}]]}
I20260709 13:02:14.043285  3908 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.212579  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.086020  4076 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.212932  1607 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.242574  1604 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:14.209698  3686 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.214385  1528 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:02:14.221271  4056 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.003s
I20260709 13:02:14.215252  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:14.251484  1533 raft_consensus.cc:2368] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:14.220258  1678 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:14.217110  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:14.145893  1683 rpcz_store.cc:276] 0709 13:02:12.615839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.724022 (+108183us) service_pool.cc:224] Handling call
0709 13:02:12.724506 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.724966 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.725007 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.725589 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.978745 (+253156us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.695200 (+716455us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b18001510c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:13.715733 (+ 20533us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18001510c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:02:13.889792 (+174059us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.144806 (+255014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.144889 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.144941 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:14.144959 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.145109 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388836,"prepare.queue_time_us":817180,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":4695,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4297,"spinlock_wait_cycles":59986560,"thread_start_us":301813,"threads_started":2,"wal-append.queue_time_us":409576}
I20260709 13:02:14.245661  3910 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:14.232570  1430 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 7, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:14.235678  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 235936us
I20260709 13:02:14.077323  3925 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:02:14.237135  1605 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:14.261497  1528 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:14.242439  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
W20260709 13:02:14.238602  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143237us
I20260709 13:02:14.244616  1606 raft_consensus.cc:606] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:14.139065  3944 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:14.167796  4019 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:14.245610  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:14.233305  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 136977us
I20260709 13:02:14.222914  4083 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.258149  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.270375  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.258637  1430 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 7 to 8, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.263226  1606 raft_consensus.cc:614] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:14.149928  3961 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:02:14.202440  4008 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:02:14.273904  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:14.268841  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:14.274441  1603 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:14.252359  3686 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.277278  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.214761  3886 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.280587  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.282868  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:14.282591  1430 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.259249  4056 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.213164  4021 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.283655  4060 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:14.288748  4061 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.289481  4089 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:02:14.289705  4063 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:14.264693  4006 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.262833  4017 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:14.309311  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.306550  1430 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.290727  4084 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:02:14.310557  4093 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:02:14.310801  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.311290  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1011) took 1481 ms. Trace:
I20260709 13:02:14.394892  1532 rpcz_store.cc:276] 0709 13:02:12.830204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.830309 (+   105us) service_pool.cc:224] Handling call
0709 13:02:12.830638 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.668067 (+837429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.311053 (+642986us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54000fb754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:14.311233 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824352128}
I20260709 13:02:14.394584  1430 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 6, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.311415  4000 raft_consensus.cc:2764] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:02:14.396443  1430 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 7, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 7 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.322093  1574 leader_election.cc:400] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:14.201704  4040 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:14.333055  1602 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.264300  4082 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:14.341291  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.399279  1605 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
W20260709 13:02:14.341660  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 89867.3us
I20260709 13:02:14.284119  4062 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.350533  1677 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:14.351751  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.400278  4040 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:14.400781  1574 leader_election.cc:403] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.356803  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.401211  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.401906  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.401985  1677 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:14.402524  1682 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.402549  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.403623  1684 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:14.367657  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.298467  4069 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:14.400733  1680 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:14.353664  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.277071  3944 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.404587  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.337280  3446 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.401494  1681 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:14.412487  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:14.404500  1683 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:14.408684  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 86811.7us
W20260709 13:02:14.409242  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98528.8us
I20260709 13:02:14.414126  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:14.401978  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.415409  1676 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.418202  1602 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:14.341970  4006 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.362099  3752 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.422363  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:14.426864  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.421974  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:14.428231  1532 raft_consensus.cc:2368] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:14.429680  1532 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:14.403164  1430 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.433525  1682 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:14.433424  1430 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:14.434762  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.342705  4025 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:02:14.313653  3870 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.365995  4063 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.374271  4019 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.434616  1676 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
W20260709 13:02:14.513744  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.711598  1607 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:14.715081  1607 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:14.713759  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.717952  1676 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.743681  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:14.747208  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.752472  1676 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.420433  3932 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.755568  1430 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 7, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:14.420853  4017 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:14.413555  4056 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:14.754010  1648 leader_election.cc:400] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:14.890192  1648 leader_election.cc:403] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.497083  1526 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:14.753118  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:14.891516  1605 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
I20260709 13:02:14.715994  1607 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:14.768162  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.065s
I20260709 13:02:14.499819  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.426761  4006 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:14.892690  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.004s	sys 0.065s
I20260709 13:02:14.427412  4087 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.898476  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:14.899163  2178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.013s
W20260709 13:02:14.899655  2178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.014s
W20260709 13:02:14.899998  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 565005us
I20260709 13:02:14.419960  4005 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.419874  3446 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:14.892136  1676 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:14.901867  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.902652  1676 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:14.903756  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:14.907239  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45542.7us
I20260709 13:02:14.900298  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.909931  1684 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:14.908372  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:14.567183  4020 consensus_meta.cc:287] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.011s
I20260709 13:02:14.927807  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:14.435238  4061 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:14.900799  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.001s	sys 0.017s
I20260709 13:02:14.496915  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:14.971954  1682 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:14.437585  4077 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:14.978255  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:14.985630  1684 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:14.988286  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:14.977160  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.002s	sys 0.017s
I20260709 13:02:14.501490  3909 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.429337  3961 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.500s
I20260709 13:02:14.998863  1675 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:14.999279  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.002877  3921 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.004541  3882 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:14.926465  3446 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.016002  1601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.028s	sys 0.025s
W20260709 13:02:15.027140  1601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.029s	sys 0.025s
I20260709 13:02:14.437924  3752 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:15.023559  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 269695us
I20260709 13:02:15.032886  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.013628  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.034791  1682 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:14.929721  3920 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:14.950855  4025 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:15.042409  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.055186  1684 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:15.056798  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:15.101593  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.047971  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.033s	sys 0.026s
W20260709 13:02:15.125147  4103 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.706s	user 0.000s	sys 0.001s
W20260709 13:02:15.125413  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.034s	sys 0.027s
I20260709 13:02:15.125620  4001 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:15.125797  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 705199us
I20260709 13:02:15.126210  4001 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:14.865391  4099 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.745s
I20260709 13:02:15.127769  3752 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:15.129443  4001 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:15.132346  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:15.133255  1684 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:14.907780  3932 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:15.049242  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.135680  3932 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:14.600924  4085 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.762s
W20260709 13:02:15.050395  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.010s	sys 0.049s
I20260709 13:02:15.016345  4077 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.137297  4077 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:15.030382  3786 consensus_meta.cc:287] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.001s
I20260709 13:02:14.976361  4020 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.132395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.169786  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:15.174793  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:15.020057  4019 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.022645  3882 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:15.120615  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 87836.5us
W20260709 13:02:15.138018  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.049s
I20260709 13:02:15.185382  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.187018  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.026578  3921 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.150354  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:15.154498  4076 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.902s	user 0.005s	sys 0.004s
I20260709 13:02:15.028328  4021 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.117673  3886 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:15.159016  4102 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.541s	user 0.001s	sys 0.000s
I20260709 13:02:15.054651  4025 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:14.968647  4017 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:15.139109  4061 raft_consensus.cc:2764] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:02:15.160550  3752 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.162523  4023 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.193774  3909 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:15.211760  4060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.030s
W20260709 13:02:15.192209  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 283906us
I20260709 13:02:15.202559  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:15.240278  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 90053.6us
I20260709 13:02:15.275368  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.277663  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1031) took 1138 ms. Trace:
I20260709 13:02:15.278173  1526 rpcz_store.cc:276] 0709 13:02:14.138994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.139214 (+   220us) service_pool.cc:224] Handling call
0709 13:02:15.277460 (+1138246us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:15.277589 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596260096}
I20260709 13:02:15.228645  3920 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.194864  4113 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.119s
W20260709 13:02:15.210407  3912 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.002s
I20260709 13:02:15.319234  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:15.299981  4111 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.299893  3920 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.322582  3920 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:15.333974  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131511us
I20260709 13:02:15.335295  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:15.189589  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.204301  3971 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.343140  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 153633us
I20260709 13:02:15.344368  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.211882  4001 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:15.293332  4021 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.280858  4076 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.227064  3670 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:15.268185  4060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.007s	sys 0.030s
I20260709 13:02:15.210650  3944 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.302201  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1035) took 1161 ms. Trace:
I20260709 13:02:15.172580  3786 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.310854  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43302 (request call id 5) took 1239 ms. Trace:
I20260709 13:02:15.314018  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:15.258225  3886 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.319034  3912 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:15.378671  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64766.7us
W20260709 13:02:15.202248  4069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.007s	sys 0.025s
I20260709 13:02:15.347275  3446 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.250514  1530 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:15.363214  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:15.364133  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1398) took 1291 ms. Trace:
I20260709 13:02:15.371760  1606 rpcz_store.cc:276] 0709 13:02:14.037081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.037221 (+   140us) service_pool.cc:224] Handling call
0709 13:02:15.275935 (+1238714us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001734d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698073853 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:15.276076 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474683264}
I20260709 13:02:15.368140  1534 rpcz_store.cc:276] 0709 13:02:14.141235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.141378 (+   143us) service_pool.cc:224] Handling call
0709 13:02:14.201411 (+ 60033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.212343 (+ 10932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.212380 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.221495 (+  9115us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.424900 (+203405us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:14.424981 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.425064 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.301956 (+876892us) raft_consensus.cc:1685] finished
0709 13:02:15.301977 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.302113 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10517,"raft.queue_time_us":11051,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17232,"thread_start_us":162097,"threads_started":1,"wal-append.queue_time_us":1004913}
I20260709 13:02:15.358151  4061 raft_consensus.cc:2764] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:02:15.333652  3909 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:15.391495  1609 rpcz_store.cc:276] 0709 13:02:14.072863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.073011 (+   148us) service_pool.cc:224] Handling call
0709 13:02:14.086001 (+ 12990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.213637 (+127636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.213674 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.214082 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.393669 (+179587us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.393708 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.393912 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.360202 (+966290us) raft_consensus.cc:1685] finished
0709 13:02:15.360230 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.364045 (+  3815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15362,"raft.queue_time_us":150708,"spinlock_wait_cycles":13202176,"thread_start_us":270124,"threads_started":2,"wal-append.queue_time_us":218724}
W20260709 13:02:15.371706  3942 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.278s	user 0.005s	sys 0.006s
I20260709 13:02:15.398998  3446 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.355679  4001 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.359203  4023 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.378191  3886 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:15.393882  4069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.007s	sys 0.026s
I20260709 13:02:15.413105  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1407) took 1050 ms. Trace:
I20260709 13:02:15.415185  1534 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.369145  4119 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:15.417001  1526 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.394066  4111 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:15.419003  1601 rpcz_store.cc:276] 0709 13:02:14.363175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.363333 (+   158us) service_pool.cc:224] Handling call
0709 13:02:14.407964 (+ 44631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.408175 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:15.027679 (+619504us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.412738 (+385059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.412800 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:15.412854 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.412929 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.413046 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":744077,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":985393,"threads_started":3}
I20260709 13:02:15.399868  3870 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.358374  3971 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.368196  4021 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:15.427839  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 83599.1us
I20260709 13:02:15.404711  3670 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:15.375485  4076 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.409103  3944 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.432538  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.358682  4025 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.433981  3870 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.456022  3870 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.458492  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.459060  4127 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.459832  4127 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.418061  3886 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.415573  4001 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.435354  3944 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.411590  3942 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.578240  3786 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.399411  4017 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.428169  4132 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:15.436738  3686 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.128s	user 0.009s	sys 0.002s
W20260709 13:02:15.438963  4110 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:02:15.444198  4061 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.354049  3882 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.445015  3909 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.445708  4021 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.380268  4006 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.447942  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1411) took 1097 ms. Trace:
I20260709 13:02:15.558446  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1405) took 1195 ms. Trace:
I20260709 13:02:15.418102  4069 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:15.426551  3752 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:15.435429  4114 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:02:15.572059  3944 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.426429  4111 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:15.605645  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.699561  4025 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.694540  4087 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:15.694600  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 419313us
I20260709 13:02:15.680853  3920 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.706427  4087 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.709942  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1036) took 1568 ms. Trace:
I20260709 13:02:15.710860  3786 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.711334  4126 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.710345  1535 rpcz_store.cc:276] 0709 13:02:14.141710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.203288 (+ 61578us) service_pool.cc:224] Handling call
0709 13:02:14.232422 (+ 29134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.234988 (+  2566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.235014 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.235458 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.893247 (+657789us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.893304 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.893416 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.709680 (+816264us) raft_consensus.cc:1685] finished
0709 13:02:15.709701 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.709886 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159,"raft.queue_time_us":93,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9513,"thread_start_us":626738,"threads_started":1,"wal-append.queue_time_us":719396}
I20260709 13:02:15.711711  3786 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:15.694447  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 261975us
I20260709 13:02:15.711949  4126 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.713786  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.713905  3786 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.714082  4126 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.714896  3786 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:15.715552  3786 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.716430  3686 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.721650  4063 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:15.704751  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1037) took 1562 ms. Trace:
I20260709 13:02:15.727758  3686 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.719413  1679 rpcz_store.cc:276] 0709 13:02:14.350695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.350836 (+   141us) service_pool.cc:224] Handling call
0709 13:02:14.407068 (+ 56232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.407349 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.407386 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.419478 (+ 12092us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.880752 (+461274us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.880808 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.880918 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.447708 (+566790us) raft_consensus.cc:1685] finished
0709 13:02:15.447734 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.447873 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":383607,"threads_started":1,"wal-append.queue_time_us":936676}
I20260709 13:02:15.728751  3686 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.729262  3686 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.729709  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:15.730435  1679 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:15.731230  3686 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.710115  1602 rpcz_store.cc:276] 0709 13:02:14.269995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.270133 (+   138us) service_pool.cc:224] Handling call
0709 13:02:15.465358 (+1195225us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b5400249d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:15.465503 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142712576}
I20260709 13:02:15.718151  3786 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.432292  4119 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:15.582442  4083 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.298s	user 0.008s	sys 0.005s
W20260709 13:02:15.699743  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.720646  1676 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:15.720799  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1042) took 1299 ms. Trace:
W20260709 13:02:15.619596  3930 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.451s	user 0.004s	sys 0.009s
I20260709 13:02:15.721732  3752 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:15.722121  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.705273  4127 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.705287  4132 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.579563  3942 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.579214  1532 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:15.702473  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 367245us
I20260709 13:02:15.435542  3670 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.727187  1527 rpcz_store.cc:276] 0709 13:02:14.141995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.243958 (+101963us) service_pool.cc:224] Handling call
0709 13:02:14.258857 (+ 14899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.273796 (+ 14939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.273826 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.287467 (+ 13641us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.425494 (+138027us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:14.425530 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.425593 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.440512 (+1014919us) raft_consensus.cc:1685] finished
0709 13:02:15.440543 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.704666 (+264123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14518,"raft.queue_time_us":15134,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8543,"thread_start_us":59707,"threads_started":1,"wal-append.queue_time_us":951946}
I20260709 13:02:15.718583  4111 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.735745  1533 rpcz_store.cc:276] 0709 13:02:14.421668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.422075 (+   407us) service_pool.cc:224] Handling call
0709 13:02:14.422352 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.422694 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.422722 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.423192 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.965440 (+542248us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.965674 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.965771 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.720152 (+754381us) raft_consensus.cc:1685] finished
0709 13:02:15.720172 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.720742 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91789,"raft.queue_time_us":5668,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":22822,"thread_start_us":384829,"threads_started":1,"wal-append.queue_time_us":687959}
I20260709 13:02:15.746906  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:15.447985  3912 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.757097  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:15.737927  4063 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.747768  4021 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:15.782727  4124 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:15.748467  3930 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:15.788004  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.799968  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.800401  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.806358  4125 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.807098  4125 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.791309  3908 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.793417  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1393) took 1729 ms. Trace:
I20260709 13:02:15.813017  1610 rpcz_store.cc:276] 0709 13:02:14.063639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.074105 (+ 10466us) service_pool.cc:224] Handling call
0709 13:02:14.074376 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.394749 (+320373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.394819 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.394877 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:14.394923 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.793152 (+1398229us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400085054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:15.793203 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.793349 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691291008}
I20260709 13:02:15.825137  4100 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:15.825819  4100 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:15.826943  4100 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.734755  4020 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.808502  3752 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.809463  4058 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:15.810751  4089 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:15.788117  4136 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:15.794369  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:15.857950  1527 raft_consensus.cc:606] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:15.858585  1527 raft_consensus.cc:614] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:15.733242  4083 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.799328  4124 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.859944  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1404) took 3218 ms. Trace:
I20260709 13:02:15.763501  4127 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:15.835124  4077 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.000s
I20260709 13:02:15.863094  1678 rpcz_store.cc:276] 0709 13:02:12.635000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.716828 (+ 81828us) service_pool.cc:224] Handling call
0709 13:02:12.739372 (+ 22544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.256172 (+1516800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.853464 (+1597292us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003cb9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:15.853683 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405177600}
W20260709 13:02:15.875368  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161631us
I20260709 13:02:15.879065  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.889843  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:15.989678  1531 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:02:15.989792  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:02:15.991053  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:16.003909  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.019s (SENT) [suppressed 7 similar messages]
I20260709 13:02:15.886969  3986 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.864086  4100 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.028249  1678 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:16.030916  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 284074us
I20260709 13:02:15.835340  4021 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:15.872664  4136 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:16.048533  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:15.865852  4124 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.866446  4127 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:16.068486  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1062) took 1023 ms. Trace:
I20260709 13:02:16.071187  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1394) took 2007 ms. Trace:
I20260709 13:02:15.860888  4058 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.080456  1608 rpcz_store.cc:276] 0709 13:02:14.063932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.064734 (+   802us) service_pool.cc:224] Handling call
0709 13:02:14.096783 (+ 32049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.145203 (+ 48420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.145234 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.210048 (+ 64814us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.456654 (+1246606us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b1800412a80. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:15.686593 (+229939us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:15.686653 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.686751 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.070810 (+384059us) raft_consensus.cc:1685] finished
0709 13:02:16.070836 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.071108 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64323,"raft.queue_time_us":141631,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":8179,"spinlock_wait_cycles":11243776,"thread_start_us":229684,"threads_started":1,"wal-append.queue_time_us":1644856}
I20260709 13:02:16.082337  1678 rpcz_store.cc:276] 0709 13:02:15.059938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.872502 (+812564us) service_pool.cc:224] Handling call
0709 13:02:16.027998 (+155496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.068160 (+ 40162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.068417 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.095515  4144 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.097808  4083 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:15.896607  4020 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.120054  4144 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.059158  3909 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.888826  4077 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.106854  4127 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.047012  3986 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.113615  4023 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.001s
I20260709 13:02:15.898315  4089 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:15.763806  4119 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:15.773401  4069 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.168022  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 177054us
I20260709 13:02:16.148988  4020 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.181944  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:16.182703  4020 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:16.167243  3927 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:16.194531  3986 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:16.195134  3986 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:16.195405  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1060) took 1193 ms. Trace:
I20260709 13:02:16.202220  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:16.195622  3986 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.203083  3870 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.003s
I20260709 13:02:16.204330  4146 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:16.204941  4146 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:16.204993  3986 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:16.205669  3986 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.205889  4146 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.206676  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1029) took 2068 ms. Trace:
I20260709 13:02:16.206555  3986 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:16.208755  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.195776  1679 rpcz_store.cc:276] 0709 13:02:15.001735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.731324 (+729589us) service_pool.cc:224] Handling call
0709 13:02:15.735173 (+  3849us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.735782 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.735811 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.749824 (+ 14013us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.069254 (+319430us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:16.069308 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.069394 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.195197 (+125803us) raft_consensus.cc:1685] finished
0709 13:02:16.195216 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.195348 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86247,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":287842,"threads_started":1,"wal-append.queue_time_us":411752}
I20260709 13:02:16.203294  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1050) took 1703 ms. Trace:
I20260709 13:02:16.214656  1682 rpcz_store.cc:276] 0709 13:02:14.500420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.201852 (+1701432us) service_pool.cc:224] Handling call
0709 13:02:16.203224 (+  1372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.207233  1530 rpcz_store.cc:276] 0709 13:02:14.138424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.138553 (+   129us) service_pool.cc:224] Handling call
0709 13:02:14.210458 (+ 71905us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.384923 (+1174465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.206326 (+821403us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540032f5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:16.206584 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340648192}
I20260709 13:02:16.203526  3870 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.223868  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:16.226490  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.189985  4019 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.980s	user 0.008s	sys 0.003s
I20260709 13:02:16.145892  3944 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.232928  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 229143us
W20260709 13:02:16.233355  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.237885  4142 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:02:16.240095  4040 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.243335  3921 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:16.236186  3886 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
I20260709 13:02:16.244266  3986 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.244856  4134 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.256359  1682 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:02:16.283156  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.285008  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:16.290632  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:16.186534  4136 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.308373  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:16.309005  1609 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.310237  4157 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.310807  4157 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.312659  1602 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:16.312850  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 131012us
I20260709 13:02:16.314845  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.315284  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:16.315866  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.281291  3855 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.290063  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.068s
W20260709 13:02:16.326408  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.007s	sys 0.076s
I20260709 13:02:16.235149  3932 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:16.307690  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.305127  1608 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:16.283898  4137 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.248963  4120 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.289398  4080 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.292248  4144 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:16.379084  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.284171  4126 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:02:16.382854  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.386665  1601 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:16.314065  4017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.028s
I20260709 13:02:16.394174  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:16.397395  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:16.288112  4023 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.396196  1533 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:16.397702  1602 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:16.291345  3886 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.401675  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1038) took 2259 ms. Trace:
I20260709 13:02:16.405936  1531 rpcz_store.cc:276] 0709 13:02:14.142303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.255103 (+112800us) service_pool.cc:224] Handling call
0709 13:02:14.270427 (+ 15324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.990653 (+1720226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.401444 (+410791us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540035a7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:16.401607 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3953005440}
I20260709 13:02:16.401842  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1059) took 1412 ms. Trace:
I20260709 13:02:16.407200  1681 rpcz_store.cc:276] 0709 13:02:14.989888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.460568 (+470680us) service_pool.cc:224] Handling call
0709 13:02:15.460913 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.461162 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.461195 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.701742 (+240547us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.734252 (+ 32510us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:15.734289 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.734366 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.401651 (+667285us) raft_consensus.cc:1685] finished
0709 13:02:16.401670 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.401788 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":32074,"threads_started":1,"wal-append.queue_time_us":193685}
I20260709 13:02:16.408735  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:16.409344  1609 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:16.409571  1681 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.302239  3986 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.382880  3752 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.396011  4120 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.390969  3855 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.390777  3932 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:16.727149  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:16.753422  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 358137us
I20260709 13:02:17.295989  1684 raft_consensus.cc:2368] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
W20260709 13:02:17.296506  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1061) took 2273 ms (client timeout 2862 ms). Trace:
W20260709 13:02:17.296916  1684 rpcz_store.cc:269] 0709 13:02:15.023372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.726763 (+1703391us) service_pool.cc:224] Handling call
0709 13:02:17.296451 (+569688us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.297667  4001 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.701s	user 0.022s	sys 0.025s
I20260709 13:02:17.298197  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:16.643350  4129 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:02:17.298702  4158 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.005s	sys 0.030s
I20260709 13:02:16.536778  1681 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:17.324890  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1441) took 1072 ms. Trace:
I20260709 13:02:17.299459  1607 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.325414  1681 rpcz_store.cc:276] 0709 13:02:16.251984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.408474 (+156490us) service_pool.cc:224] Handling call
0709 13:02:17.324798 (+916324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.326701  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.327682  1681 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:16.462560  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:17.328290  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1442) took 1076 ms. Trace:
I20260709 13:02:17.328637  1610 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.328830  1681 rpcz_store.cc:276] 0709 13:02:16.252322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.326382 (+1074060us) service_pool.cc:224] Handling call
0709 13:02:17.328227 (+  1845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.599819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:17.301700  1603 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:16.400647  4017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.029s
W20260709 13:02:17.302179  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.279824  4087 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.572s	user 0.010s	sys 0.002s
W20260709 13:02:17.303351  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.004s	sys 0.017s
I20260709 13:02:16.599013  4063 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.709s
I20260709 13:02:16.394455  4125 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:16.417007  4134 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.891s
I20260709 13:02:16.644392  4089 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.313593  1684 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:17.429806  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1439) took 1178 ms. Trace:
I20260709 13:02:17.430249  1684 rpcz_store.cc:276] 0709 13:02:16.251346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.297846 (+1046500us) service_pool.cc:224] Handling call
0709 13:02:17.429726 (+131880us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.295006  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.298111  4001 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.574131  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 194072us
I20260709 13:02:17.318027  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.434882  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1435) took 1184 ms. Trace:
I20260709 13:02:17.435262  1683 rpcz_store.cc:276] 0709 13:02:16.250051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.317730 (+1067679us) service_pool.cc:224] Handling call
0709 13:02:17.434819 (+117089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.299350  3870 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:16.411135  4145 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:02:16.399716  4019 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:16.593935  4046 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.597795  3908 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.001s
W20260709 13:02:17.262676  4025 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.554s	user 0.013s	sys 0.001s
I20260709 13:02:16.400908  4080 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:16.821816  4156 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.393s	user 0.000s	sys 0.000s
I20260709 13:02:17.379741  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:17.558970  1681 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:17.401682  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.007s	sys 0.024s
I20260709 13:02:16.394058  4137 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.565230  4137 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:16.669075  3944 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.300295  3921 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:17.566515  3921 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:17.569248  3921 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:16.563810  4058 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:17.337620  4158 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.005s	sys 0.030s
I20260709 13:02:17.516392  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.570585  1683 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:17.571247  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1443) took 1318 ms. Trace:
I20260709 13:02:17.571656  1683 rpcz_store.cc:276] 0709 13:02:16.252663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.516020 (+1263357us) service_pool.cc:224] Handling call
0709 13:02:17.571173 (+ 55153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.413157  4023 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:17.272986  4146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.010s	sys 0.003s
I20260709 13:02:17.562040  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:17.563136  4160 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.166s	user 0.024s	sys 0.037s
W20260709 13:02:17.583959  4172 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:17.588224  4146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.010s	sys 0.004s
I20260709 13:02:17.310660  3752 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.595515  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1427) took 1348 ms. Trace:
I20260709 13:02:17.596828  1684 rpcz_store.cc:276] 0709 13:02:16.247192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.470330 (+1223138us) service_pool.cc:224] Handling call
0709 13:02:17.595424 (+125094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.557657  3942 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.558144  4123 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.440554  4087 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.662985  4001 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:17.665807  3752 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.666869  3855 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.672981  4023 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:17.677088  4127 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.498s	user 0.011s	sys 0.001s
I20260709 13:02:17.677721  4127 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.524863  4019 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.645262  3942 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.647943  4123 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:17.561143  4046 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.715619  4087 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.724130  4123 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.727613  4046 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.730123  4019 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:17.735004  4124 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.626s	user 0.011s	sys 0.003s
I20260709 13:02:17.735700  4124 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.754294  4124 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:17.800645  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.554332  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1030) took 2415 ms. Trace:
I20260709 13:02:17.936548  1529 rpcz_store.cc:276] 0709 13:02:14.138701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.138826 (+   125us) service_pool.cc:224] Handling call
0709 13:02:14.139342 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.171061 (+ 31719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.171089 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.425531 (+1254442us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b1800147e20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a
0709 13:02:15.794272 (+368741us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:15.794756 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.147351 (+352595us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:16.147404 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.147518 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.554079 (+406561us) raft_consensus.cc:1685] finished
0709 13:02:16.554099 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.554261 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31222,"raft.queue_time_us":63134,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":26075,"spinlock_wait_cycles":6180096,"thread_start_us":352181,"threads_started":1,"wal-append.queue_time_us":491922,"wal-append.run_cpu_time_us":2257,"wal-append.run_wall_time_us":1293715}
I20260709 13:02:17.940196  3686 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.941140  3686 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.941570  4017 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.942231  4017 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:16.530987  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:17.809355  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.810573  1607 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:02:17.389104  1610 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:17.811062  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 77) took 2394 ms. Trace:
I20260709 13:02:17.949023  1607 pending_rounds.cc:85] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 8
I20260709 13:02:17.812950  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:17.951465  1607 pending_rounds.cc:107] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:02:17.951563  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1410) took 1489 ms. Trace:
I20260709 13:02:17.951920  1607 raft_consensus.cc:2889] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.952311  1608 raft_consensus.cc:2410] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:17.952104  1610 rpcz_store.cc:276] 0709 13:02:16.461628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.462204 (+   576us) service_pool.cc:224] Handling call
0709 13:02:17.951317 (+1489113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.952972  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1411) took 1491 ms (client timeout 1943 ms). Trace:
I20260709 13:02:17.953241  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 115) took 3524 ms. Trace:
W20260709 13:02:17.953418  1608 rpcz_store.cc:269] 0709 13:02:16.462062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.376212 (+914150us) service_pool.cc:224] Handling call
0709 13:02:17.952867 (+576655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.953708  3930 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.436314  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70769.2us
I20260709 13:02:17.954269  1681 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:17.954572  3930 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:17.955292  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1438) took 1704 ms (client timeout 1723 ms). Trace:
I20260709 13:02:17.953723  1607 rpcz_store.cc:276] 0709 13:02:14.429057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.429225 (+   168us) service_pool.cc:224] Handling call
0709 13:02:14.711441 (+282216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.211181 (+1499740us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b580056f6d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697fd50aa 00007f4698057447 00007f469806ffe7 00007f46980717de 00007f469807bb49 00007f469807c416 00007f4698078d8f 00007f469807883e 00007f469d03d419 00007f46965b4bd4
0709 13:02:16.726319 (+515138us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b580056f9d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697fd50aa 00007f4698057447 00007f469806ffe7 00007f46980717de 00007f469807bb49 00007f469807c416 00007f4698078d8f 00007f469807883e 00007f469d03d419 00007f46965b4bd4
0709 13:02:17.952705 (+1226386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.953085 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036304384}
W20260709 13:02:17.826551  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1412) took 3475 ms (client timeout 2003 ms). Trace:
W20260709 13:02:17.956307  1675 rpcz_store.cc:269] 0709 13:02:14.351054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.353366 (+  2312us) service_pool.cc:224] Handling call
0709 13:02:17.825822 (+3472456us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54002ad5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:17.826144 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328017152}
I20260709 13:02:17.827322  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1065) took 2534 ms. Trace:
I20260709 13:02:17.957957  1678 rpcz_store.cc:276] 0709 13:02:15.365622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.107724 (+742102us) service_pool.cc:224] Handling call
0709 13:02:16.125470 (+ 17746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.369976 (+244506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.370011 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.370524 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.415428 (+ 44904us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:16.415473 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.415556 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.826526 (+1410970us) raft_consensus.cc:1685] finished
0709 13:02:17.826575 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.827017 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80569,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":234819,"threads_started":2,"wal-append.queue_time_us":1297211}
I20260709 13:02:17.944315  3908 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:17.828766  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1066) took 2423 ms. Trace:
I20260709 13:02:17.961563  2210 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:17.961915  1679 rpcz_store.cc:276] 0709 13:02:15.405202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.211898 (+806696us) service_pool.cc:224] Handling call
0709 13:02:16.212265 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.212620 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.212650 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.213125 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.560541 (+1347416us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:17.560601 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.560699 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.828066 (+267367us) raft_consensus.cc:1685] finished
0709 13:02:17.828118 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.828510 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1590,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12855,"thread_start_us":1346979,"threads_started":1,"wal-append.queue_time_us":1487156}
I20260709 13:02:17.951149  1535 rpcz_store.cc:276] 0709 13:02:15.416308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.712109 (+295801us) service_pool.cc:224] Handling call
0709 13:02:15.712447 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.712649 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.712673 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.713113 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.719510 (+  6397us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:15.723426 (+  3916us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.724008 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.724095 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.810151 (+2086056us) raft_consensus.cc:1685] finished
0709 13:02:17.810237 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.810740 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":330001,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":27150,"raft.queue_time_us":7873,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":9771,"threads_started":2,"wal-append.queue_time_us":204257}
I20260709 13:02:17.964587  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:17.830428  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1424) took 3420 ms. Trace:
W20260709 13:02:17.965610  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1076) took 1656 ms (client timeout 2043 ms). Trace:
W20260709 13:02:17.966198  1679 rpcz_store.cc:269] 0709 13:02:16.308969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.964207 (+1655238us) service_pool.cc:224] Handling call
0709 13:02:17.965527 (+  1320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.965505  1680 rpcz_store.cc:276] 0709 13:02:14.410303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.459672 (+1049369us) service_pool.cc:224] Handling call
0709 13:02:15.703447 (+243775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.703878 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:16.217751 (+513873us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.564078 (+346327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.297869 (+733791us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.299119 (+  1250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:17.299254 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.299403 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.829692 (+530289us) raft_consensus.cc:1685] finished
0709 13:02:17.829747 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.830143 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20939,"prepare.queue_time_us":523277,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":239970,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":202,"thread_start_us":730389,"threads_started":3,"wal-append.queue_time_us":404112}
W20260709 13:02:17.829073  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1423) took 3468 ms (client timeout 2454 ms). Trace:
W20260709 13:02:17.955963  1681 rpcz_store.cc:269] 0709 13:02:16.251006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.379451 (+1128445us) service_pool.cc:224] Handling call
0709 13:02:17.955179 (+575728us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.968223  1676 rpcz_store.cc:269] 0709 13:02:14.360558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.903450 (+542892us) service_pool.cc:224] Handling call
0709 13:02:17.828546 (+2925096us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54003cafd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:17.828835 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876526336}
I20260709 13:02:17.968719  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.837559  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:17.843178  3752 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:17.844667  3927 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:17.732534  4100 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.649s	user 0.011s	sys 0.001s
I20260709 13:02:17.737576  4127 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.974610  3927 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:17.717551  4111 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 1.921s	user 0.007s	sys 0.007s
I20260709 13:02:17.588997  3986 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:17.978312  4111 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:17.858405  4023 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.858242  4001 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:17.859246  4063 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.982080  4023 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.982712  4063 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.865172  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.984602  1684 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:17.985344  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1445) took 1732 ms (client timeout 2033 ms). Trace:
I20260709 13:02:17.985656  4006 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:17.985786  1684 rpcz_store.cc:269] 0709 13:02:16.253278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.597730 (+1344452us) service_pool.cc:224] Handling call
0709 13:02:17.985226 (+387496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.986931  3752 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.982112  4001 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.988457  1530 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.988641  4021 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:17.990206  3752 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.878600  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1044) took 3453 ms. Trace:
I20260709 13:02:17.990592  4001 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:17.990841  1532 rpcz_store.cc:276] 0709 13:02:14.425132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.438249 (+ 13117us) service_pool.cc:224] Handling call
0709 13:02:14.438529 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.754304 (+1315775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.877981 (+2123677us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540032f0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:17.878387 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622866688}
I20260709 13:02:17.832849  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.993086  1683 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 4.
I20260709 13:02:17.993685  4063 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:17.993744  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1434) took 1744 ms (client timeout 2006 ms). Trace:
W20260709 13:02:17.994470  1683 rpcz_store.cc:269] 0709 13:02:16.249724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.593851 (+1344127us) service_pool.cc:224] Handling call
0709 13:02:17.993654 (+399803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.995528  3855 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.996477  3855 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.943897  4017 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.998059  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:17.998589  4017 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.859989  3921 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.894546  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.000147  3855 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:18.000864  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.000530  3921 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:18.001554  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.002005  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.002390  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.002712  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.003470  3921 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:17.896227  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:18.004010  4111 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:18.005517  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109779us
I20260709 13:02:18.006673  4023 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.007136  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:17.902806  3925 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:18.008314  4100 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.861927  4019 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.995749  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.999678  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.008605  3925 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:17.806869  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.531319  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:18.015635  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1052) took 1610 ms (client timeout 2140 ms). Trace:
W20260709 13:02:18.016206  1527 rpcz_store.cc:269] 0709 13:02:16.405798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.405976 (+   178us) service_pool.cc:224] Handling call
0709 13:02:18.015402 (+1609426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.572467  1677 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 13:02:18.019037  4164 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.340s	user 0.015s	sys 0.029s
I20260709 13:02:17.961033  3908 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:17.959599  4177 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:18.020778  4177 consensus_queue.cc:1243] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:17.834227  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1067) took 2412 ms. Trace:
I20260709 13:02:18.021592  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:17.967815  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.022802  1679 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.969493  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:17.972880  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:17.974675  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:17.974929  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1451) took 1545 ms (client timeout 1980 ms). Trace:
I20260709 13:02:17.987352  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:17.876062  3932 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.007571  4023 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.025432  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:17.944708  3686 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:17.927987  4076 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.012215  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.024644  1605 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:18.025288  1681 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.025854  3908 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.027308  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:18.023723  1680 rpcz_store.cc:269] 0709 13:02:16.427542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.968261 (+1540719us) service_pool.cc:224] Handling call
0709 13:02:17.973256 (+  4995us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.012881  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 72279.8us
I20260709 13:02:18.032718  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.021399  1682 rpcz_store.cc:276] 0709 13:02:15.421990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.215970 (+793980us) service_pool.cc:224] Handling call
0709 13:02:16.231080 (+ 15110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.289045 (+ 57965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.833342 (+1544297us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54002e9ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:17.833982 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57490816}
I20260709 13:02:18.035193  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.035758  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1064) took 2745 ms. Trace:
I20260709 13:02:18.037420  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1412) took 1571 ms. Trace:
I20260709 13:02:18.037724  1605 rpcz_store.cc:276] 0709 13:02:16.463033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.020970 (+1557937us) service_pool.cc:224] Handling call
0709 13:02:18.034776 (+ 13806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.039734  1676 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.040094  1602 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:18.040756  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.041077  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.042286  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.042501  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.043110  3920 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.011461  4019 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.045013  2212 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:18.047161  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:18.048076  2210 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:18.048247  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:18.049175  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1433) took 1799 ms. Trace:
I20260709 13:02:18.049242  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.049645  1682 rpcz_store.cc:276] 0709 13:02:16.249439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.047897 (+1798458us) service_pool.cc:224] Handling call
0709 13:02:18.049099 (+  1202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.050266  1601 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:18.050508  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.050770  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1416) took 1586 ms. Trace:
I20260709 13:02:18.050882  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:18.051127  1601 rpcz_store.cc:276] 0709 13:02:16.464341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.048791 (+1584450us) service_pool.cc:224] Handling call
0709 13:02:18.050713 (+  1922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.051568  1535 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.051687  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:02:18.043691  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.051877  1682 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:18.043869  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.037230  1677 rpcz_store.cc:276] 0709 13:02:15.275414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.066132 (+790718us) service_pool.cc:224] Handling call
0709 13:02:16.066447 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.017681 (+1951234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.019577 (+  1896us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:18.019855 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3462762368}
I20260709 13:02:18.060477  1607 raft_consensus.cc:606] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:18.061772  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:18.063421  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 127515us
I20260709 13:02:18.063685  1681 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:18.064002  1683 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:18.047192  4077 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:18.057211  4149 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.388s	user 0.028s	sys 0.026s
I20260709 13:02:18.065821  1684 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:18.068167  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1450) took 1782 ms. Trace:
I20260709 13:02:18.070408  1683 rpcz_store.cc:276] 0709 13:02:16.284620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.995389 (+1710769us) service_pool.cc:224] Handling call
0709 13:02:18.066907 (+ 71518us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.068534  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1440) took 1812 ms (client timeout 2167 ms). Trace:
I20260709 13:02:18.068023  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.054104  3886 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.071956  4077 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.042537  3882 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.072453  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.072820  3925 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.075006  3921 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.075335  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.076432  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:18.077268  1601 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.079097  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.079751  3920 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:18.082728  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:18.069883  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1080) took 1643 ms (client timeout 2140 ms). Trace:
I20260709 13:02:18.084584  4063 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:18.084872  4144 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:18.088078  1680 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:18.088599  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.096535  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.097523  1602 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.097898  4117 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.118821  1532 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:18.098614  1574 connection.cc:256] RPC call timeout handler was delayed by -1.6810956839999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:02:18.102021  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 95177.9us
I20260709 13:02:18.103935  1530 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:18.104722  1681 rpcz_store.cc:269] 0709 13:02:16.251683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.968687 (+1717004us) service_pool.cc:224] Handling call
0709 13:02:18.064300 (+ 95613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.047238  4019 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.108621  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.122382  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:18.122515  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.123129  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.123252  1681 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.110302  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.124127  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:18.111758  4077 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.113018  1528 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.124554  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.111198  4132 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.125257  1606 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.124300  1682 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.115413  1684 rpcz_store.cc:269] 0709 13:02:16.426473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.986925 (+1560452us) service_pool.cc:224] Handling call
0709 13:02:18.069809 (+ 82884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.123289  4019 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.109103  1676 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:18.127939  1675 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:18.121170  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1413) took 1653 ms. Trace:
I20260709 13:02:18.129065  1601 rpcz_store.cc:276] 0709 13:02:16.463406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.051883 (+1588477us) service_pool.cc:224] Handling call
0709 13:02:18.068467 (+ 16584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.114768 (+ 46301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.117048 (+  2280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.130954  1604 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:18.096784  4080 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.131865  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.133205  4117 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.133630  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:18.134200  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1437) took 1883 ms (client timeout 2228 ms). Trace:
I20260709 13:02:18.133245  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.134891  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.134788  4063 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.142661  4132 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.143071  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:18.142736  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1446) took 1889 ms (client timeout 2240 ms). Trace:
I20260709 13:02:18.143468  1683 raft_consensus.cc:2368] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:18.127813  3921 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:18.143719  1678 rpcz_store.cc:269] 0709 13:02:16.253587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.117147 (+1863560us) service_pool.cc:224] Handling call
0709 13:02:18.142654 (+ 25507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.144726  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:18.145390  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1447) took 1891 ms. Trace:
I20260709 13:02:18.145725  3921 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.145682  1678 rpcz_store.cc:276] 0709 13:02:16.253913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.144439 (+1890526us) service_pool.cc:224] Handling call
0709 13:02:18.145324 (+   885us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.136221  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:18.137044  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1426) took 1891 ms (client timeout 2196 ms). Trace:
W20260709 13:02:18.146888  1676 rpcz_store.cc:269] 0709 13:02:16.246831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.972496 (+1725665us) service_pool.cc:224] Handling call
0709 13:02:18.128821 (+156325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.138679  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.125651  4146 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:18.138763  1675 rpcz_store.cc:269] 0709 13:02:16.250694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.088189 (+1837495us) service_pool.cc:224] Handling call
0709 13:02:18.134116 (+ 45927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.151145  4146 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.151672  4146 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.153733  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.128670  4019 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:18.154970  4019 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.116894  4144 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:18.135573  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:18.150174  1605 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:18.157189  4144 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.135723  3920 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.154887  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.142802  4077 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.141790  1679 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:18.115437  3927 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:18.477355  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.161181  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:18.530288  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1449) took 2248 ms (client timeout 2120 ms). Trace:
I20260709 13:02:18.530385  1529 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.531072  3920 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.252188  1682 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:18.511096  4120 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.532305  1677 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:02:18.214565  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52256.8us
I20260709 13:02:18.533253  1678 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:02:18.534111  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1069) took 2949 ms. Trace:
I20260709 13:02:18.247670  1680 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:18.158587  4144 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.534608  1678 rpcz_store.cc:276] 0709 13:02:15.584987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.532507 (+2947520us) service_pool.cc:224] Handling call
0709 13:02:18.532930 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.533785 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.534034 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.362828  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.246109  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.536235  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.536805  1609 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.537680  1528 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:18.159981  1607 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:18.527612  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1051) took 2125 ms (client timeout 2043 ms). Trace:
I20260709 13:02:18.501538  1681 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:18.227545  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.158628  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:18.530792  1679 rpcz_store.cc:269] 0709 13:02:16.281964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.967442 (+1685478us) service_pool.cc:224] Handling call
0709 13:02:18.530191 (+562749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.465662  1606 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:18.228233  1684 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.534045  1682 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:18.161538  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.256428  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1049) took 3104 ms. Trace:
I20260709 13:02:18.541674  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.263540  1602 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
W20260709 13:02:18.247515  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1398) took 1932 ms (client timeout 2001 ms). Trace:
I20260709 13:02:18.267580  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.540088  1605 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:18.539103  1530 rpcz_store.cc:269] 0709 13:02:16.401915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.402058 (+   143us) service_pool.cc:224] Handling call
0709 13:02:18.509573 (+2107515us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54000a46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:18.527466 (+ 17893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78280064}
I20260709 13:02:18.545712  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.299748  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.546252  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.546788  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1070) took 2955 ms. Trace:
I20260709 13:02:18.547534  1682 rpcz_store.cc:276] 0709 13:02:15.585367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.533455 (+2948088us) service_pool.cc:224] Handling call
0709 13:02:18.533781 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.540995 (+  7214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.541132 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.546922  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 423003us
I20260709 13:02:18.546839  1610 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:18.544697  1603 rpcz_store.cc:269] 0709 13:02:16.314492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.314607 (+   115us) service_pool.cc:224] Handling call
0709 13:02:18.247171 (+1932564us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54003be2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:18.247327 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268039552}
I20260709 13:02:18.551225  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.552559  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.553100  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:18.255472  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.554176  1532 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:18.382737  4167 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.740s	user 0.009s	sys 0.033s
I20260709 13:02:18.228513  3921 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:18.557926  1602 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:18.558182  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.560484  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.313560  3930 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:18.294802  3942 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.561259  1681 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:18.559052  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.563453  1680 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:18.565109  4087 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.541733  1526 rpcz_store.cc:276] 0709 13:02:15.151971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.423350 (+271379us) service_pool.cc:224] Handling call
0709 13:02:15.555513 (+132163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.555923 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.555974 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.574472 (+ 18498us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.232949 (+658477us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:16.232996 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.233084 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.056320 (+1823236us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:18.162279 (+105959us) raft_consensus.cc:1685] finished
0709 13:02:18.162298 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.256254 (+ 93956us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23043,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":344689920,"thread_start_us":484004,"threads_started":1,"wal-append.queue_time_us":861513}
I20260709 13:02:18.255950  4157 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.227212  3971 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.561092  1605 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:18.569447  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.570488  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.550347  4063 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.562417  1608 raft_consensus.cc:2376] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5. Re-sending same reply.
I20260709 13:02:18.568403  3921 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:18.571839  1533 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.583971  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:18.583457  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 446032us
I20260709 13:02:18.584740  1528 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:18.575387  1682 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:02:18.575965  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.576982  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.376019  4019 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.510814  4146 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.578125  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1072) took 2987 ms. Trace:
I20260709 13:02:18.589128  1531 raft_consensus.cc:2368] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:18.589644  1606 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:18.587272  3927 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.578491  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1073) took 2992 ms. Trace:
I20260709 13:02:18.576856  4087 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.570022  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.575378  1530 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:18.586052  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1074) took 2999 ms. Trace:
I20260709 13:02:18.597379  1682 rpcz_store.cc:276] 0709 13:02:15.586782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.548824 (+2962042us) service_pool.cc:224] Handling call
0709 13:02:18.575161 (+ 26337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.585531 (+ 10370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.585961 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.587930  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1428) took 2336 ms. Trace:
I20260709 13:02:18.588523  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.589262  1681 rpcz_store.cc:276] 0709 13:02:15.586172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.539522 (+2953350us) service_pool.cc:224] Handling call
0709 13:02:18.557377 (+ 17855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.573266 (+ 15889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.573515 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.576267  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.579476  1535 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:18.592234  1675 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.591995  1680 rpcz_store.cc:276] 0709 13:02:15.586482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.539825 (+2953343us) service_pool.cc:224] Handling call
0709 13:02:18.560918 (+ 21093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.578166 (+ 17248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.578440 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.599694  1679 rpcz_store.cc:276] 0709 13:02:16.247457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.555939 (+2308482us) service_pool.cc:224] Handling call
0709 13:02:18.572418 (+ 16479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.580108 (+  7690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.580132 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.583137 (+  3005us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.583180 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.583251 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.583363 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.592522  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.597206  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.601060  1608 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.587366  3921 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.601714  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1429) took 2353 ms. Trace:
I20260709 13:02:18.602413  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.606880  1675 rpcz_store.cc:276] 0709 13:02:16.248324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.586657 (+2338333us) service_pool.cc:224] Handling call
0709 13:02:18.587075 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.599744 (+ 12669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.601662 (+  1918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.604604  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:18.611260  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.612286  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.613384  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.614213  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.615619  1531 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:18.617517  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.619110  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:18.624048  1602 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.621127  1574 leader_election.cc:400] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:18.624918  1574 leader_election.cc:403] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.627089  1601 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:18.628347  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.629398  1528 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:18.630496  1680 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.610036  4117 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.631615  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 76) took 3213 ms. Trace:
I20260709 13:02:18.617218  3971 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.629714  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.632843  1605 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:18.634312  1533 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:18.633837  1535 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.632876  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1432) took 2383 ms. Trace:
I20260709 13:02:18.634380  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1444) took 2381 ms. Trace:
I20260709 13:02:18.636050  1680 rpcz_store.cc:276] 0709 13:02:16.249165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.600448 (+2351283us) service_pool.cc:224] Handling call
0709 13:02:18.621717 (+ 21269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.630830 (+  9113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.632817 (+  1987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.636287  1675 rpcz_store.cc:276] 0709 13:02:16.252970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.610355 (+2357385us) service_pool.cc:224] Handling call
0709 13:02:18.630154 (+ 19799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.634066 (+  3912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.634091 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.634133 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:18.634169 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.634230 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.634333 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.638441  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.640564  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.635561  3927 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.642904  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:18.635993  4136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.016s	sys 0.022s
I20260709 13:02:18.645399  1604 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.647156  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.648617  1531 raft_consensus.cc:2368] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
W20260709 13:02:18.649248  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73299.6us
I20260709 13:02:18.646732  1532 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:18.633384  1534 rpcz_store.cc:276] 0709 13:02:15.416006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.701053 (+285047us) service_pool.cc:224] Handling call
0709 13:02:16.230755 (+529702us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.231169 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:16.231199 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:16.236240 (+  5041us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.395883 (+159643us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.395934 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.399005 (+  3071us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.381679 (+1982674us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:18.610399 (+228720us) raft_consensus.cc:1685] finished
0709 13:02:18.610423 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.629249 (+ 18826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28346,"raft.queue_time_us":587,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13654,"spinlock_wait_cycles":324919168,"thread_start_us":105621,"threads_started":1,"wal-append.queue_time_us":251880}
I20260709 13:02:18.647888  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.656267  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.657646  1535 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:18.648262  4136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.017s	sys 0.022s
I20260709 13:02:18.642051  3927 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:18.661572  1680 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:18.662252  3927 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.665694  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.666391  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.666435  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1448) took 2403 ms. Trace:
I20260709 13:02:18.667460  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.650637  4117 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:18.667294  1680 rpcz_store.cc:276] 0709 13:02:16.263118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.637246 (+2374128us) service_pool.cc:224] Handling call
0709 13:02:18.648286 (+ 11040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.666160 (+ 17874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.666381 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.670397  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1430) took 2419 ms. Trace:
I20260709 13:02:18.659143  4146 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:18.670838  1682 rpcz_store.cc:276] 0709 13:02:16.248617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.598236 (+2349619us) service_pool.cc:224] Handling call
0709 13:02:18.631244 (+ 33008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.664370 (+ 33126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.664401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.668201 (+  3800us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.668246 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.668304 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.668413 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.667263  1601 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:18.673260  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.679109  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:18.680965  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.685040  1609 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:18.688199  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.686864  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1077) took 2304 ms. Trace:
I20260709 13:02:18.690084  1675 rpcz_store.cc:276] 0709 13:02:16.382460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.639592 (+2257132us) service_pool.cc:224] Handling call
0709 13:02:18.669079 (+ 29487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.686543 (+ 17464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.686571 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.686611 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.686652 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.686710 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.686809 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.691491  1683 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:18.692858  1609 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:18.693996  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1081) took 2267 ms. Trace:
I20260709 13:02:18.694411  1683 rpcz_store.cc:276] 0709 13:02:16.426793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.676642 (+2249849us) service_pool.cc:224] Handling call
0709 13:02:18.689393 (+ 12751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.693747 (+  4354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.693931 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.695091  1529 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:18.696493  4186 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:18.696527  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.694339  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.664430  3971 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:18.689664  4063 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.701267  1680 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:18.701777  1682 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:18.702183  1532 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:18.701434  4157 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:18.703897  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1079) took 2278 ms. Trace:
I20260709 13:02:18.691408  4019 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:18.701750  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:18.704496  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.712018  1682 rpcz_store.cc:276] 0709 13:02:16.426011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.672393 (+2246382us) service_pool.cc:224] Handling call
0709 13:02:18.700332 (+ 27939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.703682 (+  3350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.703836 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.707237  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1078) took 2316 ms. Trace:
I20260709 13:02:18.713208  1680 rpcz_store.cc:276] 0709 13:02:16.390563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.670298 (+2279735us) service_pool.cc:224] Handling call
0709 13:02:18.692736 (+ 22438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.703554 (+ 10818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.703754 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.712097  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48747.9us
I20260709 13:02:18.707782  4157 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.704502  4063 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.721649  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.720938  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.723212  1680 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.713299  4117 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:18.724972  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1068) took 3164 ms. Trace:
I20260709 13:02:18.725402  1677 rpcz_store.cc:276] 0709 13:02:15.557104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.156949 (+2599845us) service_pool.cc:224] Handling call
0709 13:02:18.532018 (+375069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.532834 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.721561 (+188727us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000bead0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:18.721698 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861528832}
I20260709 13:02:18.714825  4146 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:18.727415  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.716746  4157 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.729343  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:18.722543  4063 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.732978  1675 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:18.737398  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:18.720575  3930 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:18.739223  1684 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:18.739923  1678 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:18.741149  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1071) took 3155 ms. Trace:
I20260709 13:02:18.741497  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.741472  1678 rpcz_store.cc:276] 0709 13:02:15.585664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.535587 (+2949923us) service_pool.cc:224] Handling call
0709 13:02:18.739706 (+204119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.740365 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.740955 (+   590us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002d50d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:18.741077 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468413824}
I20260709 13:02:18.742338  1532 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:18.732983  4146 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:18.756256  4008 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.761371  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.755554  1682 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.762253  1532 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:18.778954  4144 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.779090  1526 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:18.776654  1680 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:18.783070  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1436) took 2532 ms. Trace:
I20260709 13:02:18.762199  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:18.779561  4144 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:18.784440  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55240.4us
I20260709 13:02:18.785691  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.783824  1679 rpcz_store.cc:276] 0709 13:02:16.250373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.600657 (+2350284us) service_pool.cc:224] Handling call
0709 13:02:18.620702 (+ 20045us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.636769 (+ 16067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.636798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.643567 (+  6769us) log.cc:844] Serialized 52 byte log entry
0709 13:02:18.777371 (+133804us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.777732 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.782044 (+  4312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.782146 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.782205 (+    59us) raft_consensus.cc:1685] finished
0709 13:02:18.782224 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.782408 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3979,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":8811,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":7512,"thread_start_us":115362,"threads_started":1,"wal-append.queue_time_us":123655}
I20260709 13:02:18.781827  4077 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:18.798185  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.791487  4144 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.804529  4187 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:02:18.812961  1532 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:18.828398  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.829475  1526 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.830277  3944 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:18.830902  3944 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:18.831254  4019 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:18.831930  3944 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.835080  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.835669  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.837714  1531 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.812704  4077 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.836374  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:18.852805  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 152029us
I20260709 13:02:18.858903  4105 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:18.859596  4105 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:18.866037  3942 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.866559  3942 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:18.866958  3942 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.867672  2210 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEARNER]: Advancing to term 8
I20260709 13:02:18.870594  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1415) took 2406 ms. Trace:
I20260709 13:02:18.871065  1604 rpcz_store.cc:276] 0709 13:02:16.463996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.606336 (+2142340us) service_pool.cc:224] Handling call
0709 13:02:18.620904 (+ 14568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.645788 (+ 24884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.870306 (+224518us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5400085554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:18.870496 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49921408}
W20260709 13:02:18.873746  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 147932us
I20260709 13:02:18.874922  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.875185  1605 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:18.879113  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.881136  1528 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.877216  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.883325  1529 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:18.889964  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.891149  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.893018  1527 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:18.894601  1606 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:18.884562  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.897940  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:18.897842  1526 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:18.897650  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:18.901934  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 94437.6us
W20260709 13:02:18.910435  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.904000  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.912184  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.915215  1535 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:18.830277  4157 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:18.913805  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:18.919811  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1403) took 1103 ms. Trace:
I20260709 13:02:18.921927  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:18.926108  4008 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:18.928066  1606 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:18.927615  1610 rpcz_store.cc:276] 0709 13:02:17.816358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.606834 (+790476us) service_pool.cc:224] Handling call
0709 13:02:18.620212 (+ 13378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.621049 (+   837us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:18.780216 (+159167us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.919383 (+139167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.919445 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:18.919493 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.919563 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.919723 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7856,"prepare.queue_time_us":201033,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"thread_start_us":233025,"threads_started":3}
I20260709 13:02:18.941107  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.941737  1607 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:18.942750  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.943589  1534 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.944474  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.944995  1529 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:18.944828  1526 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:18.941901  1527 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:18.946319  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.946503  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.946941  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.947320  1534 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.948182  1528 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.949931  1608 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:18.951035  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.947676  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.952327  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.952924  1528 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:18.953570  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:18.954026  1528 pending_rounds.cc:85] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 3
I20260709 13:02:18.954344  1528 pending_rounds.cc:107] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:18.954406  1526 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:18.954658  1528 raft_consensus.cc:2889] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:18.959141  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.959621  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.928136  1605 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:18.966178  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:18.967545  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69891.7us
I20260709 13:02:18.888818  4117 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:02:18.975093  1534 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:18.976490  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:18.974154  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:18.933495  4008 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:18.994498  1610 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.899021  4146 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:19.004573  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 166455us
W20260709 13:02:18.997478  4189 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:02:19.007493  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:19.009310  4120 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.011154  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:19.013022  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.018162  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1408) took 1199 ms. Trace:
I20260709 13:02:19.026298  1609 rpcz_store.cc:276] 0709 13:02:17.818600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.697314 (+878714us) service_pool.cc:224] Handling call
0709 13:02:18.703091 (+  5777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.720953 (+ 17862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.720986 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.733022 (+ 12036us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.913202 (+180180us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:18.913262 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.913354 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.017919 (+104565us) raft_consensus.cc:1685] finished
0709 13:02:19.017939 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.018086 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10933,"raft.queue_time_us":9332,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":24326,"thread_start_us":156001,"threads_started":1,"wal-append.queue_time_us":247177}
W20260709 13:02:19.034013  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.039134  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47410.1us
I20260709 13:02:19.040678  4199 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.041260  4199 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.042309  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:19.041678  4199 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.084689  1609 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:18.996742  4200 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.088315  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95944.6us
I20260709 13:02:19.035928  4208 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:19.095549  1607 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.030607  4120 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:19.089044  1610 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:19.093325  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 177141us
I20260709 13:02:19.103569  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.105204  1607 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:19.041261  4099 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:19.108493  1606 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:19.119417  1527 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:19.107198  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:19.121279  1602 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:19.121965  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1444) took 1026 ms. Trace:
I20260709 13:02:19.122246  1602 rpcz_store.cc:276] 0709 13:02:18.095962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.035088 (+939126us) service_pool.cc:224] Handling call
0709 13:02:19.094511 (+ 59423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.121720 (+ 27209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.121906 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.124953  4157 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.125672  4157 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.126088  4157 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:19.018886  4166 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.225s
I20260709 13:02:19.125279  3927 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:19.110049  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71247.7us
I20260709 13:02:19.126439  4157 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:19.106937  4167 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:19.042662  4205 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.133806  1610 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:19.109200  4191 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:02:19.107023  4120 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.144531  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1410) took 1325 ms. Trace:
I20260709 13:02:19.149719  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.108881  4117 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:19.159484  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.156949  1530 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.128456  4099 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.187265  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.191570  1532 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:19.151397  4205 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:19.201197  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 158315us
I20260709 13:02:19.166806  3971 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.157063  4077 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.212394  2210 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:19.221969  4222 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:19.222496  3927 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.222635  4222 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:19.223215  4119 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.007218  4105 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:19.226795  3921 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
I20260709 13:02:19.227283  3921 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.152202  4008 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.227710  4099 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:19.228991  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79490.3us
I20260709 13:02:19.195251  3930 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.235909  4008 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.193207  4117 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.238317  1681 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:19.239251  4117 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.240298  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1431) took 2991 ms. Trace:
I20260709 13:02:19.240672  4117 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.223704  4119 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.247618  4119 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.240782  1681 rpcz_store.cc:276] 0709 13:02:16.248879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.598883 (+2350004us) service_pool.cc:224] Handling call
0709 13:02:18.619888 (+ 21005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.238757 (+618869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.240007 (+  1250us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400404a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:19.240233 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421799808}
I20260709 13:02:19.252286  4087 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.212642  4205 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.185338  1601 rpcz_store.cc:276] 0709 13:02:17.819597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.698223 (+878626us) service_pool.cc:224] Handling call
0709 13:02:18.707725 (+  9502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.733725 (+ 26000us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:18.911796 (+178071us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.144216 (+232420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.144270 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.144316 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.144376 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.144477 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53596,"prepare.queue_time_us":153929,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2680,"raft.queue_time_us":103820,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":28407,"spinlock_wait_cycles":22159744,"thread_start_us":308340,"threads_started":3,"wal-append.queue_time_us":180686}
I20260709 13:02:19.236392  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:19.215481  3971 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.271569  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1429) took 1218 ms. Trace:
I20260709 13:02:19.288715  1531 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:19.223801  4222 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.300347  4099 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.289119  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.272332  1603 rpcz_store.cc:276] 0709 13:02:18.052966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.804396 (+751430us) service_pool.cc:224] Handling call
0709 13:02:18.806301 (+  1905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.806613 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:18.838491 (+ 31878us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.269148 (+430657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.269227 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.269294 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.269368 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.271476 (+  2108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38211,"prepare.queue_time_us":89178,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":57758,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":15738,"thread_start_us":393816,"threads_started":3,"wal-append.queue_time_us":351332}
I20260709 13:02:19.313608  4213 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.314299  4213 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:19.303802  4204 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:02:19.332159  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98258.3us
I20260709 13:02:19.227735  4144 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.334025  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1442) took 1238 ms. Trace:
W20260709 13:02:19.333016  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 229581us
I20260709 13:02:19.251881  4063 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.303763  4208 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:19.334661  1604 rpcz_store.cc:276] 0709 13:02:18.095197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.876273 (+781076us) service_pool.cc:224] Handling call
0709 13:02:18.910892 (+ 34619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.917494 (+  6602us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:18.976471 (+ 58977us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.333590 (+357119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.333646 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.333697 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.333782 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.333939 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31910,"prepare.queue_time_us":63554,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":290187,"threads_started":1}
W20260709 13:02:19.379288  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 293821us
W20260709 13:02:19.392431  4215 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:02:19.397601  4223 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.398116  4223 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.398281  4208 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:19.398478  4223 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.398691  4208 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:19.399138  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.315347  4213 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.402490  4144 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.402726  4198 raft_consensus.cc:993] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:02:19.403260  4198 raft_consensus.cc:1081] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:02:19.331995  3971 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.410692  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.395936  4119 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.413782  4119 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:19.414263  3942 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 13:02:19.414727  3942 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.415144  4120 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.416579  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.417207  4237 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:02:19.417408  4120 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.417546  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.419704  4120 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.420271  4198 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.420320  4120 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:19.421563  4120 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.423880  1576 leader_election.cc:400] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8.
I20260709 13:02:19.424625  4198 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.426941  4198 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:19.425170  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.399612  4208 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.430064  4208 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.424214  4008 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.430893  4008 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:19.431272  4008 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.441854  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:19.416318  4199 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.454916  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:19.467403  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.423470  4157 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:19.468719  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.469281  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.471895  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48189.4us
I20260709 13:02:19.439718  4120 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.453469  3942 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.472496  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.474383  4237 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:19.474762  4120 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.475152  4237 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:19.476296  3920 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.476763  3920 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.477106  3920 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.477741  4237 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.479352  4237 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.456182  4146 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:02:19.484316  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.480398  4218 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.486316  4218 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:19.487926  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.488732  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.425191  4063 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.492046  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.487231  4218 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.498298  4199 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.500569  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:19.501343  4157 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.502396  4157 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.502918  4157 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:19.507135  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:19.505676  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 287261us
I20260709 13:02:19.503500  4224 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.499094  4223 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.503031  4008 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.489722  4198 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.512550  4224 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.516076  4213 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.510414  4063 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.529469  4198 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.524008  4224 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.530993  4223 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.531963  4063 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.534547  4063 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.543552  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:19.545733  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:19.547114  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:19.547587  4206 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:19.549125  4206 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:19.549604  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:19.550062  4105 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.550158  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:19.550801  1529 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:19.550954  4120 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.551385  4120 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.551690  4242 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:19.552479  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 512295us
I20260709 13:02:19.552312  4120 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.553648  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.553813  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:19.550817  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:19.554843  1527 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:19.556208  4222 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.556708  4222 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.557610  4200 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.558133  4200 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:19.558923  4222 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.559445  4222 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.559082  4200 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.560523  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:19.550843  1532 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:19.554876  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:19.552265  4242 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.554903  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:19.561867  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.560180  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 338906us
I20260709 13:02:19.574149  1681 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:19.575639  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.515079  4205 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.589421  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:19.560352  3944 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.592468  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.513083  4227 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:02:19.524125  4213 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:19.595831  2210 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:19.596220  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.560531  3927 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:02:19.606356  1433 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:19.611667  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.601318  4234 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:02:19.613099  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.614696  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:19.596917  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.615767  1682 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:19.598531  3971 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.616098  4157 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.618191  1601 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:19.599431  1680 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:19.600310  1684 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:19.598104  3920 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.572896  4166 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.602908  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.614878  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.553833  4120 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.626330  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:19.627089  1605 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.627318  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:19.559911  4222 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.626610  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:19.637982  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.640668  1608 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:19.650803  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46659.2us
I20260709 13:02:19.650815  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.651822  1607 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:19.655997  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:19.656204  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.619434  3921 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:19.657261  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 102449us
I20260709 13:02:19.656730  1680 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:19.664917  1601 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:19.680301  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.680321  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.570876  4206 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:02:19.620461  4213 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:19.658735  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.659665  4231 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:02:19.620424  4218 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.677731  1605 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:19.683331  1681 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:19.694607  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:19.658295  1610 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:19.686575  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131745us
I20260709 13:02:19.696296  1531 raft_consensus.cc:606] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.696908  1531 raft_consensus.cc:614] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:19.695057  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.656826  4234 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.699374  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.699748  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.700254  1680 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:19.664839  3908 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:19.664448  1684 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:19.704774  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.705010  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:19.705175  1679 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:19.708461  1610 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:19.709290  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 556474us
I20260709 13:02:19.699249  3927 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.710215  1501 leader_election.cc:400] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:19.710271  3927 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:19.710683  1501 leader_election.cc:403] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.710772  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.711510  3927 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.711833  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.719404  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.720364  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:19.711936  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.720446  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.719040  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.693086  3944 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:19.733959  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.718621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.720450  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.737613  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.738391  1679 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:19.739482  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.744882  1680 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:19.739157  4243 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:02:19.748221  4199 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.749094  4229 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:19.748116  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.753230  4008 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.753921  4008 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.754392  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.755508  4222 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.747138  3908 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:19.756183  4227 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.712623  4087 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.756498  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:19.756695  4227 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:19.747764  3944 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.757200  4227 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.759358  4230 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.759995  4230 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.749044  4206 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:02:19.760944  4199 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.762323  4224 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.720981  3930 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.763849  3930 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.764668  3930 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.765266  4228 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:19.765770  4228 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:19.766423  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.766813  4228 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.767563  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.756301   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:19.768872  4223 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.765169  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.769359  4223 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:19.770262  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58499.6us
I20260709 13:02:19.770360  4223 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.771180  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.757215  1677 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:19.736961  1682 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:19.772594  4120 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.772998  4120 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.773336  4242 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.769362  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.774588  4206 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.775182  4205 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.775203  4207 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.775866  4207 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.776243  4207 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.773339  4120 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:19.778242  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.783545  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44144.7us
I20260709 13:02:19.765852  3930 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.712407  3942 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:19.771690  4223 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.718158  3920 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.793417  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.798461  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.786245   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:19.805756  1679 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.762341  4230 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:19.828894  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:19.834466  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 141438us
I20260709 13:02:19.835103  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.744204  3921 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.767966  4228 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.840931  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:19.840755  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45441.7us
W20260709 13:02:19.842509  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43712.9us
I20260709 13:02:19.842598  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.792711  4157 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.844642  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.845633  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.847754  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.851891  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.853366  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:19.840751  4117 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.000s
W20260709 13:02:19.858019  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64725.9us
I20260709 13:02:19.861860  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.837393  4199 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:19.839929  4206 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:19.859650  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.846496  4231 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.852214  3908 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.853034  4157 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.872635  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.863878  4008 raft_consensus.cc:2764] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:19.876353  4195 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:19.880578  4224 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.885432  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:19.866559  4146 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:19.890621  1679 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:19.823158  4087 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:02:19.904696  4119 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:19.856405  3971 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:19.890959  3882 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:19.906638  3971 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:19.907092  3971 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.899075  4157 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.863523  3920 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:19.913151  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:19.916260  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 191385us
I20260709 13:02:19.845685  4205 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:19.916985  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.917747  1679 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.868966  4206 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:19.920615  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68785.4us
I20260709 13:02:19.918920  4230 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.892409  3908 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.923255  4195 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:19.928669  4218 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.870528  4231 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.896876  4243 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:19.912292  4199 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:19.933756  4260 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:02:19.941519  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:19.931397  4207 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.951920  4146 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:19.952281  4237 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.935807  4206 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:19.956363  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71019.7us
I20260709 13:02:19.948997  3908 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.954216  4231 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.949318  4218 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:19.897986  3944 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:02:19.978653  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.968767  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.986244  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44822.7us
I20260709 13:02:19.989225  3920 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:19.989719  3920 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.990114  3920 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.992923  4199 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.994334  4120 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:19.960681  4087 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:19.996167  4135 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:20.003111  3971 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.004657  4213 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:20.005630  4087 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:20.006315  4135 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.007256  4213 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:20.008107  4135 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.008628  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:20.009132  4207 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:19.958909  4230 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:20.010074  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.010516  1604 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.015344  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:20.017318  1610 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:20.015614  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.018286  1677 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:20.019795  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.022321  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:20.023290  1605 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:20.024721  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:20.025835  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46694.4us
I20260709 13:02:20.028121  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.028828  1606 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.029444  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:19.979343  4237 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.031296  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:19.977896  4195 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.035421  1679 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:19.981715  4243 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.037935  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.032392  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.041465  1608 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.039808  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.044813  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:19.959419  3942 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:02:20.037544  3921 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.065554  1608 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:20.068701  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.069766  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.071403  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.072613  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.073262  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.042701  4227 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.073721  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.073843  1675 raft_consensus.cc:2376] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9. Re-sending same reply.
I20260709 13:02:20.074424  1679 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:20.074786  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.075292  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.076601  4157 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.077055  1676 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:20.078007  4254 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:20.078316  1676 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:20.078773  4157 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:20.079442  1676 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:20.079874  4228 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.080078  4144 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.067035  4218 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.080569  4228 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.081444  4243 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.082484  4218 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.083786  1682 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:20.068164  4242 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.084009  4237 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.085495  4237 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.075840  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.086513  1675 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.088315  1680 raft_consensus.cc:2376] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6. Re-sending same reply.
W20260709 13:02:20.088353  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78150.5us
I20260709 13:02:20.089924  1648 leader_election.cc:400] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.090220  1648 leader_election.cc:403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.090739  4200 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:20.091193  4200 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.094749  1606 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:20.098026  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.099205  1682 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:20.102214  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.103415  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.104276  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.104830  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.105473  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.106683  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.094944  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.108711  4087 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:20.109167  4087 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.109319  1679 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:20.109586  4087 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.105842  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:20.119234  1574 leader_election.cc:336] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.019s (SENT)
I20260709 13:02:20.119755  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:20.121882  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.122727  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.122525  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:20.124653  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.127206  1648 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.127393  4205 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.127592  1648 leader_election.cc:403] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.128861  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.130182  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.131079  4242 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.131879  4157 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.133437  1648 leader_election.cc:400] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.133806  1648 leader_election.cc:403] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.134497  4205 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:20.135793  1684 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:20.136117  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.137573  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.138262  4205 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.067214  3921 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.092060  4200 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.134052  1675 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:20.145953  1681 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:20.151667  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.099898  4227 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.139492  3908 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.150699  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.124537  4223 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:20.177165  1677 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:20.150633  3930 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.117604  3942 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:02:20.153409  3921 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.187387  1683 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:20.161942  4207 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:20.157648  4144 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.154808  4224 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.188349  1683 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.123993  3920 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.127192  4087 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:20.199208  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61700.2us
I20260709 13:02:20.184208  3882 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:20.102741  4230 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.173223  3971 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.188670  4222 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.190843  4242 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.219034  4135 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.154593  3927 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:20.190975  4223 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:20.192831  4200 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.217540  1679 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:02:20.218653  4265 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:20.219249  3882 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.213726  1683 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.204829  4207 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:20.221585  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 97842.3us
I20260709 13:02:20.228358  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.241463  1608 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:20.214493  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.242288  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.243073  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.250353  1683 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.250741  1607 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:20.254181  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.255111  1610 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:20.256163  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.257022  1682 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:20.256690  3971 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.266561  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.251765  4120 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:20.279775  4269 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:20.285995  4228 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:20.290150  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47988.1us
I20260709 13:02:20.343667  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.338392  4206 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.344758  4246 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.345335  4246 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.345803  4217 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:20.326097  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.349954  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 163607us
W20260709 13:02:20.351986  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.353725  1606 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:20.161692  4195 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.285370  4223 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.223377  4144 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:20.331394  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.256433  4218 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:02:20.332157  4157 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.332402  4087 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.207165  4268 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:02:20.332856  3920 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:20.285779  3882 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.333858  4146 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.333952  4231 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.337112  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:20.366765  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 156531us
W20260709 13:02:20.380177  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44790.2us
I20260709 13:02:20.381345  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.401927  1608 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:20.365149  4077 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:02:20.392206  4275 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.393390  4206 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.363772  3971 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:20.346349  4246 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.377138  3927 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:20.399297  1678 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:20.348520  4237 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:02:20.405020  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.416673  1683 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:20.405973  4157 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.436312  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:20.435333  4166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:02:20.445884  4063 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:20.440274  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.444334  4275 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.346971  3921 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.431964  3908 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.421124  4207 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:20.497874  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61672.7us
I20260709 13:02:20.505542  3921 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:20.446208  4199 raft_consensus.cc:1027] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: attempt to promote peer e3ab72f324d545a6b4ecb1025df1f7c0: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:02:20.507454  1680 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:20.508232  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:20.691387  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.787295  1606 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:20.565732  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.452548  4166 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:20.797392  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:20.797699  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 541212us
W20260709 13:02:20.791384  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.553117  4206 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:20.451059  4063 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:20.790939  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.778263  4198 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.560181  4266 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:02:20.805127  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.802556  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:20.692992  4279 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:02:20.551959  4281 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:02:20.556958  4213 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.787016  4231 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.668292  3930 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.552985  4228 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.811388  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 443025us
I20260709 13:02:20.832963  4228 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.812263  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:20.809667  4198 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.564224  4157 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.807909  4008 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:20.809871  4224 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.833776  3930 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.598927  4277 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.367s
I20260709 13:02:20.811975  3921 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.838028  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.839401  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:20.816350  4120 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:20.565037  3971 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.844851  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.844436  4208 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.808655  4206 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.850564  4224 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.852784  4224 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.852604  4208 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.853305  4008 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.854713  4208 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.852453  4206 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.855319  4008 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.858158  4135 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.858505  3921 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:20.859028  3921 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:20.859844  3921 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.860790  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 50) took 6605 ms. Trace:
I20260709 13:02:20.862663  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.862886  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:20.863384  1605 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:20.863008  4120 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.837365  4195 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.865088  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.852407   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:20.866153  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.867501  1604 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:20.868148  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.874226  3930 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.868834  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.878624  1601 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:20.869459  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:20.879976  1606 raft_consensus.cc:2368] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
I20260709 13:02:20.878553  3920 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.870780  1607 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:20.884229  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.818221  4213 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:20.861181  1433 rpcz_store.cc:276] 0709 13:02:14.255833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.256535 (+   702us) service_pool.cc:224] Handling call
0709 13:02:20.860676 (+6604141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:19.908715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:19.909464 (+   749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:19.909513 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:02:19.909547 (+    34us) tablet.cc:662] Decoding operations
0709 13:02:19.909940 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:19.910013 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:19.910049 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:19.910293 (+   244us) tablet.cc:701] Row locks acquired
0709 13:02:19.910341 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:19.910492 (+   151us) write_op.cc:270] Start()
0709 13:02:19.910632 (+   140us) write_op.cc:276] Timestamp: P: 1783602139910434 usec, L: 0
0709 13:02:19.910653 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:19.911299 (+   646us) log.cc:844] Serialized 535 byte log entry
0709 13:02:20.092124 (+180825us) op_driver.cc:464] REPLICATION: finished
0709 13:02:20.240063 (+147939us) write_op.cc:301] APPLY: starting
0709 13:02:20.256210 (+ 16147us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:20.271381 (+ 15171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:20.337694 (+ 66313us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:20.337959 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:20.338161 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:20.338215 (+    54us) write_op.cc:312] APPLY: finished
0709 13:02:20.338525 (+   310us) log.cc:844] Serialized 22 byte log entry
0709 13:02:20.339547 (+  1022us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:20.347551 (+  8004us) write_op.cc:454] Released schema lock
0709 13:02:20.348255 (+   704us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:20.396628 (+ 48373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:20.396665 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":327719,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":118998,"apply.run_cpu_time_us":5160,"apply.run_wall_time_us":163751,"num_ops":1,"prepare.queue_time_us":125430,"prepare.run_cpu_time_us":2860,"prepare.run_wall_time_us":2860,"replication_time_us":157573,"thread_start_us":152915,"threads_started":2}]]}
I20260709 13:02:20.877205  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.878211  1602 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:20.869879  3944 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:20.868551  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.883252  1608 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:20.871918  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.891722  1608 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:20.885842  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69897.6us
I20260709 13:02:20.892833  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:20.894661  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.894913  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.895587  1532 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:20.898910  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.897781  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.902594  1527 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:20.903008  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:20.903565  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:20.904713  1606 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:20.906766  1608 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:20.902390  4242 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.909564  4213 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.910784  4198 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:20.911808  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.912647  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.914824  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:20.886551  4195 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.917649  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:20.918037  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49577.5us
I20260709 13:02:20.918431  1609 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:02:20.918848  1609 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 2
I20260709 13:02:20.887967  3944 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:20.934340  1608 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:20.919088  1609 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:02:20.935443  1609 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:20.922474  1607 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:20.925534  1602 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:20.940454  1610 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:20.927707  1601 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:20.847954  4063 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:20.933501  1606 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:20.905927  4277 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.959208  1605 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:21.014294  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.041364  1608 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:21.049197  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 156455us
W20260709 13:02:21.045660  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 83090.5us
I20260709 13:02:20.960662  1530 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:21.013639  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52054.2us
I20260709 13:02:21.067670  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:21.074072  1535 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:21.013139  4265 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:02:21.045022  4284 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:02:21.049540  4288 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:20.932548  4267 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.079398  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:21.079919  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.080677  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:21.083093  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.088371  1681 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:21.089176  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.090338  1676 raft_consensus.cc:2410] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:21.046185  4063 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.016551  4144 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.085544  1680 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:20.959368  4228 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.018098  4120 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.093930  4008 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:21.094885  4206 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:21.095736  1608 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:21.096758  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.097545  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.104729  1535 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:21.084769  1574 leader_election.cc:336] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.500s (SENT)
I20260709 13:02:21.073799  4223 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.950667  4291 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 13:02:21.116604  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:20.950460  4135 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 13:02:21.082543  3930 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.072444  4277 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.048281  4292 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:02:21.082027  3944 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:21.202126  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.670626  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.651893  1529 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.466327  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.674767  1534 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:21.674811  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 568689us
W20260709 13:02:21.386782  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.124423  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.675737  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:21.618680  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.018s
W20260709 13:02:21.677064  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.003s	sys 0.019s
I20260709 13:02:21.303258  1528 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:21.678244  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 593508us
I20260709 13:02:21.149509  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:21.683655  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.013s	sys 0.011s
W20260709 13:02:21.684554  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.013s	sys 0.011s
I20260709 13:02:21.141067  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.685959  1676 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:21.186986  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.687525  1677 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:21.676733  1680 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:21.120369  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.690729  1683 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:21.679919  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:21.083878  3908 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:21.645249  2175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.008s
I20260709 13:02:21.684098  1678 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
W20260709 13:02:21.686494  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 501005us
I20260709 13:02:21.753654  1675 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
W20260709 13:02:21.753113  2175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.009s
I20260709 13:02:21.752409  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.756347  1608 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:21.757512  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 77713.4us
W20260709 13:02:21.486274  4298 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:02:21.488775  4301 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:02:21.487221  4296 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:02:21.115828  4208 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:21.755213  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 648874us
I20260709 13:02:21.761477  1533 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:21.345057  4293 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:21.107520  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:02:21.558398  4234 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.553666  4300 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:02:21.214800  4288 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:21.765466  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.753841  4297 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.184932  4228 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.140522  4199 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:21.691535  4290 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.482s	user 0.027s	sys 0.052s
I20260709 13:02:21.692723  4008 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.771062  1531 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.792480  1531 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.693248  4223 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.093067  4157 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.668s
W20260709 13:02:21.769583  4243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.033s	sys 0.042s
I20260709 13:02:21.782721  1528 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:21.345333  4282 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.630s
I20260709 13:02:21.759881  4295 raft_consensus.cc:2764] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:21.768941  4286 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:21.801673  4286 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:21.801955  4282 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:21.802446  4282 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:21.802575  4286 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.764784  4135 consensus_queue.cc:1243] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:21.765193  4207 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.776178  3944 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.807997  4207 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.809701  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.810163  3920 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.810489  4207 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.779528  4166 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.810792  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.810642  3920 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.811595  1532 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:21.811314  4166 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.796249  4008 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.812438  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.813514  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.813753  4166 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:21.779786  3908 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:21.816365  3908 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.753126  3930 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.788023  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.789485  1527 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:21.819423  4008 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.782186  4234 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:21.144239  4144 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.820892  3930 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.821630  4008 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.821758  4234 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.769284  4087 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:21.822175  4144 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.775673  1534 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:21.799437  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.823660  1528 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:21.790645  4297 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.823691  4223 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:21.783286  3971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.041s
I20260709 13:02:21.095933  4195 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:21.824602  3971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.005s	sys 0.042s
I20260709 13:02:21.825162  4277 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.825692  4297 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.780548  4208 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:21.804085  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.829556  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.830768  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.832064  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.832741  1534 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.805575  4286 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.805186  1531 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.807276  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1454) took 1354 ms. Trace:
I20260709 13:02:21.834290  1533 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:21.834137  1603 rpcz_store.cc:276] 0709 13:02:20.449135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.453833 (+  4698us) service_pool.cc:224] Handling call
0709 13:02:20.454239 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.547970 (+ 93731us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:20.559340 (+ 11370us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.037933 (+478593us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.068572 (+ 30639us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.069061 (+   489us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.069202 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.069575 (+   373us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.803592 (+734017us) raft_consensus.cc:1685] finished
0709 13:02:21.803613 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.803756 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11114,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":52266,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5829,"thread_start_us":386007,"threads_started":2,"wal-append.queue_time_us":248119}
I20260709 13:02:21.797775  4292 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:21.789906  4237 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.827430  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.827883  4208 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:21.828323  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:21.800009  4243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.033s	sys 0.043s
I20260709 13:02:21.833873  4234 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:21.874284  4287 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:21.874806  4287 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:21.874752  4234 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:21.875296  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.875957  1535 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:21.833156  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.875792  4287 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.876879  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.843991  4292 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:21.877939  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.878154  4292 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.879078  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.879467  4292 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.877243  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.844636  1527 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 5: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:21.833681  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.879710  1531 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.884982  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.879640  1535 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:21.889142  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.889860  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.890339  1529 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:21.891775  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:21.893839  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:21.795280  4228 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.877275  4287 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.878021  4234 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:21.803342  4282 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:21.905373  1534 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:21.949419  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 184890us
I20260709 13:02:21.967815  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:21.967741  3920 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:21.970186  4063 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 13:02:21.969717  4294 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:21.973862  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.977773  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:21.978513  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
I20260709 13:02:21.979562  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.977815  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:21.979614  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:21.978622  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:21.965561  4166 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.983289  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:21.984894  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.987136  1677 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:21.988071  1680 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:21.989122  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:21.989532  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 313848us
I20260709 13:02:21.990199  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:21.990394  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:21.990728  1676 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.995415  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:21.996083  1675 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:21.992892  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.000937  1498 leader_election.cc:400] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
I20260709 13:02:22.001256  1498 leader_election.cc:403] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.003113  1608 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:22.004781  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.006196  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:22.007097  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:21.986315  4313 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.010002  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:21.989603  4277 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.010497  1677 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:21.989248  4229 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.998445  4199 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.017508  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:21.991168  4312 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.017642  4242 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.037036  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.020834  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.021631  4319 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.038300  4319 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.038839  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.039047  4319 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:22.040444  4157 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.025677  4228 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.011023  4213 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.011072  4207 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.994735  4166 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.042666  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.043207  4166 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:22.015815  4229 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.016158  4277 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.044437  4229 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.044684  4277 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.018731  4294 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.043902  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.015308  3908 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9.
I20260709 13:02:22.013581  3930 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.052390  4318 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.017758  4313 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.052701  4294 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.053023  4318 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:22.053599  4318 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.054675  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.055471  4313 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.008522  4008 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.037271  4242 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:22.060405  4242 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.020123  4144 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.064489  4144 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.040836  4157 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.068460  4157 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.033221  3971 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:22.072355  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.072834  3971 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:22.073383  3971 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:22.074117  1676 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:22.074471  3971 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:22.076570  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 75716.8us
I20260709 13:02:22.077814  4316 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:22.080154  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.081120  4316 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.043778  4166 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.081983  3920 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.083320  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:22.085129  3920 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.085518  3920 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:22.085742  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.085911  3920 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.067695  4144 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.089077  3971 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.089224  4321 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:22.090972  4321 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.092365  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.087411  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.112308  4195 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:22.095309  4277 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:22.095875  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 979573us
I20260709 13:02:22.113559  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.098549  1527 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:22.101442  4242 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.106164  4207 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.109202  4318 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.118625  4242 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:22.109910  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.130008  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.110450  4310 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:22.110334  4229 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.111065  4157 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.113202  4008 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.113312  3971 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.114692  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.119382  4166 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.114894  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.137125  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.137547  4157 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:22.138108  4277 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.094630  3920 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.142411  4198 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.142658  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:22.143159  3920 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:22.142966  4198 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.143874  1684 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:22.116683  3930 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.121289  4321 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.146119  4321 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.146859  4198 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.146870  4213 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:22.140537  4008 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:22.148195  4321 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:22.134830  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.148542  4198 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.119059  4318 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:22.115260  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.145617  4287 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.148958  1678 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:02:22.149621  4287 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.150063  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.147657  4213 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.153281  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.156514  4144 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:02:22.150735  4207 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:22.156383  4316 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.157572  4207 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:22.157734  4286 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:22.151865  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.158437  4286 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.157650  4213 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:22.159103  4302 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.783s	user 0.004s	sys 0.012s
I20260709 13:02:22.159399  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.159559  4144 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.160374  4311 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.160750  4311 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.159417  4286 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.119347  4195 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:02:22.151885  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.164222  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.141018  4313 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.205111  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:22.212245  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48087.8us
I20260709 13:02:22.202100  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:22.162001  4286 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.226403  1607 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:22.226480  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.227108  1530 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:22.227514  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.162393  4321 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.216336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.168888  4157 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.241457  1607 raft_consensus.cc:2410] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:22.241664  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.217736  4223 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:22.220499  4242 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.221266  3942 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.223313  1675 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:02:22.214347  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62543.8us
I20260709 13:02:22.259152  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:22.259719  1675 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.223800  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.260425  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:22.224382  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.162343  4318 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.228353  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.157884  2210 raft_consensus.cc:2368] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6.
I20260709 13:02:22.225775  1604 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:22.229132  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.229769  4229 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.229586  3908 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:22.276531  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52809.3us
I20260709 13:02:22.276350  3908 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.277964  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.278704  3908 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.279167  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.279343  3908 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:22.231002  1608 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:22.229409  4323 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:02:22.213793  4280 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.286159  4313 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.227442  4008 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.224553  4208 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.231626  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:22.293550  1601 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.292832  4206 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:22.294039  1601 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:22.295349  4291 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:22.232064  1533 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:22.296411  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:22.296970  4309 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:02:22.297271  1608 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:22.298090  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.298642  1608 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:22.235515  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.299027  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.299656  1684 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:22.164080  3920 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:22.236269  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76932.6us
I20260709 13:02:22.300848  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.236364  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.236487  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.237071  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.161662  4311 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.223954  4277 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:22.237782  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:22.303973  1529 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:22.238498  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:22.305287  1677 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:22.237802  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.226485  1676 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:22.240082  1683 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:22.216975  1682 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:22.215282  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:22.237323  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.152741  4198 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.307907  1528 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:22.242709  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:22.224423  4213 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.244473  4135 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:22.286201  4280 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:22.157173  4287 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:02:22.247421  4195 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.225075  3971 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.250505  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.228138  4199 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.253413  4282 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.245613  3944 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.246061  4223 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:22.255455  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.256886  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:22.369767  1682 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:02:22.263669  1605 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:22.266104  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:22.375026  4198 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:22.271324  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.160713  4207 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.281193  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:22.387429  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 106285us
I20260709 13:02:22.331140  4206 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.290786  1675 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:22.390106  1675 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:22.295217  1601 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.307703  1680 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.264104  4318 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:22.313082  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:22.352665  4280 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:22.316327  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73658.8us
I20260709 13:02:22.421170  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.421658  1683 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:22.422816  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:22.319170  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:22.307061  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60415.5us
I20260709 13:02:22.314798  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.424737  1679 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:22.257746  4292 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:22.424850  1677 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:22.424926  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:22.244608  4316 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.313750  4166 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.334820  3908 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:22.306049  4208 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.265429  3942 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.337114  1608 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:22.349436  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:22.352015  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 86051.7us
I20260709 13:02:22.293299  4297 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.353838  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
W20260709 13:02:22.362905  4308 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
I20260709 13:02:22.363162  4195 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:22.366648  4267 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.367165  4310 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:22.378059  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.420282  4318 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.407755  1675 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:22.457996  1675 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:22.460638  1609 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:22.427136  3930 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.314057  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.330638  4135 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.304385  4008 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.353323  3971 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.325367  4229 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:02:22.424340  1681 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:22.449623  4267 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.429737  1676 raft_consensus.cc:2410] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:22.434228  1604 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:22.432907  4294 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.433043  4297 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.415275  4206 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.435386  1678 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:22.376379  4199 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.347325  4213 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.387063  3944 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.436661  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.439251  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.440188  4291 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:22.441241  4326 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:02:22.446250  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57414.7us
I20260709 13:02:22.379619  1682 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:22.426684  4313 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:22.476974  3971 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.461957  1532 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:22.433406  4228 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:22.467748  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 153787us
I20260709 13:02:22.470057  1680 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:22.451311  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.472388  1683 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:22.419210  4223 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.515570  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.470728  4321 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.434093  4316 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.488863  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:22.538312  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49523.1us
I20260709 13:02:22.480324  4294 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.494354  1603 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:22.486294  4206 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:22.508522  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69335.8us
W20260709 13:02:22.507570  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70967us
I20260709 13:02:22.427747  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:22.459825  4195 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:22.544621  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93392.9us
I20260709 13:02:22.546988  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.486541  4297 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.413384  1601 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.539606  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.489616  4313 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.524431  4228 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:22.607594  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60704.7us
I20260709 13:02:22.493856  4213 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.610045  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:22.524183  3930 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.487691  4327 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 13:02:22.627846  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.555714  4198 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.555496  4166 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:22.633265  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.582607  4294 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.586712  4319 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.582439  4331 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.606741  4313 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.643998  4207 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.644296  3942 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.645537  4316 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.593876  4267 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.493456  4135 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.656612  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:22.658195  4208 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.658849  4213 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:22.665694  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.668193  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 110212us
I20260709 13:02:22.670187  1601 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:22.622707  4223 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.622159  4222 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.624389  4228 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.676232  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.677793  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.723150  4330 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.678844  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.690785  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.724630  1529 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:22.680773  4319 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.723197  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:22.715246  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 175729us
W20260709 13:02:22.717643  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 158778us
I20260709 13:02:22.626868  3930 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.723272  4337 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:22.668828  4277 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:02:22.705238  4207 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:22.724880  1527 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:22.701503  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 273808us
I20260709 13:02:22.725154  1601 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:22.725562  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.766938  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:22.707105  1534 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:22.719077  4267 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.723955  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.731498  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.735199  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.715562  3944 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.732997  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.738332  4008 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:22.779023  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43953.7us
I20260709 13:02:22.738940  4195 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:22.739332  4213 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:22.740267  4199 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.744268  4320 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:02:22.780836  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.704944  4291 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:22.745776  4337 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.746214  4330 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.752354  4206 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.754977  4135 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.771576  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:22.771965  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.798468  1534 raft_consensus.cc:2368] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:02:22.772715  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.775501  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.779793  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:22.780087  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.733812  4319 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:22.765853  4286 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.004s
I20260709 13:02:22.744828  3930 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.787896  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:22.776747  4207 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.776459  4277 consensus_queue.cc:1243] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:22.792101  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:22.793102  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60241.4us
I20260709 13:02:22.784103  3944 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.784260  4312 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.799388  1535 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:22.806510  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.796738  4199 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:22.815086  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.818158  4228 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.793051  3920 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:02:22.808001  4323 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.820353  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.821369  4206 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.824775  4213 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.825466  4337 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.829909  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.830040  1574 leader_election.cc:400] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6.
W20260709 13:02:22.831187  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51481.5us
I20260709 13:02:22.793704  4318 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.832960  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.577855   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:22.835623  1534 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:22.830914  4199 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.840973  1648 leader_election.cc:400] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:02:22.852671  1648 leader_election.cc:403] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.828675  4312 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.832219  4222 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.870689  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.841629  1574 leader_election.cc:403] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.836974  4208 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:22.854022  3971 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.859460  4280 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.855453  4144 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:22.839748  4344 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:22.855230  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.884836  1602 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:22.889185  4287 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.889801  4287 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.891018  4287 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.888239  4344 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.893190  4344 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.893853  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.898965  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.855291  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:22.900125  4222 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.900568  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.901028  4286 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:22.901600  4144 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:22.856141  4337 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:22.902112  4222 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.879498  4294 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.902546  4222 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.902861  4337 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:22.902967  4222 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.903307  4337 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.845320  4321 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.903898  4294 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.853255  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:22.904150  4337 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.901611  4286 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.905407  4337 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.906064  4286 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.909519  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.840307  3930 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.869599  4199 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.872737  4323 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:02:22.868005  4313 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:22.869320  4328 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.228s	user 0.004s	sys 0.000s
I20260709 13:02:22.914222  3930 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:22.872949  4312 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.873397  4208 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.916237  4208 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.917290  1533 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:22.917817  1533 pending_rounds.cc:85] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:02:22.881106  4206 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.918128  1533 pending_rounds.cc:107] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:02:22.918385  1533 raft_consensus.cc:2889] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.880963  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.878870  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.920856  4085 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:22.864645  4336 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:22.921250  1534 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:22.922032  4333 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:22.922668  1534 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:22.876258  3908 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:22.924489  3908 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.924837  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.926177  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:22.900496  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45276.3us
I20260709 13:02:22.914065  4313 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:22.914825  3930 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.902153  4144 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:22.931747  1604 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:22.946823  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.948002  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.932519  1533 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:22.932854  1526 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:22.904953  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.949501  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.949683  4323 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.950153  1609 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:22.950503  1526 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:22.951011  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:22.951740  1526 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:22.952379  1526 pending_rounds.cc:85] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:02:22.952644  1526 pending_rounds.cc:107] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:02:22.952898  1526 raft_consensus.cc:2889] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:22.949496  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44789.4us
I20260709 13:02:22.935313  1528 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:22.956408  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.931649  1607 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:02:22.874300  4335 raft_consensus.cc:1027] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: attempt to promote peer e3ab72f324d545a6b4ecb1025df1f7c0: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:02:22.953197  1533 pending_rounds.cc:85] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:02:22.960529  1609 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:22.962786  1533 pending_rounds.cc:107] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:22.965764  1607 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:22.966202  1533 raft_consensus.cc:2889] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.965112  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:22.973904  1609 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:22.873641  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 43776.6us
I20260709 13:02:22.921254  4085 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:22.983434  1531 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:22.988873  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.990548  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.986274  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:22.986693  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.993007  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:22.994019  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:22.946414  3908 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:22.971534  2210 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:22.996759  3908 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.985886  4166 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:22.997578  4166 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:22.998531  4166 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.999071  4085 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:22.960266  4287 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.009225  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.008858  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.003778  1531 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:22.995484  4135 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.010810  1682 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:23.011812  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:23.008512  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.006405  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.010017  1681 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:22.972229  4321 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.029254  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:22.939010  3944 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:02:22.962479  4342 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:23.030125  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.033524  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.033700  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.036377  3930 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.036878  4316 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:23.038209  3920 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.978123  3971 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.067574  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.069670  3971 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.070070  3971 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.070395  3971 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.041860  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.071135  1676 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:23.071288  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:23.007036  4282 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:02:23.039990  4344 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.059880  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:02:23.061933  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96923.1us
I20260709 13:02:23.012140  4213 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:23.011499  4345 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.150s	user 0.003s	sys 0.001s
W20260709 13:02:23.061182  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.065019  4135 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.066172  3930 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.041035  4085 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.087069  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:22.962849  4330 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:02:23.045146  4199 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.073717  4338 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.076613  4325 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:23.079459  1535 raft_consensus.cc:2410] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:23.041786  4206 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 5. Current term is 6.
W20260709 13:02:23.066618  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.088630  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.012902  4267 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:22.977566  4335 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:02:23.090433  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.151762  1684 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:23.154064  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 63716.7us
I20260709 13:02:23.089393  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:23.161448  1680 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:23.084143  4294 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.118430  4223 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.129317  4286 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:23.128986  4330 consensus_queue.cc:1243] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:02:23.173787  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 341119us
I20260709 13:02:23.117789  4344 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.087121  4135 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.129142  4157 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.120476  4325 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:23.153970  4291 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.160729  4331 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:23.223896  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.227322  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.120582  3920 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:02:23.279160  3920 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.228950  4282 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:23.281710  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.272356  1609 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:23.119669  4297 consensus_meta.cc:287] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.003s
I20260709 13:02:23.164085  4294 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:23.119685  4312 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.232651  3930 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:23.236745  4349 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:23.229012  4331 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:23.240206  4313 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:02:23.182870  4223 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.242475  4208 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.172127  4323 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.248873  4344 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:23.251045  4311 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.253476  4319 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.254854  4207 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.255077  4222 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.258625  4166 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:23.260180  1527 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:23.261722  4280 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.262089  3971 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.262352  4340 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:02:23.265232  4206 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.324409  4344 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.204231  4267 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:02:23.269084  4199 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.171336  4228 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.269186  1610 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:23.197224  4326 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:02:23.169623  4320 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:02:23.204551  4087 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.349829  4087 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.350268  4087 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.350579  4312 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.350841  4207 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.340209  4344 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.170224  4353 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:02:23.352231  4208 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:23.353788  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.271308  1605 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 4. Current term is 6. Ops: []
I20260709 13:02:23.272346  4342 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:23.196209  4286 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:23.358150  4286 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.203027  4318 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:23.275111  4198 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:23.360822  4198 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:23.361284  4320 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:23.361733  4320 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:23.362066  4198 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.362644  4320 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.363045  4310 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:02:23.364356  4343 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:23.364869  4343 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.365249  4343 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.165381  4242 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.113s
W20260709 13:02:23.296433  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 136214us
I20260709 13:02:23.082907  4144 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:23.301293  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 212092us
W20260709 13:02:23.301590  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.220709  4135 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.319787  1603 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:02:23.320794  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.296217  4294 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.299562  3930 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:23.367128  4320 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.389226  3930 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.300777  4287 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.392485  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.392658  4287 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.394877  4287 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:23.330237  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.331343  1604 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:23.331794  1527 pending_rounds.cc:85] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 5
I20260709 13:02:23.396996  1527 pending_rounds.cc:107] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:23.374985  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.397382  1527 raft_consensus.cc:2889] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:23.318244  4223 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.281009  4291 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.267807  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:23.404726  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.337589  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 110360us
I20260709 13:02:23.296523  4297 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.338685  1679 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:23.327183  4157 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.375388  4195 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.377279  4222 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:23.339084  4206 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.381872  4087 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.450590  1604 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:23.385598  4135 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.462054  1606 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:23.451265  1433 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 6 to 8, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193), now has a pending config: VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193), VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194), VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195), NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:02:23.366214  4342 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.416285  4358 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.334147  4351 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.194s
I20260709 13:02:23.396202  4363 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:23.422614  3971 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.425244  4277 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:23.425148  2210 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEARNER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:02:23.430437  4157 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.429472  4325 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.485486  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.486805  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:23.339350  4331 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.410331  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.444772  1682 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:02:23.487254  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:23.445396  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 278228us
I20260709 13:02:23.488081  1534 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:23.488200  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 78008.7us
I20260709 13:02:23.488982  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.456790  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.490007  1605 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:23.457370  1608 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:23.457978  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.491232  1604 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:23.492601  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.460790  1607 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:23.467243  1528 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:23.498204  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.500149  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:23.469199  1433 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 5 to 6, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 6 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:23.465711  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.468113  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.468381  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:23.476249  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81606.9us
I20260709 13:02:23.503091  1527 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:23.481416  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:23.462409  4321 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:23.511533  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.512506  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.514693  1529 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.513478  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.548552  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:02:23.549064  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63610.1us
I20260709 13:02:23.549356  1682 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.549953  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:23.550647  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 63929.3us
I20260709 13:02:23.480731  4277 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:23.504089  4144 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:23.560267  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 75973.4us
W20260709 13:02:23.561369  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1499) took 1328 ms (client timeout 1544 ms). Trace:
I20260709 13:02:23.469018  4282 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 13:02:23.563428  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56561.4us
W20260709 13:02:23.564291  1606 rpcz_store.cc:269] 0709 13:02:22.232532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.237555 (+  5023us) service_pool.cc:224] Handling call
0709 13:02:23.561162 (+1323607us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400085554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:23.561312 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662019456}
I20260709 13:02:23.512214  4280 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:23.513633  4195 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.508703  4323 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.571915  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.576449  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.577243  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.576479  1534 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:23.580605  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.587766  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.598582  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.616292  1526 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:23.587798  1680 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:23.499531  4312 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:02:23.600528  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 107101us
I20260709 13:02:23.563815  4325 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.567327  4198 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.617597  1681 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:23.627723  1529 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:23.618268  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.628820  1680 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.587908  1679 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:23.624745  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.630132  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.566781  4228 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:23.636610  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.637960  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.638689  1681 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:23.630308  1683 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:23.640774  4087 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.641178  4222 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:23.644855  4208 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.645467  4208 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.635628  1529 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: [7.4-8.5]
W20260709 13:02:23.613905  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 110693us
I20260709 13:02:23.650640  1608 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 6.
I20260709 13:02:23.650882  1680 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:23.569456  4330 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:02:23.632310  4328 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:23.569996  4008 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:02:23.618350  4280 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:23.647830  4208 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.582542  4338 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:23.685794  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.687552  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.690703  1676 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.692246  4321 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:23.692960  4321 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.695196  4321 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:23.698431  4361 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:23.698951  4361 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:23.699915  4361 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.706465  4365 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:23.707062  4365 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.706319  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.708603  1681 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.711699  1676 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:23.718465  4321 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:23.701408  4361 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.719175  4321 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.721817  4321 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:23.653445  4228 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:23.724086  4228 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.712224  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:23.728305  4368 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:02:23.733521  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:23.734727  4213 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:23.734889  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.736307  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:23.717556  4365 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:23.717700  4377 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:02:23.829207  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:23.738955  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:23.741935  4357 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:02:23.658731  4319 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:23.757135  4371 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:02:23.811055  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 192644us
I20260709 13:02:23.661764  4363 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
W20260709 13:02:23.820269  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.858734  1530 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:23.859372  1530 pending_rounds.cc:85] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 3
I20260709 13:02:23.634264  4277 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.825135  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:23.826009  1610 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:23.864812  1607 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:23.854410  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:23.863919  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 125265us
I20260709 13:02:23.853080  1681 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:23.859894  1530 pending_rounds.cc:107] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 7.4
W20260709 13:02:23.860319  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.861903  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 294394us
I20260709 13:02:23.865831  1530 raft_consensus.cc:2889] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:23.853575  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 288057us
I20260709 13:02:23.822660  4234 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:23.869243  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.869661  1603 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:23.877013  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.870116  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:23.866792  3930 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.870960  4282 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:23.874183  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:23.874531  4338 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.873919  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:23.878355  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.878494  1677 raft_consensus.cc:606] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.879079  1677 raft_consensus.cc:614] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:23.831804  4337 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:23.877946  1610 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.870020  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:23.882200  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:23.881091  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.890003  1604 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:23.891234  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.884310  4135 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.867341  4297 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:23.901500  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.876655  4287 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:02:23.907306  4373 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:23.904440  4280 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:23.884122  4364 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.357s
W20260709 13:02:23.908533  4366 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:02:23.889052  4213 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.882475  4198 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:23.910748  1681 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:23.892439  4206 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.859357  4344 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:23.922181  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55920.3us
I20260709 13:02:23.942312  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.879909  4291 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:23.880677  4384 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.882795  4337 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:23.890165  4321 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:02:23.934863  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:23.961440  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.962327  1535 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:23.963680  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 81527.3us
I20260709 13:02:23.862073  4343 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:23.938755  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58364.7us
I20260709 13:02:23.965298  4206 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.965780  4206 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.916671  1610 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:23.909408  4157 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:23.937618  1498 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.544s (SENT) [suppressed 20 similar messages]
I20260709 13:02:23.905352  4277 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.955034  1532 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:23.972751  1528 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:23.858448  4286 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:23.957379  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.957810  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.978543  1681 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.923699  4319 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:23.963483  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:23.900262  4330 consensus_queue.cc:1243] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:23.928969  3971 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.943819  4365 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.941215  4362 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:23.979839  4157 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.979514  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.982482  4207 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:23.983348  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.949365  4198 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:23.987970  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:23.990345  1609 raft_consensus.cc:2368] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 7. Current term is 8.
I20260709 13:02:23.991616  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:23.936954  4267 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:23.995174  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:23.944586  4318 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:24.003042  1681 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:24.006121  1533 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.009117  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:24.019876  1679 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:24.004952  4087 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.004530  4291 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.018797  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.032048  1677 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.020138  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:23.946391  3920 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:24.011278  4282 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.993377  4199 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.012111  4208 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:24.011286  4370 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.004s
I20260709 13:02:24.013556  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:24.003727  4319 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:24.009382  3942 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.008424  4195 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.958640  4384 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:23.989688  3908 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:24.054091  4343 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:24.055799  4380 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.056377  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:24.057588  4344 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:24.119454  4310 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.004s
I20260709 13:02:24.012193  4207 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:24.138837  1607 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:24.007831  4365 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.065760  4198 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.067873  4286 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:24.043987  4291 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.036216  4087 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.011509  4157 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.073597  4206 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.077195  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.014693  4008 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:02:24.084970  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64929.4us
I20260709 13:02:24.086163  4199 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.137362  4343 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.117163  3930 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.117400  1601 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:24.119119  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.053853  4331 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.122308  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:24.090487  4294 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.001s
I20260709 13:02:24.044989  4267 consensus_queue.cc:1243] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:02:24.112701  4320 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 13:02:24.034137  1681 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:02:24.035174  4391 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:24.129287  4234 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:24.081744  4208 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:24.007462  4337 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.119055  3971 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:24.011819  4362 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.044751  3920 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.189590  3920 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:24.189736  4387 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.180214  4208 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.168262  4364 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.201573  4364 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:24.149936  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 212317us
I20260709 13:02:24.079187  4282 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.154922  4195 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:24.158245  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:24.078743  1684 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:24.162607  1678 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:24.119364  3942 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.144640  4297 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.159991  4342 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.006s
I20260709 13:02:24.136619  4380 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.168875  4294 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.167968  4343 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.177690  4207 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.165220  4319 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.503721  2210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41286 (request call id 72) took 1048 ms. Trace:
I20260709 13:02:24.435016  1527 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:24.457023  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1525) took 1442 ms. Trace:
I20260709 13:02:24.457993  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:02:24.509413  1678 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:24.509773  1601 raft_consensus.cc:606] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:24.458081  1676 pending_rounds.cc:85] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 2
I20260709 13:02:24.510618  1676 pending_rounds.cc:107] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:02:24.511111  1676 raft_consensus.cc:2889] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.509032  1675 rpcz_store.cc:276] 0709 13:02:23.014204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.015140 (+   936us) service_pool.cc:224] Handling call
0709 13:02:23.015623 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:23.064628 (+ 49005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.064656 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:23.072691 (+  8035us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.455100 (+382409us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:23.455169 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.455280 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.181007 (+725727us) raft_consensus.cc:1685] finished
0709 13:02:24.181036 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.456945 (+275909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":676,"raft.queue_time_us":54681,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":15254,"thread_start_us":358402,"threads_started":2,"wal-append.queue_time_us":457739}
I20260709 13:02:24.514950  1678 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:24.507112  2210 rpcz_store.cc:276] 0709 13:02:23.424260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.424450 (+   190us) service_pool.cc:224] Handling call
0709 13:02:23.424762 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.425023 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:24.061367 (+636344us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.471954 (+410587us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.472275 (+   321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.472340 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:24.472402 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.472489 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.472645 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25834,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5063,"thread_start_us":401037,"threads_started":2,"wal-append.queue_time_us":117739}
W20260709 13:02:24.281365  4400 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:02:24.183876  4391 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:24.312486  4379 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.421s	user 0.004s	sys 0.005s
W20260709 13:02:24.436743  4223 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.000s
I20260709 13:02:24.521865  1532 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:24.530426  1532 pending_rounds.cc:85] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:02:24.530750  1532 pending_rounds.cc:107] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:24.530970  1532 raft_consensus.cc:2889] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.229943  3930 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.524542  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.535405  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:24.506042  4364 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.536599  4364 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.527379  1606 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.360890  4087 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.307469  4282 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.262802  4325 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.535130  4223 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.508455  4208 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.189628  4362 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:24.536820  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.526484  4008 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.507067  4342 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.231703  3971 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:24.605100  3971 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.605919  4342 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.508633  4297 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.264143  4195 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:24.608548  4391 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.609705  4223 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.607885  4207 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.611939  4359 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:24.612524  4359 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:24.613008  4087 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.613489  4087 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.613586  4359 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.615005  4359 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.616130  4316 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:24.619361  4208 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:24.232522  4335 consensus_queue.cc:1175] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6031790cc44edfba5c3964e6f27c6e" responder_term: 7 status { last_received { term: 7 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 7 index: 3 } }
I20260709 13:02:24.596115  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:24.597882  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54030.8us
I20260709 13:02:24.249545  4387 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.627848  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:24.630733  4311 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.631310  4311 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:24.632164  4311 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.635072  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:24.623710  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.084s
I20260709 13:02:24.540540  3930 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:24.636588  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.012s	sys 0.084s
I20260709 13:02:24.626165  1608 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:24.638692  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 480532us
I20260709 13:02:24.639767  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:24.424264  4234 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:24.582113  4365 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:24.582953  4199 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.652843  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.597852  4364 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:24.605100  4213 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:24.625174  4157 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:24.644217  4379 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:24.617951  4401 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:02:24.594686  4325 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:24.710959  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.623172  4008 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.659641  4277 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.744833  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:24.664346  4384 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.754262  4361 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.757395  4330 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:24.668988  4199 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.761752  1534 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:24.667578  4213 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.760154  4316 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.728448  4412 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.763417  4361 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.768534  4338 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:24.769168  4338 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:24.769855  4361 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.770370  4330 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.772673  4297 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.772615  4316 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.773363  4330 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.767805  4412 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:24.782989  4380 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:24.783113  4343 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.776292  4384 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.786602  4207 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.788341  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 148676us
W20260709 13:02:24.782732  4408 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:24.792337  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.764249  4277 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.791159  4402 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.790478  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.792143  4207 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.801640  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1174) took 1226 ms. Trace:
I20260709 13:02:24.802114  1683 rpcz_store.cc:276] 0709 13:02:23.575277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.765071 (+1189794us) service_pool.cc:224] Handling call
0709 13:02:24.801548 (+ 36477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.802384  4294 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.802551  4384 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.806882  4008 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.807154  4325 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.807353  4207 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.788686  4412 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.810590  4316 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.772487  4199 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.812599  4338 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.814496  4199 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.815327  1531 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:24.784063  4364 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.819242  4402 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:24.822579  4402 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:24.790194  4331 consensus_meta.cc:287] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.002s
W20260709 13:02:24.835247  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.838932  3942 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.838966  4337 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:24.844388  4417 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
W20260709 13:02:24.846215  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1149) took 1379 ms (client timeout 1637 ms). Trace:
W20260709 13:02:24.846746  1528 rpcz_store.cc:269] 0709 13:02:23.466909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.497881 (+ 30972us) service_pool.cc:224] Handling call
0709 13:02:24.845946 (+1348065us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002201d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:24.846141 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089425152}
I20260709 13:02:24.849392  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:24.850891  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:24.853837  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.854092  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:24.854496  1682 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.854997  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.855661  1528 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
W20260709 13:02:24.856771  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.857226  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.858598  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:24.859725  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1486) took 1171 ms. Trace:
I20260709 13:02:24.860343  1606 rpcz_store.cc:276] 0709 13:02:23.687949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.689578 (+  1629us) service_pool.cc:224] Handling call
0709 13:02:23.689910 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.540596 (+850686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.859463 (+318867us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b5400086954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:24.859660 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925330176}
I20260709 13:02:24.861981  4286 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:24.862474  4286 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.866499  4387 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.862876  4286 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.869789  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.870898  1604 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:24.869167  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.871943  4344 raft_consensus.cc:1064] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:02:24.872366  4318 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.873164  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.873361  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:24.873615  4318 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.874105  4318 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:24.875062  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.874739  4344 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:24.875167  4318 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.875861  1606 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:24.869623  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:24.933305  1601 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:24.935144  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81114.5us
I20260709 13:02:24.936676  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:24.940344  4338 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.940760  4338 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.941119  4338 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.942754  4313 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:24.943367  4313 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.943738  4313 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.874294  1531 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:24.944698  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.944975  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:24.945752  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 130) took 1374 ms. Trace:
I20260709 13:02:24.946153  1609 rpcz_store.cc:276] 0709 13:02:23.571553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.571679 (+   126us) service_pool.cc:224] Handling call
0709 13:02:24.945551 (+1373872us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400100754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:24.945699 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925068032}
I20260709 13:02:24.883569  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1522) took 1422 ms. Trace:
I20260709 13:02:24.884281  4222 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:24.886606  4411 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
I20260709 13:02:24.947405  4222 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.888336  4375 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.949002  4365 consensus_queue.cc:1175] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:24.952690  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:24.947184  1602 rpcz_store.cc:276] 0709 13:02:23.461463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.466908 (+  5445us) service_pool.cc:224] Handling call
0709 13:02:23.467183 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.823869 (+356686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.823905 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.833037 (+  9132us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.967567 (+134530us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:23.967601 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.883025 (+915424us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400101154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:24.883097 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.883163 (+    66us) raft_consensus.cc:1685] finished
0709 13:02:24.883182 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.883487 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59757,"raft.queue_time_us":74770,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":7656,"spinlock_wait_cycles":56134400,"thread_start_us":333721,"threads_started":2,"wal-append.queue_time_us":132290}
I20260709 13:02:24.888384  4363 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:24.889461  1683 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.890257  1678 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.890810  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.892081  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:24.972435  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80623.9us
I20260709 13:02:24.893559  4353 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.893735  4087 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.887936  3920 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:24.894371  4362 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.869683  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 878039us
I20260709 13:02:24.982791  1602 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:02:24.998510  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:24.999719  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.000258  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:24.918224  1526 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:25.000741  1678 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:25.002058  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:25.003471  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.925156  4319 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.925736  4321 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.882225  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:24.945792  1531 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:25.007450  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.007927  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.008320  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:25.009053  1531 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:24.967891  1682 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:25.009698  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1178) took 1431 ms. Trace:
I20260709 13:02:25.010035  1682 rpcz_store.cc:276] 0709 13:02:23.578102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.853575 (+1275473us) service_pool.cc:224] Handling call
0709 13:02:25.009640 (+156065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.011161  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:24.982133  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:24.983961  1609 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:24.984666  1601 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.985641  1606 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:24.986594  1610 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:24.988672  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:24.989531  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:24.990885  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:25.015901  1609 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.018334  1605 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:24.904552  4343 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.921133  4320 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.024986  4343 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.025146  4320 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:25.027240  4343 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:24.923691  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.990885  4207 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.028088  4365 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:02:25.028693  4207 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.030015  4365 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:25.030776  4207 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.030962  4365 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.031533  4365 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.031364  4362 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:24.949047  4375 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.032781  4380 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:25.033528  4375 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.033761  4380 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:25.034581  4375 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.021236  4294 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.991672  4327 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:24.992473  4363 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.036625  4327 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:25.037590  4320 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:25.038161  4320 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:25.038743  4363 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.039453  4363 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:25.039330  4321 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.040102  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:25.040408  3908 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.996143  4353 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.020949  4234 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.041501  4321 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.041639  4234 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.042117  4234 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.043268  4353 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.006449  3920 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.021202  3930 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.022768  4277 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:24.976159  4323 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.038801  4327 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:25.040956  3908 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.045778  1601 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:25.020695  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 156) took 13293 ms (client timeout 15000 ms). Trace:
I20260709 13:02:25.046579  1675 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:25.047298  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.018977  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:25.038517  4320 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:25.054106  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.165136  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.311192  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.311544  1683 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:25.099793  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.112151  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.312786  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.307541  1610 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:25.337879  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:25.100649  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51940.8us
I20260709 13:02:25.315088  4391 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.315385  1528 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.316614  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.141220  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.313769  1603 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:25.341310  1606 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:25.313632  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:25.307233  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.098805  2175 leader_election.cc:400] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 7. Current term is 8.
I20260709 13:02:25.322258  1682 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.342621  1535 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:25.323789  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.342795  4323 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.128386  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.165699  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1128) took 2930 ms. Trace:
I20260709 13:02:25.343597  4323 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.343837  1530 rpcz_store.cc:276] 0709 13:02:22.235171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.283729 (+ 48558us) service_pool.cc:224] Handling call
0709 13:02:22.284087 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.870711 (+1586624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.165352 (+1294641us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003d2cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:25.165620 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3620502912}
I20260709 13:02:25.346532  4323 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.347254  4323 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.111403  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.317265  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1361) took 1371 ms. Trace:
W20260709 13:02:25.342818  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 295973us
I20260709 13:02:25.348340  1532 rpcz_store.cc:276] 0709 13:02:23.937054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.009296 (+ 72242us) service_pool.cc:224] Handling call
0709 13:02:24.017530 (+  8234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.531366 (+513836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.293056 (+761690us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540027bfd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:25.307940 (+ 14884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159094144}
I20260709 13:02:25.349542  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:25.350036  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.350939  1532 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:25.327605  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1528) took 1457 ms. Trace:
I20260709 13:02:25.351925  2210 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:25.327544  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.353333  1526 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:25.039849  4363 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:24.996999  4008 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.351687  1608 rpcz_store.cc:276] 0709 13:02:23.869765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.873952 (+  4187us) service_pool.cc:224] Handling call
0709 13:02:25.327410 (+1453458us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540003c5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:25.327547 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711200512}
I20260709 13:02:25.353761  1531 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:02:25.354519  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.354256  4363 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.307675  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1349) took 1817 ms (client timeout 1965 ms). Trace:
W20260709 13:02:25.355986  1527 rpcz_store.cc:269] 0709 13:02:23.490463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.549707 (+ 59244us) service_pool.cc:224] Handling call
0709 13:02:25.294602 (+1744895us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54000fbc54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:25.307620 (+ 13018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312521984}
I20260709 13:02:25.357337  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.358135  1527 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:25.355701  1608 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:25.359977  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.360731  1608 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:25.361672  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.347846  4323 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.362869  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.364746  4323 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.365569  1605 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:25.366889  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.112736  4344 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.387650  4206 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:25.388062  4344 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.390265  4344 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.204169  4353 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.390723  4087 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.391063  4353 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.393308  4353 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.366889  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.394822  4353 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.033551  4362 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.396574  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.378484  4008 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:25.397198  1683 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:25.397413  4008 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.398216  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.398443  4329 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.398814  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:25.399008  4329 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:25.399607  4008 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.149588  4358 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:25.406510  4358 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.408284  4320 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.050050  4365 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.340310  4412 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:02:25.409726  4320 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.409956  4412 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.205979  4321 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.412269  4321 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.203128  4294 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:25.386021  4421 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:25.386695  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.387254  4199 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.388433  4166 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.390233  3908 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.391160  4087 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.397542  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.373234  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.436403  1528 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:25.436496  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63350us
I20260709 13:02:25.438141  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.143283  4144 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.400281  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.388074  4206 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:25.160573  4222 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.382310  4364 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:25.401603  1527 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:25.370420  4391 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.405777  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:25.408767  4358 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.375623  1682 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:25.371109  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 99) took 1958 ms. Trace:
I20260709 13:02:25.407892  1532 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:25.385025  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50938 (request call id 5) took 25810 ms. Trace:
I20260709 13:02:25.394716  1609 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:02:25.395498  4353 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:25.399717  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.501670  1683 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
W20260709 13:02:25.422369  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.098150  4319 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.370219  4342 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.332449  4419 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 13:02:25.427253  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.035s
W20260709 13:02:25.498802  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 93102.4us
W20260709 13:02:25.432358  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.517222  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.035s
I20260709 13:02:25.383224  3920 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.439453  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.424979  4412 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.413838  4277 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:25.446592  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:25.530965  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 84457.6us
I20260709 13:02:25.419557  4195 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:25.241173  4286 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.313511  1430 rpcz_store.cc:269] 0709 13:02:11.713379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.713552 (+   173us) service_pool.cc:224] Handling call
0709 13:02:24.990927 (+13277375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:15.421913 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:15.601233 (+179320us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:15.601287 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:02:15.601313 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:15.602779 (+  1466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:15.602859 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:15.602898 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:02:15.679565 (+ 76667us) tablet.cc:701] Row locks acquired
0709 13:02:15.679582 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:15.679983 (+   401us) write_op.cc:270] Start()
0709 13:02:15.681737 (+  1754us) write_op.cc:276] Timestamp: P: 1783602135679908 usec, L: 0
0709 13:02:15.681755 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:15.682799 (+  1044us) log.cc:844] Serialized 4805 byte log entry
0709 13:02:18.063721 (+2380922us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b1800351400. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:18.730646 (+666925us) op_driver.cc:464] REPLICATION: finished
0709 13:02:18.990738 (+260092us) write_op.cc:301] APPLY: starting
0709 13:02:19.005191 (+ 14453us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:19.041581 (+ 36390us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:19.041621 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:19.220977 (+179356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:19.221374 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:02:19.221437 (+    63us) write_op.cc:312] APPLY: finished
0709 13:02:19.221890 (+   453us) log.cc:844] Serialized 88 byte log entry
0709 13:02:19.222078 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.222336 (+   258us) write_op.cc:454] Released schema lock
0709 13:02:19.222405 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:19.222853 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.222883 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":402191,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":164063,"apply.run_cpu_time_us":5227,"apply.run_wall_time_us":257640,"num_ops":12,"prepare.queue_time_us":487300,"prepare.run_cpu_time_us":58114,"prepare.run_wall_time_us":642069,"raft.queue_time_us":298995,"raft.run_cpu_time_us":37329,"raft.run_wall_time_us":281144,"replication_time_us":3032903,"spinlock_wait_cycles":61509888,"thread_start_us":726309,"threads_started":5,"wal-append.queue_time_us":437455,"wal-append.run_cpu_time_us":55297,"wal-append.run_wall_time_us":3236108}]]}
I20260709 13:02:25.377889  4287 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:02:25.465622  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:25.513151  4223 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.602756  1527 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.403676  1535 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:25.604223  1535 pending_rounds.cc:85] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 5
I20260709 13:02:25.604501  1535 pending_rounds.cc:107] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:25.381036  4292 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:02:25.383739  3942 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:02:25.474957  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 467861us
I20260709 13:02:25.395795  4234 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:25.132084  4198 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.249s
I20260709 13:02:25.496789  1533 rpcz_store.cc:276] 0709 13:02:23.412925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.422127 (+  9202us) service_pool.cc:224] Handling call
0709 13:02:23.422414 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.019401 (+596987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.370821 (+1351420us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54000de654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:25.371039 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341760896}
W20260709 13:02:25.503351  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.499862  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.012s	sys 0.019s
W20260709 13:02:25.610996  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.013s	sys 0.019s
I20260709 13:02:25.444496  4144 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:25.463129  3930 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.497833  1681 rpcz_store.cc:276] 0709 13:01:59.574215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.576203 (+  1988us) service_pool.cc:224] Handling call
0709 13:01:59.654421 (+ 78218us) log.cc:844] Serialized 506 byte log entry
0709 13:02:00.341537 (+687116us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5400368920. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff2142 00007f4697fd2eaa 00007f4697fd9d53 00007f4697fd9cd9 00007f4697fd9c69 00007f4697fd9c31 00007f4697fd8dfd 000000000038f354 000000000038f199 00007f4694f8c475
0709 13:02:01.099310 (+757773us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5400368920. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff2142 00007f4697fd2eaa 00007f4697fd9d53 00007f4697fd9cd9 00007f4697fd9c69 00007f4697fd9c31 00007f4697fd8dfd 000000000038f354 000000000038f199 00007f4694f8c475
0709 13:02:25.384924 (+24285614us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8906,"raft.queue_time_us":3459,"raft.run_cpu_time_us":5993,"raft.run_wall_time_us":2116986,"spinlock_wait_cycles":12009472}
W20260709 13:02:25.421373  4228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.020s	sys 0.035s
I20260709 13:02:25.426136  4294 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.519481  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:25.508124  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 507882us
I20260709 13:02:25.625227  1682 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:25.625782  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:25.604740  4195 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.611766  4157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.020s
W20260709 13:02:25.494433  4242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.027s	sys 0.066s
I20260709 13:02:25.468096  4222 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.435906  4166 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.539253  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:25.520113  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:25.641199  1683 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:25.591583  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.512320  4342 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.604768  1535 raft_consensus.cc:2889] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:25.586151  4326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.047s	sys 0.074s
I20260709 13:02:25.609452  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.419679  4329 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.639633  4213 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.852s	user 0.015s	sys 0.000s
I20260709 13:02:25.616510  1527 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:25.681214  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.630609  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:25.603124  4384 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:02:25.606981  4431 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:25.624648  4228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.021s	sys 0.035s
W20260709 13:02:25.636291  4242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.027s	sys 0.067s
I20260709 13:02:25.596347  4277 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.463706  4008 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:25.642153  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 122177us
I20260709 13:02:25.609102  4321 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:25.646338  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54851.5us
W20260709 13:02:25.691936  4313 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.004s
W20260709 13:02:25.632767  4338 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.001s
I20260709 13:02:25.464403  4364 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:25.616954  3908 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:25.669660  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1159) took 1146 ms. Trace:
W20260709 13:02:25.635998  4157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.008s	sys 0.021s
I20260709 13:02:25.603492  4206 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.677891  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68531.3us
I20260709 13:02:25.723807  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.594767  4207 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.733476  4207 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.733995  4207 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.635777  4323 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.682118  1682 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:25.737210  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.737920  1682 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:25.738971  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.739614  1682 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:02:25.682687  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52181.9us
I20260709 13:02:25.640460  4222 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.668460  4342 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.742477  4222 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:25.670954  4223 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.732748  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.698333  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:25.669406  4198 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:25.635352  4195 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.616354  3930 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.711982  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:25.688304  4213 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.762817  1609 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:02:25.692986  4329 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.714016  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.714907  1535 rpcz_store.cc:276] 0709 13:02:24.523241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.402862 (+879621us) service_pool.cc:224] Handling call
0709 13:02:25.403237 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.669301 (+266064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.669583 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.700088  4423 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:02:25.699747  4008 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.745090  1528 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:25.745610  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.687820  4431 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.756814  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.803319  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.803231  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:25.803988  3930 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.701857  4242 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:02:25.712584  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 361040us
I20260709 13:02:25.802939  1683 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:25.713394  4313 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.859647  1601 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.730326  4362 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.852365  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:25.852077  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.680624  4144 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.744710  3920 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:25.860452  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.861415  1682 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:25.861941  1532 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:25.862778  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.863545  1682 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:25.854099  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:25.756258  4206 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.755235  4223 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.782363  4087 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.896534  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.717736  4338 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.720860  4387 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:25.897720  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.918152  1535 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:25.897887  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 283967us
I20260709 13:02:25.899188  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.918877  1682 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
W20260709 13:02:25.750648  4405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.043s
I20260709 13:02:25.728403  3908 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.851679  4430 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.905277  1528 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:25.939010  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.897178  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:25.913975  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:25.755625  4228 consensus_queue.cc:1175] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36f53e9bfce749bbba4a4b34829f563d" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:25.855188  4008 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.905251  4438 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.905390  4198 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:25.913573  3920 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:25.856652  4222 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.778745  4321 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.924263  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:25.953847  4427 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:02:25.856339  4432 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:25.928304  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:25.866190  4319 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:25.936354  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80701.8us
I20260709 13:02:26.002672  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1545) took 1998 ms. Trace:
I20260709 13:02:25.940932  1683 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:26.003669  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:26.004356  1683 raft_consensus.cc:606] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:26.005200  1683 raft_consensus.cc:614] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.005621  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58454 (request call id 19) took 1081 ms. Trace:
I20260709 13:02:26.005915  1683 rpcz_store.cc:276] 0709 13:02:24.924634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.003512 (+1078878us) service_pool.cc:224] Handling call
0709 13:02:26.005542 (+  2030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.007586  1683 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:25.936762  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 224875us
W20260709 13:02:25.941846  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 243589us
I20260709 13:02:26.009230  4364 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:26.009411  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:25.939690  1528 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:26.010834  4364 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.010974  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.011687  1528 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:25.905885  4223 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.012585  4277 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.940418  1532 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:26.013760  4363 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.013248  4321 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.896309  4353 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:25.944743  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:25.906016  4384 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.944648  4391 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.015663  4384 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:26.015964  4391 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:26.016165  4384 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.920491  4312 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:26.017182  4312 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:26.017817  4166 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.018000  4312 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.019243  4312 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.912225  4286 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.953431  1603 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:25.920665  4405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.015s	sys 0.057s
I20260709 13:02:26.020987  4405 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.716761  4433 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:25.920650  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.922770  4144 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.939198  4414 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.152s	user 0.003s	sys 0.002s
I20260709 13:02:25.926862  4374 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:25.938195  4430 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.961596  4419 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.928119  4387 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.977929  1535 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:25.906436  4362 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.975255  4198 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:25.979568  4425 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:02:25.980526  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:25.982028  3908 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:25.982817  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1537) took 2023 ms. Trace:
I20260709 13:02:25.985332  4213 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:25.987807  4426 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:02:25.990824  4365 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.004s
I20260709 13:02:25.993866  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1538) took 2029 ms. Trace:
I20260709 13:02:26.064724  1676 rpcz_store.cc:276] 0709 13:02:23.964756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.457512 (+492756us) service_pool.cc:224] Handling call
0709 13:02:24.457861 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:25.351930 (+894069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.351974 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:25.352693 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 13:02:25.713542 (+360849us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:25.713588 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.713660 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.993602 (+279942us) raft_consensus.cc:1685] finished
0709 13:02:25.993623 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.993779 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375201,"raft.queue_time_us":377836,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":819501,"threads_started":2,"wal-append.queue_time_us":504697}
I20260709 13:02:26.011593  4364 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:25.960661  4438 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.076499  4291 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.076880  3920 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.078364  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1546) took 1040 ms. Trace:
I20260709 13:02:26.078792  1605 rpcz_store.cc:276] 0709 13:02:25.038161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.382903 (+344742us) service_pool.cc:224] Handling call
0709 13:02:25.383253 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.404061 (+ 20808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.404106 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.404574 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.713872 (+309298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.713926 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.714649 (+   723us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.078149 (+363500us) raft_consensus.cc:1685] finished
0709 13:02:26.078170 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.078301 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20403,"raft.queue_time_us":21549,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"thread_start_us":308948,"threads_started":1,"wal-append.queue_time_us":640649}
I20260709 13:02:25.976785  4222 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.080792  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.082053  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.001253  4447 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:25.960544  4435 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:02:26.022753  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:26.088434  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 65762us
I20260709 13:02:26.003060  1684 rpcz_store.cc:276] 0709 13:02:24.004756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.511583 (+506827us) service_pool.cc:224] Handling call
0709 13:02:24.511820 (+   237us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:25.338209 (+826389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.338239 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:25.383551 (+ 45312us) log.cc:844] Serialized 52 byte log entry
0709 13:02:25.728646 (+345095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.728682 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.728761 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.002439 (+273678us) raft_consensus.cc:1685] finished
0709 13:02:26.002463 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.002617 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379687,"raft.queue_time_us":383022,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":675096,"threads_started":2,"wal-append.queue_time_us":458042}
I20260709 13:02:26.026621  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:26.012609  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.014160  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.090173  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:26.090533  1528 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:26.090775  1532 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:26.090713  1684 raft_consensus.cc:606] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:26.028520  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 113) took 1104 ms. Trace:
I20260709 13:02:25.926185  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1534) took 1967 ms. Trace:
I20260709 13:02:26.003907  4313 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.023409  4234 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.060971  2212 raft_consensus.cc:2393] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:02:26.091526  1681 rpcz_store.cc:276] 0709 13:02:23.958528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.033239 (+ 74711us) service_pool.cc:224] Handling call
0709 13:02:24.033647 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.033963 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:24.399514 (+365551us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.685342 (+1285828us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.925706 (+240364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.925783 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:25.925853 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.925947 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.926110 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360026,"prepare.queue_time_us":6993,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":433216,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":49729,"thread_start_us":802435,"threads_started":3,"wal-append.queue_time_us":255116}
I20260709 13:02:26.029729  4433 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:26.100653  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 74107us
I20260709 13:02:26.101770  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:26.064108  4458 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.950045  4294 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.031698  4432 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:26.083078  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74610.5us
I20260709 13:02:26.041673  4419 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.083801  1605 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:26.084434  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.133647  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1529) took 1151 ms. Trace:
I20260709 13:02:26.041186  4430 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:26.028123  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.091373  1684 raft_consensus.cc:614] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.091506  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:26.143747  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.038005  4444 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:26.061381  1677 rpcz_store.cc:276] 0709 13:02:23.959777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.165450 (+205673us) service_pool.cc:224] Handling call
0709 13:02:24.165774 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.884888 (+719114us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:25.336143 (+451255us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.729152 (+393009us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.729597 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.729721 (+   124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.729753 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.729815 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.982506 (+252691us) raft_consensus.cc:1685] finished
0709 13:02:25.982536 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.982729 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754001,"prepare.queue_time_us":647233,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":1151,"raft.queue_time_us":824358,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":47297,"thread_start_us":745661,"threads_started":2,"wal-append.queue_time_us":575977}
I20260709 13:02:26.144974  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.146281  1677 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:26.147073  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1189) took 1205 ms. Trace:
I20260709 13:02:26.147490  1677 rpcz_store.cc:276] 0709 13:02:24.941925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.145498 (+1203573us) service_pool.cc:224] Handling call
0709 13:02:26.145864 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.146765 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.147003 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.103535  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:26.095388  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:26.144754  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.149175  1532 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:26.149539  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.088083  4222 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.092404  4242 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.151322  1532 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:26.082993  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.152298  1676 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.135035  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.134107  1602 rpcz_store.cc:276] 0709 13:02:24.982019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.982153 (+   134us) service_pool.cc:224] Handling call
0709 13:02:24.982474 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.982678 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:25.329088 (+346410us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.112142 (+783054us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.114468 (+  2326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.122140 (+  7672us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:26.133395 (+ 11255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.133461 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.133586 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3072,"prepare.queue_time_us":24646,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":45,"raft.queue_time_us":113819,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2342,"thread_start_us":771423,"threads_started":3,"wal-append.queue_time_us":674677}
I20260709 13:02:26.085448  4438 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.048897  4374 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:26.091419  1683 rpcz_store.cc:276] 0709 13:02:24.924281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.006742 (+1082461us) service_pool.cc:224] Handling call
0709 13:02:26.007166 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.028178 (+ 21012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.028442 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.154795  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.109277  4458 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:26.087141  4365 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.114018  4457 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.112486  4321 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.162031  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.143752  4195 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.143704  4213 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:26.160063  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56641.8us
I20260709 13:02:26.187961  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:26.189327  4455 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.189465  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:26.173869  4430 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.190827  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:26.191359  4207 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.112727  4433 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.192183  4430 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.185112  1676 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:02:26.193084  1609 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:26.183436  4444 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:26.184325  4320 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.002s
W20260709 13:02:26.167418  4451 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:26.166847  4432 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.185087  4458 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.164479  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1175) took 2589 ms. Trace:
I20260709 13:02:26.169325  4464 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.144539  4419 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.191690  4457 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.193627  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:26.194501  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1207) took 1168 ms. Trace:
W20260709 13:02:26.156177  4375 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.005s	sys 0.015s
I20260709 13:02:26.192770  4463 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:26.207545  1677 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:26.207857  1678 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:26.207633  1680 rpcz_store.cc:276] 0709 13:02:23.575491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.743471 (+1167980us) service_pool.cc:224] Handling call
0709 13:02:24.744706 (+  1235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.745009 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.745052 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.764424 (+ 19372us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.112900 (+348476us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.112955 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.113052 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.164279 (+1051227us) raft_consensus.cc:1685] finished
0709 13:02:26.164307 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.164425 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":319894,"threads_started":1,"wal-append.queue_time_us":818210}
I20260709 13:02:26.189824  4455 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.182371  4234 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.185846  4338 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.231822  1676 rpcz_store.cc:276] 0709 13:02:25.026265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.193914 (+1167649us) service_pool.cc:224] Handling call
0709 13:02:26.194177 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.194305 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.194320 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.194347 (+    27us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:26.194368 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.194399 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.194460 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.159657  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:26.250476  1680 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:26.251212  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1546) took 1224 ms. Trace:
I20260709 13:02:26.251654  1680 rpcz_store.cc:276] 0709 13:02:25.026503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.250035 (+1223532us) service_pool.cc:224] Handling call
0709 13:02:26.250312 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.250880 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.251153 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:26.237231  4375 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.005s	sys 0.016s
I20260709 13:02:26.256899  4206 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:26.257468  4206 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.259677  4206 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.240731  4464 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.260377  4008 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.261674  4365 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.253111  4234 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:26.238641  4457 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:26.299427  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.300341  4465 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.301060  4465 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:26.301512  4462 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:26.309360  4465 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.253825  3930 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.265666  4223 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.312590  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1202) took 1287 ms. Trace:
I20260709 13:02:26.293442  4313 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.373404  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.500734  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1550) took 1473 ms. Trace:
I20260709 13:02:26.500909  1610 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:26.500360  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:26.496803  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.253410  4455 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.272992  4463 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:26.523849  1605 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:26.497787  1683 rpcz_store.cc:276] 0709 13:02:25.025031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.167487 (+1142456us) service_pool.cc:224] Handling call
0709 13:02:26.167921 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.179080 (+ 11159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.179112 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.179592 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.253918 (+ 74326us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:26.253962 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.254540 (+   578us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.312353 (+ 57813us) raft_consensus.cc:1685] finished
0709 13:02:26.312380 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.312527 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10656,"raft.queue_time_us":11500,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":73946,"threads_started":1,"wal-append.queue_time_us":111659}
I20260709 13:02:26.501130  1676 rpcz_store.cc:276] 0709 13:02:25.027545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.250088 (+1222543us) service_pool.cc:224] Handling call
0709 13:02:26.250439 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.250699 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:26.292399 (+ 41700us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.500275 (+207876us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.500435 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.500476 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:26.500517 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.500576 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.500680 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2714,"prepare.queue_time_us":62276,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3358,"thread_start_us":79039,"threads_started":1}
I20260709 13:02:26.317557  4008 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.528501  1602 raft_consensus.cc:2368] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:26.311187  4234 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:26.528065  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.535068  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:26.320680  4409 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.557s	user 0.000s	sys 0.005s
I20260709 13:02:26.535989  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.536177  1676 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:26.522286  4313 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:26.538986  4313 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:26.317888  4207 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.522439  4318 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.388897  4431 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.540597  4374 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:26.542407  2212 raft_consensus.cc:2368] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:26.542637  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1200) took 1518 ms. Trace:
W20260709 13:02:26.499946  4359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.007s	sys 0.005s
I20260709 13:02:26.543053  1677 rpcz_store.cc:276] 0709 13:02:25.024472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.148368 (+1123896us) service_pool.cc:224] Handling call
0709 13:02:26.148686 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.249801 (+101115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.542414 (+292613us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54000bf4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:26.542574 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134916864}
I20260709 13:02:26.543958  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1188) took 1602 ms. Trace:
I20260709 13:02:26.546829  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.543741  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.303568  4457 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.544133  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:26.501056  4342 consensus_meta.cc:287] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.760s	user 0.002s	sys 0.010s
I20260709 13:02:26.545586  1683 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.546525  1681 rpcz_store.cc:276] 0709 13:02:24.941627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.098993 (+1157366us) service_pool.cc:224] Handling call
0709 13:02:26.099416 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.099877 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.099931 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.113517 (+ 13586us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.263861 (+150344us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:26.263924 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.264015 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.543759 (+279744us) raft_consensus.cc:1685] finished
0709 13:02:26.543781 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.543906 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1196,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7599,"thread_start_us":113476,"threads_started":1,"wal-append.queue_time_us":388132}
I20260709 13:02:26.550870  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.551777  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.552377  1677 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.552898  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.553642  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:26.546307  4359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.014s	sys 0.007s
I20260709 13:02:26.554958  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.561766  4292 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:26.562033  4223 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.562256  4292 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:26.565935  4320 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.566449  4320 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.568321  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.569257  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1353) took 3077 ms. Trace:
I20260709 13:02:26.569594  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:26.570744  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:26.571321  4312 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.003s
I20260709 13:02:26.573900  4456 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.574312  4456 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:26.555801  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.577957  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.578967  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 51) took 4675 ms. Trace:
I20260709 13:02:26.579063  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:26.580168  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.581239  3930 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.560343  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.584888  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:26.585215  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.583896  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.586202  1684 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.584954  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.587180  1532 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:26.584240  4337 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:26.588003  4087 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.588327  4337 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.588593  4087 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.588887  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1174) took 1611 ms. Trace:
I20260709 13:02:26.590685  4087 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.589706  1526 rpcz_store.cc:276] 0709 13:02:24.977751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.412859 (+435108us) service_pool.cc:224] Handling call
0709 13:02:25.413163 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.413391 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:25.804170 (+390779us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.946006 (+141836us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.588562 (+642556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.588619 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:26.588662 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.588724 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.588835 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649264,"prepare.queue_time_us":121055,"prepare.run_cpu_time_us":204,"prepare.run_wall_time_us":12253,"raft.queue_time_us":642908,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":505201,"threads_started":2,"wal-append.queue_time_us":262541}
I20260709 13:02:26.556334  4207 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:26.591782  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.563391  4292 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.588356  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:26.592756  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.602794  1532 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:26.569608  1529 rpcz_store.cc:276] 0709 13:02:23.491410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.649551 (+158141us) service_pool.cc:224] Handling call
0709 13:02:23.649989 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.883188 (+233199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.904606 (+ 21418us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.897330 (+992724us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4800002958. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:02:25.515584 (+618254us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b180041b420. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:25.755271 (+239687us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.781769 (+ 26498us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.781942 (+   173us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.782210 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.566794 (+784584us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b180041b420. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:26.568729 (+  1935us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180041b420. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:02:26.568912 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.568993 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.569045 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:26.569059 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.569199 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020572,"prepare.queue_time_us":45195,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":106,"raft.queue_time_us":1062790,"raft.run_cpu_time_us":14606,"raft.run_wall_time_us":1039361,"spinlock_wait_cycles":93218944,"thread_start_us":215308,"threads_started":1,"wal-append.queue_time_us":2183982}
I20260709 13:02:26.594195  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.604089  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.585891  1528 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:26.592777  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.600770  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.604521  1681 raft_consensus.cc:2368] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:26.610498  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.605489  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.604884  1532 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:26.614603  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.616210  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.616968  1681 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:26.618085  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.607964  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.607110  1677 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:26.628337  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.634166  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.634951  1676 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.637574  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.640975  1526 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:02:26.642838  1526 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:26.652684  1526 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:26.679740  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.681663  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.682744  1677 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:26.558187  4313 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:02:26.716840  1676 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:26.579452  1433 rpcz_store.cc:276] 0709 13:02:21.903653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.907603 (+  3950us) service_pool.cc:224] Handling call
0709 13:02:26.578912 (+4671309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:24.031029 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:24.050081 (+ 19052us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:24.050133 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:02:24.050152 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:24.050878 (+   726us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:24.050942 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:24.050968 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:24.051242 (+   274us) tablet.cc:701] Row locks acquired
0709 13:02:24.051256 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:02:24.051453 (+   197us) write_op.cc:270] Start()
0709 13:02:24.051575 (+   122us) write_op.cc:276] Timestamp: P: 1783602144051379 usec, L: 0
0709 13:02:24.051593 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:24.150169 (+ 98576us) log.cc:844] Serialized 1174 byte log entry
0709 13:02:24.886435 (+736266us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b2000073778. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697c27b91 00007f4697c49a19 00007f4697c148c3 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169 00007f4697c1d131 00007f4697c1c42d 000000000038f354
0709 13:02:25.694832 (+808397us) op_driver.cc:464] REPLICATION: finished
0709 13:02:26.079639 (+384807us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4694f6f0ac 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f469baafef0
0709 13:02:26.172341 (+ 92702us) write_op.cc:301] APPLY: starting
0709 13:02:26.172434 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:26.172579 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:26.172609 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:26.173017 (+   408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:26.173234 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:26.173302 (+    68us) write_op.cc:312] APPLY: finished
0709 13:02:26.173516 (+   214us) log.cc:844] Serialized 28 byte log entry
0709 13:02:26.173691 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:26.173782 (+    91us) write_op.cc:454] Released schema lock
0709 13:02:26.173818 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:26.174624 (+   806us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:26.174668 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1006445,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":464489,"apply.run_cpu_time_us":1870,"apply.run_wall_time_us":1872,"num_ops":2,"prepare.queue_time_us":148846,"prepare.run_cpu_time_us":18354,"prepare.run_wall_time_us":527339,"raft.queue_time_us":684049,"raft.run_cpu_time_us":31912,"raft.run_wall_time_us":485979,"replication_time_us":1617334,"spinlock_wait_cycles":498768640,"thread_start_us":1274710,"threads_started":4,"wal-append.queue_time_us":378636}]]}
I20260709 13:02:26.706017  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:26.733316  1529 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.706833  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:26.711383  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.591841  4444 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:26.638846  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:26.734566  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.554152  4342 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.705160  4144 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.624828  4207 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.744535  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:26.744805  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 116558us
W20260709 13:02:26.735018  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.745965  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.737867  1683 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:02:26.738374  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 135261us
I20260709 13:02:26.739656  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.743160  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.543581  4463 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:26.705894  4242 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.002s
I20260709 13:02:26.802130  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.747797  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.705152  4282 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.803575  1499 leader_election.cc:400] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:26.709563  4380 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.802837  1681 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
W20260709 13:02:26.732785  4433 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:02:26.802372  1677 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:26.803468  1683 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:26.601397  4432 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:02:26.709165  4344 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.746914  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:26.809531  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.826066  1526 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.811206  1499 leader_election.cc:403] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:26.818397  1529 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:26.810279  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62592.8us
I20260709 13:02:26.814221  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.839012  1677 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:26.839074  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.839861  1529 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:26.805316  4286 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:26.837119  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.710358  4327 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:26.838171  1681 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:26.852393  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.840291  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:26.822391  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.842315  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.853864  1677 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:26.767549  4207 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.763621  1684 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:26.769479  4326 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.809599  4282 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:26.805063  4444 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:26.644429  4318 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.809203  4242 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.853138  1681 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:26.804360  4144 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.879835  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.858815  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.880935  1529 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:26.811877  4087 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.812366  4380 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:26.865882  4195 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.710644  3920 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:26.867029  1684 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:26.887530  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 248785us
I20260709 13:02:26.888958  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1212) took 1553 ms. Trace:
I20260709 13:02:26.889279  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:26.889452  1684 rpcz_store.cc:276] 0709 13:02:25.335194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.854882 (+1519688us) service_pool.cc:224] Handling call
0709 13:02:26.862880 (+  7998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.888591 (+ 25711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.888867 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.867775  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:26.766969  3908 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:02:26.857057  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 53649.5us
I20260709 13:02:26.892385  1677 raft_consensus.cc:606] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:26.892800  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.892989  1677 raft_consensus.cc:614] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.881392  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.882812  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.856190  4374 raft_consensus.cc:2764] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:26.824532  4433 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.866289  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:26.886423  1676 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
W20260709 13:02:26.877712  4473 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:02:26.908746  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.891750  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1213) took 1516 ms. Trace:
I20260709 13:02:26.842923  4344 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.918021  1684 rpcz_store.cc:276] 0709 13:02:25.375149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.890559 (+1515410us) service_pool.cc:224] Handling call
0709 13:02:26.891043 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.891301 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.891345 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.891400 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:26.891443 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.891513 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.891679 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.919925  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:26.940358  1682 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:26.940673  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:26.881404  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 145983us
I20260709 13:02:26.812250  4456 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:26.936164  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.868114  4277 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:26.887974  4380 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.863201  4327 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.938059  1683 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:26.951217  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1214) took 1575 ms. Trace:
I20260709 13:02:26.951593  1683 rpcz_store.cc:276] 0709 13:02:25.376002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.896253 (+1520251us) service_pool.cc:224] Handling call
0709 13:02:26.937610 (+ 41357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.950886 (+ 13276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.951145 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.895882  3920 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.953490  1684 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:26.955236  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 205364us
I20260709 13:02:26.941210  4087 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.957531  1683 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:26.961064  1684 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:02:26.962239  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1186) took 2071 ms (client timeout 2640 ms). Trace:
W20260709 13:02:26.954917  4472 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 13:02:26.962699  1675 rpcz_store.cc:269] 0709 13:02:24.887910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.890577 (+  2667us) service_pool.cc:224] Handling call
0709 13:02:26.958660 (+2068083us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b54000a0ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:26.958804 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172179840}
I20260709 13:02:26.966398  1675 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:26.957544  4456 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.969180  1683 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:26.969221  1675 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:26.953812  3920 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.971576  4144 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.961545  4087 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:26.972236  4144 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.972328  4087 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.972705  4144 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.973137  4144 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.976136  4008 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.976405  1526 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:02:26.976783  4008 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.978439  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:26.979063  4008 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.970276  1684 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:26.935997  4282 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.980696  4342 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.981180  4282 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.980661  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:26.985318  3908 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.985777  3908 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.986138  3908 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.979851  4331 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:26.988548  4207 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:26.989774  1610 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:26.991384  4207 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:26.994302  1675 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:27.004115  4433 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.004971  4433 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:27.008208  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.009186  1605 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.009549  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1527) took 1025 ms. Trace:
I20260709 13:02:27.009838  1605 rpcz_store.cc:276] 0709 13:02:25.984334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.007930 (+1023596us) service_pool.cc:224] Handling call
0709 13:02:27.009499 (+  1569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.010857  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:27.012485  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.005554  4433 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.012789  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1518) took 1146 ms. Trace:
I20260709 13:02:26.951768  4444 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:27.014689  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.015482  1527 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:27.016434  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.017113  1527 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:27.017562  4433 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.017858  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.018321  4433 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.018848  4433 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:27.019300  4433 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.020781  1526 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:27.021255  4428 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.116s	user 0.005s	sys 0.003s
I20260709 13:02:27.022454  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1535) took 3063 ms. Trace:
I20260709 13:02:27.023334  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 133) took 1977 ms. Trace:
I20260709 13:02:27.013281  1602 rpcz_store.cc:276] 0709 13:02:25.866048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.159242 (+293194us) service_pool.cc:224] Handling call
0709 13:02:27.012587 (+853345us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400087354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:27.012729 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782626560}
I20260709 13:02:27.022797  1679 rpcz_store.cc:276] 0709 13:02:23.958895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.047566 (+ 88671us) service_pool.cc:224] Handling call
0709 13:02:24.048396 (+   830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.880763 (+832367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.880797 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.881354 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.517742 (+636388us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.517798 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.517886 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.020669 (+1502783us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:27.022160 (+  1491us) raft_consensus.cc:1685] finished
0709 13:02:27.022186 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.022399 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":828123,"raft.queue_time_us":834403,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":62146816,"thread_start_us":635831,"threads_started":1,"wal-append.queue_time_us":897442}
I20260709 13:02:27.023751  1606 rpcz_store.cc:276] 0709 13:02:25.046397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.445081 (+398684us) service_pool.cc:224] Handling call
0709 13:02:25.496364 (+ 51283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.756426 (+260062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.756470 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.756523 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.756567 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.023125 (+1266558us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540003c0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:27.023170 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.023281 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597493632}
I20260709 13:02:27.024827  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.025238  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.025801  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1528) took 1041 ms. Trace:
I20260709 13:02:27.026408  1602 rpcz_store.cc:276] 0709 13:02:25.984673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.024488 (+1039815us) service_pool.cc:224] Handling call
0709 13:02:27.025734 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.027585  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.028483  4387 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.030334  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1163) took 2506 ms. Trace:
I20260709 13:02:27.031219  4358 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:27.032318  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1552) took 1992 ms (client timeout 1521 ms). Trace:
I20260709 13:02:27.035499  1602 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.035269  1534 rpcz_store.cc:276] 0709 13:02:24.523978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.406029 (+882051us) service_pool.cc:224] Handling call
0709 13:02:25.406350 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.415649 (+  9299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.415692 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.415748 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:25.415797 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.029942 (+1614145us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b54000a46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:27.029994 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.030248 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20822912}
I20260709 13:02:27.034813  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:27.039194  1603 rpcz_store.cc:269] 0709 13:02:25.039690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.366667 (+326977us) service_pool.cc:224] Handling call
0709 13:02:27.032063 (+1665396us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400085054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:27.032246 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288804608}
I20260709 13:02:27.037236  1606 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.040551  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.041360  1603 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:27.042725  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.043097  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.044219  1603 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.044139  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
W20260709 13:02:27.047456  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53133.1us
I20260709 13:02:27.045481  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:27.048821  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.048851  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.049875  1527 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:27.036368  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.050208  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.050688  1526 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.051133  1602 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
I20260709 13:02:27.051168  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.052050  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1521) took 1123 ms. Trace:
I20260709 13:02:27.052482  1602 rpcz_store.cc:276] 0709 13:02:25.929180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.049888 (+1120708us) service_pool.cc:224] Handling call
0709 13:02:27.051975 (+  2087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.052873  1527 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:02:27.063324   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:27.064611  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:26.992556  4087 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.065356   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:27.054625  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.038905  4358 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:27.080236  4358 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.081389  4358 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.055967  1603 raft_consensus.cc:2368] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:27.049791  1605 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:27.092743  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.087488  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:27.094465  1679 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.086576  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:27.093245  1534 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.096462  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.083535  1527 raft_consensus.cc:2393] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:02:27.110707  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.110956  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.111449  1605 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:27.113051  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1514) took 1332 ms. Trace:
I20260709 13:02:27.113755  1605 rpcz_store.cc:276] 0709 13:02:25.780611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.110430 (+1329819us) service_pool.cc:224] Handling call
0709 13:02:27.112989 (+  2559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.125945  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.126847  1605 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:27.127687  4344 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.094980  4313 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:27.113847  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:27.128587  4313 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:27.130909  4313 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:27.054167  4455 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.132351  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.133117  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1525) took 1149 ms. Trace:
I20260709 13:02:27.133234  4455 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.133460  1606 rpcz_store.cc:276] 0709 13:02:25.983596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.097797 (+1114201us) service_pool.cc:224] Handling call
0709 13:02:27.133058 (+ 35261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.134414  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:27.135103  1606 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.136761  4207 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:27.137099  4419 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.000s
I20260709 13:02:27.137686  4419 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.082574  4483 raft_consensus.cc:2764] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:27.136045  1526 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:27.139637  4483 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.140023  4483 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:27.128742  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:27.140763  1605 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.140441  3908 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.142644  3908 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.143039  4433 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.145327  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.145624  4144 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.146025  1526 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.123098  1679 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:27.123633  4380 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.150648  4327 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:27.092857  4457 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:02:27.140496  4483 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.123833  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.154511  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.119621  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.155423  1534 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.135829  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.161096  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1522) took 1219 ms. Trace:
I20260709 13:02:27.161666  1606 rpcz_store.cc:276] 0709 13:02:25.941561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.135595 (+1194034us) service_pool.cc:224] Handling call
0709 13:02:27.160759 (+ 25164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.163630  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.163820  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.164979  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1209) took 1832 ms. Trace:
I20260709 13:02:27.151557  4457 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:27.169148  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55370.2us
I20260709 13:02:27.147886  4144 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.173777  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1363) took 1432 ms. Trace:
I20260709 13:02:27.174058  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:27.183693  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.192418  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:27.074007  4286 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:27.195216  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.196201  4313 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.174337  1533 rpcz_store.cc:276] 0709 13:02:25.741540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.744471 (+  2931us) service_pool.cc:224] Handling call
0709 13:02:25.802059 (+ 57588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.572193 (+770134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.572221 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.572656 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.841686 (+269030us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:26.877602 (+ 35916us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.173380 (+295778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.173455 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.173512 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:27.173532 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.173701 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":769715,"prepare.queue_time_us":35700,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1774,"raft.queue_time_us":814631,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":18631,"thread_start_us":564054,"threads_started":2,"wal-append.queue_time_us":372731}
I20260709 13:02:27.205750  1534 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:27.206913  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.207615  1534 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.209954  1680 rpcz_store.cc:276] 0709 13:02:25.332163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.253728 (+921565us) service_pool.cc:224] Handling call
0709 13:02:26.254141 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.254345 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:26.709398 (+455053us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.866380 (+156982us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.147089 (+280709us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b1800278aa0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:27.164619 (+ 17530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.164678 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.164721 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.164784 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.164915 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35485,"prepare.queue_time_us":77960,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":6731,"raft.queue_time_us":164113,"spinlock_wait_cycles":19429760,"thread_start_us":858066,"threads_started":3,"wal-append.queue_time_us":220026}
I20260709 13:02:27.168799  4455 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.216542  1534 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:27.224012  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.225762  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1516) took 1413 ms. Trace:
I20260709 13:02:27.226099  1606 rpcz_store.cc:276] 0709 13:02:25.812447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.176355 (+1363908us) service_pool.cc:224] Handling call
0709 13:02:27.225700 (+ 49345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.227777  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.197131  4207 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.203194  4313 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.197746  4008 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.239027  4008 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:27.239552  4008 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.242156  3920 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.196839  4228 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:27.249226  4087 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.249480  4405 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.234741  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.250778  1533 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:27.249533  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.231451  1534 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.238464  4486 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.224850  4419 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:27.253906  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 312252us
I20260709 13:02:27.255520  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.258519  1533 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.259411  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:27.268868  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.284735  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 346735us
I20260709 13:02:27.290971  4488 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.294705  1526 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:27.295647  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:27.207742  1605 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:27.300340  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.292757  4195 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:27.303056  1526 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:27.311370  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.249258  4228 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.250090  4313 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.319702  1534 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:27.335902  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45148.4us
I20260709 13:02:27.337231  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.338052  1501 leader_election.cc:400] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:27.230238  4455 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.342285  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.335971  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:27.344311  1534 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.284799  4207 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:27.304682  4380 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.355381  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.360736  1534 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:27.361481  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.373577  1605 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 3.
I20260709 13:02:27.327168  4228 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:27.406252  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.406956  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.407322  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.407687  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.408069  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.397553  1603 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:27.305737  4405 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:27.291599  4488 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:27.561304  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.020s	sys 0.031s
W20260709 13:02:27.518966  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 176741us
I20260709 13:02:27.392256  3920 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.528630  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.581765  1605 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:27.551354  4419 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.351393  4286 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:27.598778  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.563771  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.031s
I20260709 13:02:27.285298  4486 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.421290  4228 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.558964  4433 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.622889  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.553318  4380 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:02:27.559710  4444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.032s
I20260709 13:02:27.588567  3920 raft_consensus.cc:2764] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:27.578809  4311 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.565724  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.624373  1605 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:27.663640  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:27.648589  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 456256us
I20260709 13:02:27.665858  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:27.658996  4208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.030s	sys 0.022s
I20260709 13:02:27.667379  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:27.640348  4444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.016s	sys 0.032s
I20260709 13:02:27.670063  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.670213  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:27.670802  1605 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:27.659206  4342 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.033s	sys 0.046s
W20260709 13:02:27.675673  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 499619us
W20260709 13:02:27.675957  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 110347us
I20260709 13:02:27.676599  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.574697  4195 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.676985  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.680567  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.661947  4457 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.678260  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1509) took 1948 ms. Trace:
I20260709 13:02:27.681681  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.683087  1605 rpcz_store.cc:276] 0709 13:02:25.729402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.677311 (+1947909us) service_pool.cc:224] Handling call
0709 13:02:27.677620 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.677819 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.677854 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.677907 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.677952 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.678030 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.678192 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.595865  4419 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:27.668069  4208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.031s	sys 0.023s
W20260709 13:02:27.677174  4342 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.033s	sys 0.046s
I20260709 13:02:27.675468  4391 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.689805  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:27.692659  1675 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:27.668934  3920 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.604866  4207 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.678598  4492 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:27.665099  4311 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.687490  4490 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.696285  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:27.659775  4405 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.692579  4457 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:27.677449  4463 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.686885  4358 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.696069  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.679576  4491 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.759649  4486 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.683719  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:27.706575  1675 raft_consensus.cc:2410] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:27.761201  1604 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.761904  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:27.763118  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:27.763613  1675 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.706682  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:27.764297  1677 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:27.765101  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:27.765717  1677 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:27.766357  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:27.766803  1677 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.687274  4497 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.768249  4497 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:27.768684  4497 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.757323  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:27.769939  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:27.770799  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:27.771396  4496 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:27.705996  4490 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:27.773026  4490 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.773984  1680 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:27.775594  1604 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:27.699445  4391 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:27.792798  4495 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:02:27.793866  4311 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.795055  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1186) took 1213 ms. Trace:
I20260709 13:02:27.759282  1605 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:27.704412  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 445044us
I20260709 13:02:27.796334  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.690447  4489 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:27.693879  3920 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.776621  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.704372  4498 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.756958  4358 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.797555  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.795696  1675 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:27.799675  1677 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:27.795686  1535 rpcz_store.cc:276] 0709 13:02:26.581336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.584161 (+  2825us) service_pool.cc:224] Handling call
0709 13:02:26.584443 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.601869 (+ 17426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.601928 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.602451 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.225822 (+623371us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:27.225890 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.226012 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.794831 (+568819us) raft_consensus.cc:1685] finished
0709 13:02:27.794852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.794994 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33357,"raft.queue_time_us":41363,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":66439,"thread_start_us":422225,"threads_started":1,"wal-append.queue_time_us":843386}
I20260709 13:02:27.809448  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.759678  4491 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.699898  4487 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
W20260709 13:02:27.811818  1533 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
I20260709 13:02:27.812258  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:27.815686  1533 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:27.757900  4455 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.818076  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1393) took 1067 ms. Trace:
I20260709 13:02:27.820437  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1397) took 1069 ms. Trace:
I20260709 13:02:27.820883  1533 rpcz_store.cc:276] 0709 13:02:26.750971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.819553 (+1068582us) service_pool.cc:224] Handling call
0709 13:02:27.819881 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.820090 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.820113 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.820154 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.820193 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.820265 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.820379 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:27.819628  1535 rpcz_store.cc:276] 0709 13:02:26.750130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.816988 (+1066858us) service_pool.cc:224] Handling call
0709 13:02:27.817422 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.817643 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.817680 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.817737 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.817786 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.817855 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.818006 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:27.809376  4482 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:02:27.818602  4491 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.814265  4358 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.802294  4486 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.815564  4488 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:27.819324  4433 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:27.824378  4483 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.002s
I20260709 13:02:27.710368  4492 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.816570  4135 raft_consensus.cc:2764] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:27.851138  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.869992  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:27.819610  4380 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.852082  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:27.833698  4486 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:27.825996  4455 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.864311  1533 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:27.877627  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1189) took 1295 ms. Trace:
I20260709 13:02:27.879146  1532 rpcz_store.cc:276] 0709 13:02:26.582184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.612412 (+ 30228us) service_pool.cc:224] Handling call
0709 13:02:26.612811 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.613101 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.613139 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.613688 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.033219 (+419531us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.033259 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.033328 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.877401 (+844073us) raft_consensus.cc:1685] finished
0709 13:02:27.877427 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.877564 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":265060,"threads_started":1,"wal-append.queue_time_us":594087}
I20260709 13:02:27.880779  1647 leader_election.cc:400] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:27.881301  1647 leader_election.cc:403] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:27.813305  4498 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.863090  4433 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:27.831516  4506 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:02:27.867148  4507 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.895370  4514 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:27.871862  4380 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:27.877345  4486 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.905689  3920 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:27.906217  4499 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:02:27.905740  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.912674  1605 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:27.868999  4483 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.881910  4419 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:27.909461  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 232927us
I20260709 13:02:27.902899  4433 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.925876  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.927259  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1172) took 2950 ms. Trace:
I20260709 13:02:27.929710  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.907123  4380 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:27.950981  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 279035us
I20260709 13:02:27.956017  4207 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.956664  4207 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:27.957064  4207 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.959614  4497 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.960300  4419 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.961248  4419 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.961642  4228 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.962299  4497 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:27.963413  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.965538  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:27.907428  4463 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:27.966820  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:27.916293  3920 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.874500  4391 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.974695  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:27.929862  1530 rpcz_store.cc:276] 0709 13:02:24.977229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.411270 (+434041us) service_pool.cc:224] Handling call
0709 13:02:25.411590 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.411812 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:25.420211 (+  8399us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.566588 (+2146377us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18002174e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:27.926730 (+360142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.926810 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:27.926888 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.926983 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.927175 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52941,"prepare.queue_time_us":8202,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4055,"raft.queue_time_us":69710,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6260,"spinlock_wait_cycles":3931904,"thread_start_us":359790,"threads_started":2,"wal-append.queue_time_us":2474853}
I20260709 13:02:27.969350  4457 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:27.992786  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:27.984023  4493 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:02:27.997195  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1513) took 2229 ms (client timeout 1841 ms). Trace:
W20260709 13:02:28.001399  1609 rpcz_store.cc:269] 0709 13:02:25.761696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.802999 (+ 41303us) service_pool.cc:224] Handling call
0709 13:02:27.990627 (+2187628us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540024b8d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:27.990815 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779890432}
I20260709 13:02:28.002812  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:27.974084  4510 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.997849  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:27.998407  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 122791us
I20260709 13:02:28.000335  1675 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:28.041327  1675 pending_rounds.cc:85] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 3
I20260709 13:02:28.041749  1675 pending_rounds.cc:107] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:02:28.041364  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43569.2us
I20260709 13:02:28.042068  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:27.972213  4518 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.992506  4342 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:27.971503  4228 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.042034  1675 raft_consensus.cc:2889] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.996603  4497 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.971948  4455 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:02:28.046205  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 242785us
I20260709 13:02:27.993589  4489 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.116272  4509 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:28.042814  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:28.057607  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90842.2us
I20260709 13:02:28.051786  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.265901  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:28.266777  4489 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.062302  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:28.270114  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 207934us
I20260709 13:02:28.270306  4489 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.271210  4489 raft_consensus.cc:2764] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:28.050011  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 81426.4us
I20260709 13:02:28.272802  4534 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.054328  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:27.983071  3920 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:28.117367  4008 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.876s	user 0.013s	sys 0.000s
I20260709 13:02:28.209172  4291 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:28.135131  4380 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.290784  4365 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.068125  4419 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.292575  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.293491  4419 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.293855  1605 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
W20260709 13:02:28.130007  4439 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 2.277s	user 0.008s	sys 0.008s
I20260709 13:02:28.295028  4419 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:27.975281  4511 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:02:28.134099  4364 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.316457  4511 consensus_queue.cc:1243] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:28.317023  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1547) took 3278 ms. Trace:
I20260709 13:02:28.139439  4412 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.318370  4412 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.320336  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1234) took 1753 ms. Trace:
I20260709 13:02:28.320194  4412 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.320863  1676 rpcz_store.cc:276] 0709 13:02:26.566796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.821432 (+254636us) service_pool.cc:224] Handling call
0709 13:02:28.319857 (+1498425us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54002d4bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.320082 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74914560}
I20260709 13:02:28.067883  4522 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:28.120604  4524 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:28.061175  4463 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.137228  4526 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:28.317590  1601 rpcz_store.cc:276] 0709 13:02:25.038394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.392592 (+354198us) service_pool.cc:224] Handling call
0709 13:02:25.392974 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.868709 (+475735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.316347 (+2447638us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400309dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:28.316804 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072736128}
I20260709 13:02:28.332003  4526 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.050114  4530 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:28.136765  4533 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.118016  4492 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.063513  4497 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.347045  4530 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.036633  4507 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:28.347246  4533 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.349484  4507 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:28.350258  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.350529  4533 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.350739  1681 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:27.996817  4514 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:28.351665  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51860.4us
I20260709 13:02:28.352087  4514 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.355312  4384 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.054823  4523 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.357220  4523 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.357947  4523 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.360126  4412 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.181547   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:28.154613  4486 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.150516  4491 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.391251  4497 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:28.392560  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1575) took 1195 ms (client timeout 1521 ms). Trace:
W20260709 13:02:28.392982  1606 rpcz_store.cc:269] 0709 13:02:27.196912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.226862 (+ 29950us) service_pool.cc:224] Handling call
0709 13:02:28.392206 (+1165344us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400085054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.392418 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881237888}
I20260709 13:02:28.394439  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.395430  1606 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.151038  4490 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.398398  4490 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:28.229728  4313 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.877s	user 0.008s	sys 0.009s
I20260709 13:02:28.243273  4337 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.140966  4358 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:28.265422  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 222583us
I20260709 13:02:28.271826  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:28.279173  4538 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:28.273638  4534 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.265901  4195 raft_consensus.cc:2764] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:28.081125  4457 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.297178  4380 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.451488  4380 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.452163  4380 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.452682  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.453735  1606 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.296977  4008 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.298616  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:28.455734  4242 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:28.456249  4242 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:28.456909  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.457123  4008 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.457690  1602 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:28.457480  4242 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:28.458551  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 160341us
I20260709 13:02:28.300576  3920 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.459985  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1544) took 3422 ms. Trace:
I20260709 13:02:28.461046  4387 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.460492  1608 rpcz_store.cc:276] 0709 13:02:25.037638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.364623 (+326985us) service_pool.cc:224] Handling call
0709 13:02:25.364998 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.600788 (+235790us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:25.601200 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.035416 (+434216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.035487 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:26.035561 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.459462 (+2423901us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400100254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:28.459565 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.459781 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1076,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1477,"raft.queue_time_us":143872,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":541469440,"thread_start_us":403910,"threads_started":2,"wal-append.queue_time_us":461389,"wal-append.run_cpu_time_us":4143,"wal-append.run_wall_time_us":1154416}
I20260709 13:02:28.463577  4433 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.463853  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.465173  1608 raft_consensus.cc:2368] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:28.466219  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.466434  4433 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.467234  1608 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.301019  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1507) took 2572 ms. Trace:
I20260709 13:02:28.284191  4291 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:28.460518  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:28.301779  4391 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.303823  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:28.295341  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:28.306209  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1520) took 2388 ms (client timeout 1989 ms). Trace:
I20260709 13:02:28.309015  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.391264  4491 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.456087  4362 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.291836  4365 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:28.325281  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1199) took 3301 ms (client timeout 1922 ms). Trace:
I20260709 13:02:28.331079  4521 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.333213  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.338774  4526 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.338805  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1206) took 3312 ms. Trace:
W20260709 13:02:28.347842  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.399669  4313 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.448845  4498 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.450152  4234 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.485514  4521 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:28.486043  4521 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.458902  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.487193  1602 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
W20260709 13:02:28.472644  1610 rpcz_store.cc:269] 0709 13:02:25.917451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.570474 (+653023us) service_pool.cc:224] Handling call
0709 13:02:28.305683 (+1735209us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400100c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.305970 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962121600}
I20260709 13:02:28.497118  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.488626  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:28.470328  4391 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.474413  4380 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.498162  4391 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.498674  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:28.474977  4292 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.499490  4391 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.500133  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:28.488065  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1574) took 1319 ms. Trace:
I20260709 13:02:28.500667  4337 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.501055  1603 rpcz_store.cc:276] 0709 13:02:27.168720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.194905 (+ 26185us) service_pool.cc:224] Handling call
0709 13:02:28.487732 (+1292827us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400086e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.487877 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462902144}
I20260709 13:02:28.502431  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.470333  4534 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.295784  4207 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:28.494697  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 223158us
I20260709 13:02:28.467589  1607 rpcz_store.cc:276] 0709 13:02:25.728765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.730575 (+  1810us) service_pool.cc:224] Handling call
0709 13:02:25.730961 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.069085 (+338124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.069149 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.069211 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:26.069262 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.300356 (+2231094us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54001716d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:28.300455 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.300778 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776957696}
I20260709 13:02:28.480556  1682 rpcz_store.cc:276] 0709 13:02:25.026033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.927909 (+901876us) service_pool.cc:224] Handling call
0709 13:02:28.338279 (+2410370us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.338593 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213912960}
I20260709 13:02:28.472457  4358 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.495702  4483 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.497077  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.503144  1603 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.470255  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:28.471328  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 167740us
I20260709 13:02:28.493826  4365 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:28.473780  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.481276  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.472113  1605 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.477336  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.498756  4008 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:28.481281  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.439759  4514 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:28.476205  1678 rpcz_store.cc:269] 0709 13:02:25.024145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.317666 (+293521us) service_pool.cc:224] Handling call
0709 13:02:28.324693 (+3007027us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400039b54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.324947 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868449024}
I20260709 13:02:28.516687  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.501183  4337 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.459003  4242 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.472091  4329 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:28.475474  4530 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.483052  4313 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.475274  4486 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:28.546265  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 76162.3us
I20260709 13:02:28.517393  4008 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.553380  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.529378  4337 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:28.562224  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109395us
I20260709 13:02:28.537277  4329 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:28.548466  4195 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.555605  4008 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:28.568455  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.569463  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.568555  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.580487  1610 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:28.580547  1675 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:28.581930  1610 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.582528  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1526) took 2598 ms. Trace:
I20260709 13:02:28.582811  1610 rpcz_store.cc:276] 0709 13:02:25.983979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.581399 (+2597420us) service_pool.cc:224] Handling call
0709 13:02:28.581740 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.582290 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.582460 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.468647  4291 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.576813  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:28.570973  4329 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.585827  1610 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.583990  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:28.588384  1601 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.576299  4087 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:28.597945  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1510) took 2867 ms. Trace:
I20260709 13:02:28.598148  4514 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.598388  4501 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.778s	user 0.004s	sys 0.001s
I20260709 13:02:28.598909  4514 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:28.599836  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63429.5us
I20260709 13:02:28.601567  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:28.602749  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:28.603260  1605 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:28.603593  2212 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:28.598397  1601 rpcz_store.cc:276] 0709 13:02:25.729632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.553322 (+2823690us) service_pool.cc:224] Handling call
0709 13:02:28.576635 (+ 23313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.596597 (+ 19962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.596772 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.604003  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1556) took 2498 ms. Trace:
I20260709 13:02:28.604141  4514 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:28.606330  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1529) took 2611 ms. Trace:
I20260709 13:02:28.602653  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.626621  1608 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:02:28.630213  1610 rpcz_store.cc:276] 0709 13:02:25.984993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.583525 (+2598532us) service_pool.cc:224] Handling call
0709 13:02:28.583860 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.595838 (+ 11978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.596140 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.584254  4198 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:28.620999  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1238) took 1520 ms. Trace:
W20260709 13:02:28.614089  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.580505  4458 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.604609  4208 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:28.606387  1605 rpcz_store.cc:276] 0709 13:02:26.105672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.600530 (+2494858us) service_pool.cc:224] Handling call
0709 13:02:28.601053 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.603687 (+  2634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.603914 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.621045  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 114) took 3179 ms. Trace:
I20260709 13:02:28.633931  4291 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:28.636611  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 99996.9us
I20260709 13:02:28.638249  1601 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.585273  4195 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:28.643534  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.584153  4320 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.644933  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1557) took 2539 ms. Trace:
I20260709 13:02:28.646183  1601 rpcz_store.cc:276] 0709 13:02:26.105958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.612000 (+2506042us) service_pool.cc:224] Handling call
0709 13:02:28.637997 (+ 25997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.644646 (+  6649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.644868 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.647913  1607 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.641999  1681 rpcz_store.cc:276] 0709 13:02:25.441355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.903022 (+1461667us) service_pool.cc:224] Handling call
0709 13:02:28.349917 (+1446895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.351193 (+  1276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.608479 (+257286us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002d4bd0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.620982 (+ 12503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254556928}
I20260709 13:02:28.622605  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:28.621279  4486 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:28.650557  2210 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:28.626278  4087 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:28.584303  4358 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:02:28.676378  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:28.677947  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:28.678332  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1391) took 1928 ms (client timeout 1783 ms). Trace:
W20260709 13:02:28.678812  1529 rpcz_store.cc:269] 0709 13:02:26.749722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.904952 (+155230us) service_pool.cc:224] Handling call
0709 13:02:28.678046 (+1773094us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400440554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.678206 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3982152064}
I20260709 13:02:28.680243  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.681089  1683 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:28.681243  4008 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.681828  4337 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.655580  4320 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:28.657471  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:28.686333  4320 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.686861  4444 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.659835  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:28.687498  4444 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:28.660557  4087 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.688966  4320 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:28.685823  4523 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.661996  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:28.665086  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.691490  1678 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.691620  4533 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.691888  4523 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.641368  4198 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.652487  4486 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:28.700687  4486 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.704377  4198 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.705103  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1585) took 1005 ms. Trace:
I20260709 13:02:28.705590  1604 rpcz_store.cc:276] 0709 13:02:27.699326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.776384 (+ 77058us) service_pool.cc:224] Handling call
0709 13:02:28.704667 (+928283us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400087354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:28.704855 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947559296}
I20260709 13:02:28.706928  1678 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:28.667537  1680 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:28.667946  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.668478  4207 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.668566  1677 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.668757  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.633037  1684 rpcz_store.cc:276] 0709 13:02:27.088265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.088406 (+   141us) service_pool.cc:224] Handling call
0709 13:02:27.088796 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.089238 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.089278 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.094832 (+  5554us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.597061 (+502229us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.597100 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.597167 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.491791 (+894624us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:28.605271 (+113480us) raft_consensus.cc:1685] finished
0709 13:02:28.605291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.608537 (+  3246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":975866,"raft.queue_time_us":203203,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":970580,"spinlock_wait_cycles":18884864,"thread_start_us":480308,"threads_started":1,"wal-append.queue_time_us":586707}
I20260709 13:02:28.671056  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1524) took 2691 ms. Trace:
I20260709 13:02:28.671211  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.671520  1610 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 9. Ops: []
I20260709 13:02:28.673549  4195 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.675590  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.683004  1602 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:28.683501  4008 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:28.684356  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 100569us
I20260709 13:02:28.666323  4530 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.699460  4337 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.707166  1647 leader_election.cc:400] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:28.665823  4491 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:28.711738  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1558) took 2605 ms. Trace:
W20260709 13:02:28.711901  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 52274.7us
I20260709 13:02:28.710855  1609 rpcz_store.cc:276] 0709 13:02:25.960720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.576164 (+2615444us) service_pool.cc:224] Handling call
0709 13:02:28.608956 (+ 32792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.644470 (+ 35514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.644497 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.648625 (+  4128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:28.652133 (+  3508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.652196 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.652301 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.715171  1610 rpcz_store.cc:276] 0709 13:02:26.106241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.642590 (+2536349us) service_pool.cc:224] Handling call
0709 13:02:28.671344 (+ 28754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.711430 (+ 40086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.711683 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.717733  1603 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:28.719512  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:28.720763  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58891.6us
I20260709 13:02:28.726658  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.727648  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1559) took 2621 ms. Trace:
I20260709 13:02:28.730937  1601 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.731392  1682 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.730796  4514 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.726227  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.733585  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:28.734483  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90523.1us
I20260709 13:02:28.736120  1679 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:28.735857  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.736593  1604 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:28.736912  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.726416  4358 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.735846  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:28.740053  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.744856  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:28.748294  1528 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.742274  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:28.753297  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:28.753654  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:28.752730  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:28.756108  1529 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:28.757408  1609 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:28.762362  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.766233  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1512) took 3036 ms. Trace:
I20260709 13:02:28.766662  1602 rpcz_store.cc:276] 0709 13:02:25.730146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.563319 (+2833173us) service_pool.cc:224] Handling call
0709 13:02:28.595107 (+ 31788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.714406 (+119299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.765957 (+ 51551us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400249854. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:28.766149 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201485184}
I20260709 13:02:28.769749  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1535) took 1768 ms. Trace:
I20260709 13:02:28.770097  1605 rpcz_store.cc:276] 0709 13:02:27.001746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.768866 (+1767120us) service_pool.cc:224] Handling call
0709 13:02:28.769217 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.769428 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.769457 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.769504 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:28.769533 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.769584 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.769679 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.771652  1605 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:28.742801  4358 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.772745  1603 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:28.773020  4358 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.774181  1603 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.742667  4514 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:28.778499  4514 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.779049  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.780694  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:28.781114  1684 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:28.781502  2210 raft_consensus.cc:2410] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:28.783459  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1570) took 1750 ms. Trace:
I20260709 13:02:28.784291  1603 rpcz_store.cc:276] 0709 13:02:27.032953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.773571 (+1740618us) service_pool.cc:224] Handling call
0709 13:02:28.773942 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.774566 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.783356 (+  8790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.787182  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1540) took 1784 ms. Trace:
I20260709 13:02:28.787636  1605 rpcz_store.cc:276] 0709 13:02:27.003125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.770982 (+1767857us) service_pool.cc:224] Handling call
0709 13:02:28.771292 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.771935 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.787126 (+ 15191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.793918  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.794368  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.796375  1528 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:28.800971  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 135) took 2504 ms. Trace:
I20260709 13:02:28.801434  1602 rpcz_store.cc:276] 0709 13:02:26.297053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.767540 (+2470487us) service_pool.cc:224] Handling call
0709 13:02:28.767884 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.800640 (+ 32756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.800671 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.800718 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:28.800745 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.800808 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.800915 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:28.804229  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.794030  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:28.811286  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.813596  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.814491  1678 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:28.812135  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.821584  1601 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.821615  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.822868  1677 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.823880  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:28.820088  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.817830  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:28.827665  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 120717us
I20260709 13:02:28.829479  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1572) took 1754 ms. Trace:
I20260709 13:02:28.830085  1601 rpcz_store.cc:276] 0709 13:02:27.075284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.785074 (+1709790us) service_pool.cc:224] Handling call
0709 13:02:28.821337 (+ 36263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.829175 (+  7838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.829425 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:28.831504  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.836434  1530 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.840755  1676 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:28.840510  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.836593  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:28.845124  1682 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:28.846206  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1387) took 1977 ms. Trace:
I20260709 13:02:28.846931  1526 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:28.851799  1678 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:28.858738  1527 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:28.858832  4555 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:02:28.860541  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 126950us
I20260709 13:02:28.856966  1683 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:28.870553  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:28.728215  1608 rpcz_store.cc:276] 0709 13:02:26.106546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.647651 (+2541105us) service_pool.cc:224] Handling call
0709 13:02:28.682384 (+ 34733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.720795 (+ 38411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.720826 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:28.727314 (+  6488us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:28.727378 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.727464 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.727590 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27251,"raft.queue_time_us":36896,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4671}
I20260709 13:02:28.869043  4554 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:02:28.881156  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:28.846977  4540 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.881911  1680 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:28.888434  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:28.889628  1527 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:28.846653  1534 rpcz_store.cc:276] 0709 13:02:26.748851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.375091 (+626240us) service_pool.cc:224] Handling call
0709 13:02:27.375428 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.519395 (+143967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.519445 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.520077 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.468748 (+948671us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180041bb40. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:28.651053 (+182305us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:28.654543 (+  3490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.662660 (+  8117us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540044d020. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697feedbe 00007f4697ff9930 00007f4697ff98d8 00007f4697ff9858 00007f4697ff9813 00007f4697ff8a9c 00007f469dee4626 00007f469dededd8 00007f46980357cb 00007f46980382c0
0709 13:02:28.712963 (+ 50303us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.716692 (+  3729us) raft_consensus.cc:1685] finished
0709 13:02:28.716711 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.726665 (+  9954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143491,"raft.queue_time_us":172783,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":14545,"spinlock_wait_cycles":35050240,"thread_start_us":102592,"threads_started":1,"wal-append.queue_time_us":1069218}
I20260709 13:02:28.883975  4444 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.903542  4329 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.906301  4329 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.909803  4457 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:28.911816  1531 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:28.912331  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.913005  1681 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.913403  4207 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.913803  4207 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.914506  4358 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:28.915033  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:28.914783  4207 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.916119  4444 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.916501  4444 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.916846  4444 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.920920  4208 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.921697  4208 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.915829  4207 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.926102  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:28.927103  4540 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.927346  4534 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.928544  4534 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.928998  4534 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.919766  4242 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.930063  4534 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.932245  4242 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:28.932741  4242 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.919281  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:28.920178  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49718.7us
I20260709 13:02:28.936070  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:28.934666  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:28.933005  4534 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.927804  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:28.947121  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:28.920722  4337 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.949470  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:28.960754  1683 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.963013  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:28.965342  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:28.957577  1531 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:28.950374  4391 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.920598  4530 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:28.969754  1606 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:28.972532  1606 pending_rounds.cc:85] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 5
I20260709 13:02:28.949371  4329 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.974702  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:28.972703  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:28.979774  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.972895  1606 pending_rounds.cc:107] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:28.988706  1606 raft_consensus.cc:2889] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.946033  4486 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.970862  4208 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:28.970373  4483 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:29.007102  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:28.977824  4195 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.969535  4391 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:28.980509  4365 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.975713  4329 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.007786  2210 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.964736  4337 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:28.981326  1431 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 6 to 8, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.957927  4521 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:29.029364  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1523) took 3053 ms. Trace:
I20260709 13:02:29.029906  1606 rpcz_store.cc:276] 0709 13:02:25.956134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.567150 (+2611016us) service_pool.cc:224] Handling call
0709 13:02:28.594707 (+ 27557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.999552 (+404845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.009297 (+  9745us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540024b3d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:29.009487 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856081280}
W20260709 13:02:29.030474  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.999588  4458 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:29.032881  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.001622  4412 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.980526  4358 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:29.007135  4457 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.040381  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 78225.5us
I20260709 13:02:29.029464  4195 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:29.004715  4540 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.045604  4195 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.051102  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:29.029211  4329 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.052565  1676 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.031713  4291 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:29.031080  4365 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:29.048193  1431 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.002432  4530 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.060578  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 132945us
I20260709 13:02:29.041149  4458 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.040879  4008 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.041290  4380 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.047724  4208 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.069207  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.059100  4291 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:29.062536  4365 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.032677  4483 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.073350  4458 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.076382  1431 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 6 to 7, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.054078  4412 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.053026  4457 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.104178  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.066450  4540 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.117162  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:29.079818  4320 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:29.121747  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70736.6us
I20260709 13:02:29.091147  4291 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:29.132730  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.133646  1531 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.078714  4008 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.123405  1431 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.148967  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.156654  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.112529  4208 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.171600  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:29.187120  1530 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:29.192549  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.193567  1676 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.195652  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.188628  1431 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.114063  4391 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.208829  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 110138us
I20260709 13:02:29.210834  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.215051  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:29.203675  4320 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.231032  1431 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.238752  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:29.234587  4564 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:02:29.243013  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.226497  2212 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:29.246371  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:29.247126  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.247859  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:29.248255  1527 raft_consensus.cc:2368] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:29.251206  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:29.253597  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.254297  1530 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:29.255851  4198 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.000s
I20260709 13:02:29.256930  4331 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.256470  4198 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:29.257362  4331 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:29.257779  4331 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.259397  4198 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:29.260346  1609 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.261161  4087 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.262202  4087 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.262670  4087 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:29.263159  4087 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:29.264331  4563 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:02:29.264535  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.265914  4530 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.267290  4540 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.268697  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.273366  4008 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.265940  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:29.276791  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 130729us
I20260709 13:02:29.281057  4457 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.281895  4457 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.282446  4208 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.282516  4457 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.211093  4523 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:29.294275  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.295120  1684 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:29.292943  1526 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:29.298770  1681 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:29.300719  2210 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:29.300779  1677 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:29.287781  1431 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.304092  1531 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:29.305749  1683 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:29.308552  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.310992  1526 raft_consensus.cc:2368] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:29.313144  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:29.316883  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.317772  1531 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:29.322824  1683 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:29.325366   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:29.318116  1431 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 6 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 8 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:29.349444  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.354535  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:29.363714  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.364605  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.307454  4444 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:29.321786  4483 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:29.376780  1683 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:02:29.360268  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.531s (SENT) [suppressed 25 similar messages]
I20260709 13:02:29.337110  4521 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:29.356968  4523 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.348229  4008 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:29.365217  4320 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.384063  2210 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.389680  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.393788  1431 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 8, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.399760  1531 raft_consensus.cc:2376] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9. Re-sending same reply.
I20260709 13:02:29.401420  1676 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:29.404155  4320 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:29.405480  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 154400us
I20260709 13:02:29.398913  4514 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.409507  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.392527  4523 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.410640  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.388335  4008 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.423293  1676 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:29.424196  1526 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:29.420265  1431 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:29.431516  1610 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.023s	sys 0.019s
W20260709 13:02:29.432284  1610 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.024s	sys 0.019s
W20260709 13:02:29.413220  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 891c34d92ded4b85948a508cf94b612c: Illegal state: Replica f9fb126997be4ec79f8f60fcd6764b00 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.439389  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:29.423923  4242 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.453696  4491 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 13:02:29.455397  4242 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:29.455595  4412 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.461356  4523 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.462911  1531 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:29.464653  1431 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.426479  4291 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:29.466472  1431 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 1 to 5, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 5 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:29.468140  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50528.4us
I20260709 13:02:29.469558  4320 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.470237  4566 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:29.474134  1675 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:29.475539  1675 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.476605  4458 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.478060  4576 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.478876  4458 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.478642  4576 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.480840  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:29.475845  1675 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:29.483140  1675 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.485534  1675 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.487079  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:29.490384  4444 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:29.491442  4568 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:02:29.492942  4570 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:29.493621  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.494397  1680 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.498786  1678 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:29.502529  4486 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:29.504691  1526 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.506973  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:29.504714  1678 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:29.509457  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:29.510422  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.417814  4514 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.517187  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.514055  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:29.510396  1431 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 5 to 7, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.467851  4291 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:29.515443  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 166676us
W20260709 13:02:29.517575  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.525339  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:29.525839  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:29.525823  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 165589us
I20260709 13:02:29.540119  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.540886  1678 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:29.540431  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.509471  4523 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:29.545519  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.516916  4358 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.549582  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 134) took 3252 ms. Trace:
I20260709 13:02:29.553804  1609 rpcz_store.cc:276] 0709 13:02:26.292716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.758076 (+2465360us) service_pool.cc:224] Handling call
0709 13:02:28.758425 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.261016 (+502591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.544629 (+283613us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540003d4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:29.544804 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153594624}
I20260709 13:02:29.522789  4208 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.556106  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:29.553680  1431 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 3 to 4, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:29.527402  4540 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.557641  1431 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 8, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:29.541787  4313 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.570864  1531 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.571381  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:29.511708  4329 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.577598  1675 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:29.578435  1675 pending_rounds.cc:85] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 4
I20260709 13:02:29.578958  1675 pending_rounds.cc:107] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:29.579335  1675 raft_consensus.cc:2889] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.554317  4457 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.558614  4208 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.546453  4207 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:02:29.564503  4533 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.610654  1531 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:29.613294  1526 raft_consensus.cc:1240] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:29.615032  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 89249.1us
I20260709 13:02:29.615186  1527 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:29.615334  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:29.619273  1678 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.626865  1647 leader_election.cc:400] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:29.627400  1647 leader_election.cc:403] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.555857  4391 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:02:29.590150  4313 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:29.656208  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:29.634740  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 110427us
W20260709 13:02:29.658623  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66683.7us
I20260709 13:02:29.648754  4523 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:29.662174  4523 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.656064  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:29.667028  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.656908  1529 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:29.616055  4208 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:29.682181  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 91092.2us
I20260709 13:02:29.563808  4291 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:02:29.686277  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:29.617336  4533 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:29.647480  4576 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.741681  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.647603  4457 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:02:29.742622  1679 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:29.777978  1531 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 5: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:29.686446  4358 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:29.735975  4533 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:29.805948  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46790.4us
I20260709 13:02:29.803367  4463 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:29.803175  4578 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:02:29.758209  4491 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.804163  4358 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.802621  4581 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.246s
W20260709 13:02:29.818506  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 222696us
I20260709 13:02:29.744582  4483 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:29.771098  4337 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:29.833711  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.840325  1678 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:29.751478  4207 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:29.842110  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:29.851437  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.855553  1678 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:29.858232  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1563) took 3683 ms. Trace:
I20260709 13:02:29.807641  4008 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.830705  4463 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:29.859302  1610 rpcz_store.cc:276] 0709 13:02:26.159002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.788791 (+2629789us) service_pool.cc:224] Handling call
0709 13:02:28.828507 (+ 39716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.828778 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:29.438138 (+609360us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.841409 (+403271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.841463 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:29.841502 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.841577 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.841715 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90370,"prepare.queue_time_us":334090,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":85588,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":52861,"thread_start_us":861827,"threads_started":3}
I20260709 13:02:29.851612  4207 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:29.893888  1678 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:29.869428  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:29.903891  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 32221e86161141d39327e18efdbbb226: Illegal state: Replica f9fb126997be4ec79f8f60fcd6764b00 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:29.901554  1678 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:29.851212  4458 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.914441  4597 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:29.916528  4597 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.917889  4207 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.919358  4207 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.920202  4514 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:29.920781  4458 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.923475  4458 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:29.901296  4195 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.843s	user 0.014s	sys 0.000s
I20260709 13:02:29.924156  4587 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:29.924584  4195 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.925541  4573 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:02:29.925812  4534 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.979s	user 0.008s	sys 0.003s
W20260709 13:02:29.914871  4595 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:29.926884  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1405) took 1119 ms. Trace:
I20260709 13:02:29.934732  1528 rpcz_store.cc:276] 0709 13:02:28.807901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.815720 (+  7819us) service_pool.cc:224] Handling call
0709 13:02:28.828007 (+ 12287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.896528 (+ 68521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.896603 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.957827 (+ 61224us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.348714 (+390887us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:29.348778 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.348897 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.926611 (+577714us) raft_consensus.cc:1685] finished
0709 13:02:29.926640 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.926809 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12360,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":351232,"threads_started":1,"wal-append.queue_time_us":566553}
I20260709 13:02:29.924789  4587 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.913090  1678 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:29.841549  4576 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:29.932566  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.899564  4463 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.913466  4540 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:29.910153  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 239712us
W20260709 13:02:29.927814  4087 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.005s
W20260709 13:02:29.944854  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.945510  4329 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:29.946228  4586 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:02:29.967569  4609 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.968215  4609 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:29.939252  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 97235.6us
W20260709 13:02:29.946398  4365 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.003s
I20260709 13:02:29.834080  4313 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:29.991511  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1255) took 1054 ms. Trace:
I20260709 13:02:29.991889  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:29.993088  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.994032  1678 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:29.992529  1680 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:29.999375  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.992874  4365 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.002404  1683 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.971832  4087 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:30.003482  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 268117us
I20260709 13:02:30.004534  1534 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:29.999619  4458 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.004987  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.007067  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.013226  1678 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:30.013628  1680 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:30.015277  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1257) took 1077 ms. Trace:
I20260709 13:02:29.992225  1684 rpcz_store.cc:276] 0709 13:02:28.937602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.296303 (+358701us) service_pool.cc:224] Handling call
0709 13:02:29.316483 (+ 20180us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:29.357546 (+ 41063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.357577 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:29.375000 (+ 17423us) log.cc:844] Serialized 52 byte log entry
0709 13:02:29.523127 (+148127us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:29.556317 (+ 33190us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.556555 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.556632 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.991185 (+434553us) raft_consensus.cc:1685] finished
0709 13:02:29.991219 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.991423 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3541,"prepare.queue_time_us":32738,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2436,"raft.queue_time_us":30497,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":16715,"spinlock_wait_cycles":4162304,"thread_start_us":133349,"threads_started":1,"wal-append.queue_time_us":299789}
W20260709 13:02:30.025776  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 121402us
W20260709 13:02:30.026978  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.027954  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:30.030766  1680 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:30.016180  1677 rpcz_store.cc:276] 0709 13:02:28.938228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.307188 (+368960us) service_pool.cc:224] Handling call
0709 13:02:29.307515 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:29.314622 (+  7107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.314652 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:29.318639 (+  3987us) log.cc:844] Serialized 52 byte log entry
0709 13:02:29.559628 (+240989us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.611366 (+ 51738us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.630582 (+ 19216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.630654 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.965452 (+334798us) raft_consensus.cc:1685] finished
0709 13:02:29.965473 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.003260 (+ 37787us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b18001699c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:30.015202 (+ 11942us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29968,"prepare.queue_time_us":57113,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":19338,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":47003,"spinlock_wait_cycles":114636672,"thread_start_us":210247,"threads_started":2,"wal-append.queue_time_us":625886}
W20260709 13:02:30.005307  4331 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.006s
W20260709 13:02:30.041354  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.040143  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.037575  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.063392  1676 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:30.062266  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.041450  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:30.067830  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:30.063928  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.072890  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68271.2us
I20260709 13:02:30.012295  4458 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.073809  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:29.955816  4576 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:02:30.093284  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.096678  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:30.097815  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 420254us
I20260709 13:02:30.028775  4609 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.041251  4391 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.034497  4587 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.101353  1677 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:30.098397  1678 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:30.095731  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.037014  4581 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.061527  4514 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.034513  4582 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:02:30.078089  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.110245  1676 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:30.109663  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.112076  1677 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:30.040211  4365 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:30.074453  4195 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.114039  4242 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.072237  4208 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.109184  4514 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.094947  4458 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.028451  4483 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:30.092605  4593 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:30.109633  4587 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.040446  4540 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.142179  4587 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.115141  4599 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:30.144568  4599 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.144969  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:30.145761  1676 raft_consensus.cc:606] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.146368  1676 raft_consensus.cc:614] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:30.067499  4331 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.132831  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:30.137038  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.114486  4581 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.146610  4533 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.152580  1676 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:30.176735  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1258) took 1238 ms. Trace:
I20260709 13:02:30.177206  1681 rpcz_store.cc:276] 0709 13:02:28.938518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.307894 (+369376us) service_pool.cc:224] Handling call
0709 13:02:29.308298 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.312146 (+  3848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.312212 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.315700 (+  3488us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.528011 (+212311us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:29.528065 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.528134 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.176510 (+648376us) raft_consensus.cc:1685] finished
0709 13:02:30.176530 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.176675 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608000,"thread_start_us":170326,"threads_started":1,"wal-append.queue_time_us":569849}
I20260709 13:02:30.185508  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.186961  4380 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:30.160683  4242 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:30.149991  4593 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:30.159322  4533 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:30.197237  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.189694  4208 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.192376  4587 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.180262  4195 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:02:30.365423  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:02:30.365341  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66026.8us
W20260709 13:02:30.241969  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.366544  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 181627us
I20260709 13:02:30.392192  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.280273  4606 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.385119  4242 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:30.396360  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 210915us
I20260709 13:02:30.398021  1676 raft_consensus.cc:606] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.200135  4486 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.398500  1676 raft_consensus.cc:614] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:30.358668  4611 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:30.358297  4613 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:30.402904  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.403489  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:30.405799  1678 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.410480  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.414350  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.273207  4533 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:02:30.418843  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.357322  4463 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:30.409067  4380 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:30.433892  4207 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:02:30.420987  4486 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:30.436079  4572 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:02:30.437331  4615 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:02:30.439803  4463 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:30.443446  4486 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.355154  4593 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:30.470498  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79467.4us
W20260709 13:02:30.471325  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67838.4us
I20260709 13:02:30.419961  4610 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:30.429697  4514 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.448838  4365 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.475325  2210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41274 (request call id 113) took 1121 ms. Trace:
I20260709 13:02:30.479720  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:30.475090  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:30.481392  2212 raft_consensus.cc:2368] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
W20260709 13:02:30.482694  4626 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:30.478156  4610 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.486116  4610 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:30.487897  4620 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:02:30.480794  2210 rpcz_store.cc:276] 0709 13:02:29.352594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.353281 (+   687us) service_pool.cc:224] Handling call
0709 13:02:29.353671 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.387252 (+ 33581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.473907 (+1086655us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54004c0754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:30.474184 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69336448}
W20260709 13:02:30.495322  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.478363  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.408855  4611 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:30.476876  4621 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.119s	user 0.004s	sys 0.000s
I20260709 13:02:30.507278  1574 leader_election.cc:400] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:30.508987  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.521240  1574 leader_election.cc:403] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.478683  4574 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.473906  4380 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:30.517160  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.520686  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.513568  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.412768  4613 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.524333  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.526623  4611 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:30.527585  4623 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:30.551384  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:30.552068  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.528543  4331 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.530879  4605 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.531854  1678 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:30.532740  1679 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:30.533749  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.554579  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:02:30.537906  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.554539  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:30.537400  4463 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:30.537569  4610 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:30.549938  4627 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:30.549309  4207 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.550861  4419 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.550760  4554 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.539536  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.507146  4534 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.558014  4195 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:30.550794  4380 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.560206  1675 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:30.560308  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1274) took 1046 ms. Trace:
I20260709 13:02:30.558490  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:30.561648  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 142935us
I20260709 13:02:30.509924  4514 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:30.563490  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 85206.9us
I20260709 13:02:30.559012  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:30.558454  4606 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.567992  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:30.568518  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:30.569198  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:30.569096  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.565392  1679 rpcz_store.cc:276] 0709 13:02:29.513957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.777757 (+263800us) service_pool.cc:224] Handling call
0709 13:02:30.532372 (+754615us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b5400140428. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469d01debc 00007f469d05308c 00007f469d03d93b 00007f469d03d3d2 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c
0709 13:02:30.532519 (+   147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.559911 (+ 27392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.560232 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6758272}
W20260709 13:02:30.565701  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 137328us
I20260709 13:02:30.570734  4008 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:30.573436  4457 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:30.573637  4291 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.574294  4291 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.574756  4291 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.575915  4198 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:30.579255  1676 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:30.578935  4195 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.564225  4208 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:30.563144  4419 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.587890  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:30.584656  1678 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.597034  4195 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.570926  4605 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.597570  4491 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:30.551365  4574 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.566851  4514 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:30.582122  4207 consensus_queue.cc:1243] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer e3ab72f324d545a6b4ecb1025df1f7c0 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:30.602519  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.605204  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:30.560861  4458 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.583207  4457 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.583276  4008 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.585644  4601 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:30.597600  4320 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.612820  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.567895  4534 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.595342  4419 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.581005  4611 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:30.599596  4606 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:30.624166  4594 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.606467  4514 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.605906  1678 raft_consensus.cc:606] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:30.601323  4208 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:30.618502  4008 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.620440  1681 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.621718  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:30.618218  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:30.640882  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.641865  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.613391  4207 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:30.668533  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.688058  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 119015us
I20260709 13:02:30.689061  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.623203  4313 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.622773  4311 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:30.624650  4594 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.624675  4606 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:30.616474  4554 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:02:30.618707  4601 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.616817  4457 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.645452  4605 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:30.707814  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 97749.9us
I20260709 13:02:30.623575  4444 consensus_queue.cc:1059] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:02:30.685890  4207 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.690515  4195 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:30.698201  4313 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.718778  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1609) took 1738 ms. Trace:
I20260709 13:02:30.725577  1683 rpcz_store.cc:276] 0709 13:02:28.980088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.380178 (+400090us) service_pool.cc:224] Handling call
0709 13:02:29.390413 (+ 10235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.002837 (+612424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.718206 (+715369us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54002d50d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:30.718596 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406946560}
I20260709 13:02:30.719965  4576 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.704473  4594 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.705118  4584 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:30.714900  4207 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.754364  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:30.729452  4313 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:30.770507  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 158103us
I20260709 13:02:30.744099  4576 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.734989  4584 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:30.808667  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 119706us
I20260709 13:02:30.810760  4444 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:30.751343  4577 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.815062  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.755155  4613 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.729671  4195 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:30.822834  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 204636us
W20260709 13:02:30.827919  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 139446us
I20260709 13:02:30.792239  4380 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.793535  4597 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:30.838644  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.812743  4311 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:30.812328  4576 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.730929  4636 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 13:02:30.882107  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56741.8us
I20260709 13:02:30.818827  4577 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:30.888163  4576 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.769673  4208 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:30.894582  4608 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:30.895233  4635 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:02:30.896816  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1431) took 1395 ms. Trace:
I20260709 13:02:30.918808  1534 rpcz_store.cc:276] 0709 13:02:29.501072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.504149 (+  3077us) service_pool.cc:224] Handling call
0709 13:02:29.504508 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.011947 (+507439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.896563 (+884616us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540020ab54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:30.896754 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149527040}
W20260709 13:02:30.896862  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 166493us
I20260709 13:02:30.849777  4380 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:30.920644  4380 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.920776  4652 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.921149  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:30.922086  4634 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:02:30.921936  4652 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:30.922700  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:30.847688  4597 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:30.880290  4311 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.917846  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:30.892355  4574 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:30.932324  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1433) took 1312 ms (client timeout 1707 ms). Trace:
I20260709 13:02:30.813931  4444 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:30.902400  4577 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:30.944792  1530 rpcz_store.cc:269] 0709 13:02:29.620308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.620439 (+   131us) service_pool.cc:224] Handling call
0709 13:02:30.917697 (+1297258us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54eee 0000000000375939 00007f469cfc81e0 00007f469d0910c4 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:02:30.932245 (+ 14548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942464}
I20260709 13:02:30.886113  4633 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:30.915350  4458 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.914248  4608 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:30.966387  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 151376us
I20260709 13:02:30.944211  4311 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.942708  4087 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:30.969465  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 85753.8us
I20260709 13:02:30.968581  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:31.002571  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.914692  4412 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:02:30.963984  4534 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:30.948582  4584 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.155793  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.165786  1601 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.007984  1609 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.022869  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.156947  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1617) took 1190 ms. Trace:
I20260709 13:02:31.008562  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:31.139817  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 171335us
I20260709 13:02:30.974532  4008 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.155699  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.172531  1607 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.167296  1684 rpcz_store.cc:276] 0709 13:02:29.966647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.032865 (+ 66218us) service_pool.cc:224] Handling call
0709 13:02:30.066694 (+ 33829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:30.092451 (+ 25757us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:30.120603 (+ 28152us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.696318 (+575715us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800345f40. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:30.879822 (+183504us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:30.899113 (+ 19291us) log.cc:844] Serialized 52 byte log entry
0709 13:02:30.899569 (+   456us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:30.899613 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.899691 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.138883 (+239192us) raft_consensus.cc:1685] finished
0709 13:02:31.156672 (+ 17789us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.156873 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9103,"prepare.queue_time_us":22674,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":70771,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":5483,"spinlock_wait_cycles":9087744,"thread_start_us":181902,"threads_started":1,"wal-append.queue_time_us":865604}
I20260709 13:02:31.167827  1606 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:31.170599  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 247996us
W20260709 13:02:31.137166  4642 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:02:31.159054  4320 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.001s
W20260709 13:02:31.057391  4640 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:02:31.043967  4641 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.022294  4087 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.039721  4599 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.059377  4601 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.059551  4648 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.023797  4659 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.241709  4507 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.254247  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51539.8us
I20260709 13:02:31.174841  4663 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:31.257665  4331 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.259676  4637 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.260473  4646 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:02:31.260238  4331 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.260843  4637 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.262647  4593 raft_consensus.cc:3055] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:31.263062  4593 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:31.260514  4507 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.264086  4593 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:31.265287  4593 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:31.269124  4631 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.770s	user 0.005s	sys 0.000s
I20260709 13:02:31.127264  4597 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:31.056403  4608 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:31.278379  4608 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.249397  4320 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.279690  4457 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.254974  4195 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:31.313242  4643 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.416s	user 0.000s	sys 0.002s
I20260709 13:02:31.314376  4603 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:31.254050  4554 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.334422  4603 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:31.312186  4087 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:31.280360  4639 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:02:31.308513  4642 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:31.334615  4554 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:31.338199  4603 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.280603  4663 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:31.308818  4584 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.358872  4663 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:31.364092  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48679.3us
W20260709 13:02:31.369374  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 201402us
W20260709 13:02:31.377293  4419 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.005s
W20260709 13:02:31.379415  4291 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.804s	user 0.016s	sys 0.003s
I20260709 13:02:31.380302  4419 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.384065  4419 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.380822  4291 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.381832  4596 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:31.385668  4596 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:31.386209  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.387337  4291 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.386855  4596 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:31.388078  4596 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.389600  4444 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:31.391456  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.397053  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.397792  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.390846  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.407212  4331 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.412685  4358 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:31.413408  4358 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:31.413967  4380 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.414695  4358 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:31.412741  4594 consensus_meta.cc:287] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.004s
I20260709 13:02:31.419513  4419 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.431097  4419 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.433597  4577 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:31.446074  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.436157  4380 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:31.451143  4554 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:31.428186  4365 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.456321  4365 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:31.456702  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.456897  4365 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.459331  4629 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:31.459937  4629 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.434842  4419 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:31.465360  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 92709.5us
I20260709 13:02:31.466827  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.468218  4671 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:31.468405  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 77803.9us
I20260709 13:02:31.469988  4637 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:31.470014  1648 leader_election.cc:400] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:31.470651  1648 leader_election.cc:403] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.472095  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.473150  4380 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 6. Current term is 7.
I20260709 13:02:31.474089  4380 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.474584  4380 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:31.475098  4380 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.476477  4581 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.479534  4603 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:31.481062  4207 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.004s
I20260709 13:02:31.481527  4207 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.483369  4507 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:31.485277  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.485970  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.486900  1608 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.488363  1603 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:31.428520  4594 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.489490  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.490046  1603 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:31.490307  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.490756  4594 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:31.481093  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.491568  4207 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.493106  4597 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:31.493981  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1419) took 2241 ms (client timeout 2427 ms). Trace:
I20260709 13:02:31.494742  4637 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:31.497709  1602 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:02:31.497835  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.498873  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.491616  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.481482  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.501879  1675 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:31.502864  1607 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:31.501783  4311 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.506485  1608 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:31.441905  4606 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.508637  1527 rpcz_store.cc:269] 0709 13:02:29.252353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.268319 (+ 15966us) service_pool.cc:224] Handling call
0709 13:02:31.493767 (+2225448us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540032f5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:31.493896 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783530752}
I20260709 13:02:31.513651  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.515149  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.517112  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.518621  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.521368  1610 raft_consensus.cc:2368] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:31.521000  1603 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:31.542176  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.543720  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.543898  1601 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:31.544361  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:31.525446  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:31.572523  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.556399  1679 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:31.575855  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50499.4us
I20260709 13:02:31.572602  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:31.578430  1677 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:31.612885  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95890.3us
I20260709 13:02:31.613229  1527 raft_consensus.cc:1240] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:31.613695  1648 leader_election.cc:400] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:31.613968  1648 leader_election.cc:403] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.586411  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.515368  4207 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:31.585721  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.630374  1607 raft_consensus.cc:2410] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:31.617497  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.609510  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:31.543287  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.619966  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:31.620080  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:31.585734  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67216.6us
I20260709 13:02:31.620791  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:31.517526  4608 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.639649  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.542070  4671 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:31.555735  4483 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.585206  4291 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.580933  4530 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.658318  1610 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:31.661581  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48017.2us
I20260709 13:02:31.662827  1648 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:31.663245  1648 leader_election.cc:403] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:02:31.637650  4610 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.059s	user 0.002s	sys 0.017s
I20260709 13:02:31.641191  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:31.612402  4659 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.521849  4242 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:02:31.517894  4637 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.619263  4584 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:31.648880  4611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.023s
I20260709 13:02:31.674716  1602 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:31.671537  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.686628  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.638921  4577 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:31.576313  4606 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.667158  4198 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.687831  1683 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:31.690313  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.697886  1677 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:02:31.657152  4483 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.657049  4291 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.705770  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.668764  4087 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.725673  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:31.680430  4581 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.664363  4195 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:31.730342  1677 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.657058  4207 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:31.703029  4611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.010s	sys 0.024s
I20260709 13:02:31.668869  4668 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:02:31.729352  4636 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:31.678864  4660 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9.
I20260709 13:02:31.729578  4291 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.688649  4320 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.674734  4610 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
W20260709 13:02:31.709652  4533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.007s	sys 0.015s
I20260709 13:02:31.730865  1602 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:02:31.737849  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.646744  4608 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.741847  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.689458  4659 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:31.744228  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.741707  1647 leader_election.cc:400] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:31.787283  1647 leader_election.cc:403] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.668171  4208 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:31.759101  4663 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.706835  4651 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.752493  1677 raft_consensus.cc:2410] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:31.716563  4584 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:31.729475  4483 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.729760  4648 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:31.681879  4530 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.770185  1605 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 5.
W20260709 13:02:31.809989  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68555.1us
W20260709 13:02:31.770983  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65307.7us
W20260709 13:02:31.771829  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 206326us
I20260709 13:02:31.778468  4650 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.812068  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:31.727995  4534 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:31.674743  4671 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.680588  4633 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:31.792925  1608 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:02:31.747323  4198 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:31.772012  4636 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:31.788337  4533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.007s	sys 0.015s
I20260709 13:02:31.775789  4574 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.782761  4576 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.863s	user 0.006s	sys 0.012s
I20260709 13:02:31.743220  4581 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.746326  4087 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:31.778646  1606 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.003s
I20260709 13:02:31.854346  1606 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:31.792240  4320 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:31.828922  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.809635  4651 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:31.815019  4650 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.816340  4311 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.825145  4652 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.825488  4611 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:31.837944  4610 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:31.870445  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.871757  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 127592us
W20260709 13:02:31.875753  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.875813  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.843058  4679 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.881318  1683 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:31.846493  4574 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.894505  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.864823  4650 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:31.900606  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.904167  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:31.857615  4633 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:02:31.873888  4611 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.905958  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:31.909756  1678 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:31.824906  4648 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:31.911386  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.877941  4610 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:31.853951  4576 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.930255  2178 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:31.931170  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.919226  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 96089.1us
I20260709 13:02:31.921442  4611 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:31.932695  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:31.943265  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.944412  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
W20260709 13:02:31.935212  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.938143  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:31.941987  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.945976  1678 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:02:31.949354  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.949556  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:02:31.895185  4584 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.954514  4320 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.921145  4637 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:31.930543  4507 raft_consensus.cc:2764] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:31.903389  4533 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:31.962781  1606 raft_consensus.cc:606] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:31.973439  1606 raft_consensus.cc:614] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:31.966322  4514 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.272s	user 0.017s	sys 0.003s
I20260709 13:02:31.967212  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:31.913798  4596 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:31.940192  4554 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.969457  4576 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.996342  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:31.979624  4596 consensus_queue.cc:1243] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:32.016584  4648 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:32.019470  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:32.020375  1602 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:32.020871  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:32.022135  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:32.022264  1607 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.019511  1605 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:32.020356  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:31.971825  4242 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:31.977325  1683 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:31.985075  4207 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:31.985999  4530 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.986683  4087 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:31.987192  4313 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.170s	user 0.012s	sys 0.008s
I20260709 13:02:31.929598  4198 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:31.991595  4365 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:02:32.073150  4365 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.996213  4606 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:31.997112  4534 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.972525  4651 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.001387  4514 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.002444  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:32.003248  4603 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:02:31.974789  4380 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.924710  4636 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.003871  4291 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:31.892743  4659 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.033454  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:32.048085  1604 pending_rounds.cc:85] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 7
I20260709 13:02:32.020299  4629 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.056939  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:32.061539  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 128693us
I20260709 13:02:32.056388  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:32.093791  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:32.310424  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.097923  1606 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:32.209287  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.311461  1605 raft_consensus.cc:2368] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:32.278115  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.313571  1528 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:32.036401  4576 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.312220  1604 pending_rounds.cc:107] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:02:32.227227  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:32.219039  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.319833  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:32.309917  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 377315us
I20260709 13:02:32.312180  2210 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 4.
I20260709 13:02:32.175961  4311 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.310515  1683 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:32.495132  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.337133  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:32.754699  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:32.351473  1678 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:02:32.420588  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.755436  1607 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:32.755782  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.753670  1604 raft_consensus.cc:2889] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.338315  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:32.312685  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.751479  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.507174  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1303) took 1007 ms. Trace:
I20260709 13:02:32.755559  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1320) took 1141 ms. Trace:
I20260709 13:02:32.759109  1678 rpcz_store.cc:276] 0709 13:02:31.613729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.925299 (+311570us) service_pool.cc:224] Handling call
0709 13:02:32.755503 (+830204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:32.751112  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 437332us
I20260709 13:02:32.751718  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.754390  1608 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.333323  1533 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:32.757066  1605 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:32.411860  1528 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:32.062166  4242 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:32.758395  1684 rpcz_store.cc:276] 0709 13:02:31.499949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.500093 (+   144us) service_pool.cc:224] Handling call
0709 13:02:31.515791 (+ 15698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.516385 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.516413 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.516823 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.042310 (+525487us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:32.042352 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.042419 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.506846 (+464427us) raft_consensus.cc:1685] finished
0709 13:02:32.506876 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.507087 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31258,"raft.queue_time_us":5348,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13854,"thread_start_us":429980,"threads_started":1,"wal-append.queue_time_us":865022}
I20260709 13:02:32.768822  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:32.054667  4530 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.756553  4554 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 13:02:32.169795  4087 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.175560  4667 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.215423  4597 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.002s
I20260709 13:02:32.778399  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.764977  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:32.552330  4652 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
W20260709 13:02:32.687578  4611 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.007s
I20260709 13:02:32.772087  1534 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:32.775897  4629 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.771299  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.767434  4633 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.224790  4671 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.465842  4608 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.782893  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.812672  1531 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:32.437667  4291 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:32.785354  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.075817  4313 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.770841  4694 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:32.788867  1530 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:32.779062  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:32.771626  4679 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.865s	user 0.012s	sys 0.000s
I20260709 13:02:32.804087  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.757050  4514 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.764103  4365 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.809829  1683 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:32.770649  4693 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.805516  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.210708  4483 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.826756  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:32.818526  1608 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
W20260709 13:02:32.818703  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.820834  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:32.823323  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:32.831468  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.650s (SENT)
I20260709 13:02:32.823936  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:32.763360  4576 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:32.832423  1684 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:32.826033  4650 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.908s	user 0.013s	sys 0.000s
I20260709 13:02:32.778149  4380 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.824863  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.815603  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.826632  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.779083  4311 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.827757  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:32.828580  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.782470  4554 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.773389  4577 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:02:32.840116  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.817257  4652 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:32.831807  2210 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:32.834707  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.841358  1527 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:32.842134  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.778424  4530 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.824688  4671 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.835955  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:32.835465  1531 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.825529  4679 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.789441  4087 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.840116  1529 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:32.831977  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:32.843150  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.816689  4633 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.804109  4611 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.825701  4651 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:32.847610  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:32.804572  4667 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.852856  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.855700  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.854766  1527 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:32.804068  4242 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.822259  4694 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:32.858112  1574 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.774s (SENT)
I20260709 13:02:32.844623  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.859308  1677 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:32.863094  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:32.864156  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.846881  4671 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.864815  1535 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:32.865850  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1635) took 1330 ms. Trace:
I20260709 13:02:32.868019  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:32.868249  1677 rpcz_store.cc:276] 0709 13:02:31.535692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.858884 (+1323192us) service_pool.cc:224] Handling call
0709 13:02:32.859149 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.865639 (+  6490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.865804 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.869710  1677 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:32.870280  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1637) took 1334 ms. Trace:
I20260709 13:02:32.870580  1677 rpcz_store.cc:276] 0709 13:02:31.536306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.869287 (+1332981us) service_pool.cc:224] Handling call
0709 13:02:32.869545 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.870072 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.870232 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.871678  1677 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:32.873034  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.873143  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.872232  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1638) took 1335 ms. Trace:
I20260709 13:02:32.874557  1677 rpcz_store.cc:276] 0709 13:02:31.536702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.871283 (+1334581us) service_pool.cc:224] Handling call
0709 13:02:32.871529 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.871988 (+   459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.872185 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.874991  1683 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:32.884895  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1636) took 1349 ms. Trace:
I20260709 13:02:32.886461  1683 rpcz_store.cc:276] 0709 13:02:31.535987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.858421 (+1322434us) service_pool.cc:224] Handling call
0709 13:02:32.867775 (+  9354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.884627 (+ 16852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.884838 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.875765  1529 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:32.835894  4693 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.890236  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.876267  4198 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.887979  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.891587  1535 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:32.877427  1679 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:02:32.880069  4514 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.881412  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 137) took 1368 ms. Trace:
I20260709 13:02:32.892782  1601 rpcz_store.cc:276] 0709 13:02:31.512697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.641780 (+129083us) service_pool.cc:224] Handling call
0709 13:02:31.642162 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.773572 (+131410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.773618 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:31.773678 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:31.773724 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.881176 (+1107452us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540003c0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:32.881221 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.881352 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301565824}
I20260709 13:02:32.881459  2210 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:32.886910  1534 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:32.839571  4650 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.895561  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1316) took 1283 ms. Trace:
I20260709 13:02:32.896015  1679 rpcz_store.cc:276] 0709 13:02:31.611912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.876880 (+1264968us) service_pool.cc:224] Handling call
0709 13:02:32.877202 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.895283 (+ 18081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.895507 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.873046  4671 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.874902  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:32.887915  1574 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.797s (SENT)
I20260709 13:02:32.876305  1677 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:32.862876  4700 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.877364  4633 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.894224  1680 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:32.890902  1529 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:32.900427  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1641) took 1362 ms. Trace:
I20260709 13:02:32.916287  1677 rpcz_store.cc:276] 0709 13:02:31.537654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.875617 (+1337963us) service_pool.cc:224] Handling call
0709 13:02:32.876059 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.900147 (+ 24088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.900371 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.900090  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:32.901052  1684 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:32.902304  1531 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:32.903069  4530 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.903488  4483 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.904268  4087 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.904547  4694 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:32.857298  4651 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:32.906934  4661 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:32.896983  4313 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.909332  4611 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.898187  4514 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.955189  4661 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:32.956169  4661 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.956949  4514 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.919764  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1640) took 1382 ms. Trace:
I20260709 13:02:32.957746  1684 rpcz_store.cc:276] 0709 13:02:31.537396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.874368 (+1336972us) service_pool.cc:224] Handling call
0709 13:02:32.898831 (+ 24463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.919271 (+ 20440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.919681 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.958889  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:32.925560  1677 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:32.960433  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1321) took 1346 ms. Trace:
I20260709 13:02:32.960784  1677 rpcz_store.cc:276] 0709 13:02:31.613952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.917193 (+1303241us) service_pool.cc:224] Handling call
0709 13:02:32.917575 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.960201 (+ 42626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.960381 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.962056  1677 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:32.962888  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1323) took 1285 ms. Trace:
I20260709 13:02:32.963337  1677 rpcz_store.cc:276] 0709 13:02:31.677326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.961528 (+1284202us) service_pool.cc:224] Handling call
0709 13:02:32.961862 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.962658 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.962836 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.927194  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.943897  4540 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:02:32.964300  1534 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.927637  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.964331  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.968417  1535 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:32.968819  1528 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:32.969419  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.969669  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.970647  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.970868  4650 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.928658  4700 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:32.929476  4698 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:32.957233  4661 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.973887  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:32.974710  1684 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.932699  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.970665  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.976343  1529 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:32.976850  1528 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:32.977296  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.977674  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.977960  4629 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.978386  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.978834  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.934572  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:32.980002  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:32.988788  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:32.989753  1535 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:32.990702  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.910346  4690 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.956s	user 0.003s	sys 0.009s
I20260709 13:02:32.901897  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1317) took 1288 ms. Trace:
I20260709 13:02:32.992439  1683 rpcz_store.cc:276] 0709 13:02:31.613038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.889112 (+1276074us) service_pool.cc:224] Handling call
0709 13:02:32.901458 (+ 12346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.901669 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.901693 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.901733 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:32.901752 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.901787 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.901857 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:32.945467  4692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.011s	sys 0.011s
I20260709 13:02:32.947800  4311 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:32.948328  4671 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:32.929550  4576 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:32.949362  4689 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.964s	user 0.002s	sys 0.003s
W20260709 13:02:33.022689  1648 connection.cc:256] RPC call timeout handler was delayed by -1.7113221800000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 13:02:32.951839  4693 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.023489  4693 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.952920  4677 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.141s	user 0.005s	sys 0.010s
I20260709 13:02:32.952850  4667 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:33.023558  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:32.954773  4651 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:32.957222  2175 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:33.024024  4693 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.024914  4554 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:33.024979  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67831.8us
I20260709 13:02:33.025187  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:33.025430  4554 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.025827  4554 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.986266  1677 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:33.026326  4693 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.027020  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1324) took 1317 ms. Trace:
I20260709 13:02:33.027447  1677 rpcz_store.cc:276] 0709 13:02:31.710044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.985717 (+1275673us) service_pool.cc:224] Handling call
0709 13:02:32.986064 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.026720 (+ 40656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.026955 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.028672  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:32.986299  1534 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:32.987481  1531 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:02:32.981691  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 93796.5us
I20260709 13:02:33.023653  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1581) took 1520 ms. Trace:
I20260709 13:02:33.003736  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.032303  1535 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:33.031375  1603 rpcz_store.cc:276] 0709 13:02:31.503237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.627070 (+123833us) service_pool.cc:224] Handling call
0709 13:02:31.649438 (+ 22368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.679325 (+ 29887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.679374 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.690467 (+ 11093us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.867661 (+177194us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:31.867717 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.867820 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.948721 (+1080901us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:33.023339 (+ 74618us) raft_consensus.cc:1685] finished
0709 13:02:33.023359 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.023589 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":846,"raft.queue_time_us":21659,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5582,"spinlock_wait_cycles":88059264,"thread_start_us":124740,"threads_started":1,"wal-append.queue_time_us":215837}
I20260709 13:02:33.005015  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:33.003515  4692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.011s	sys 0.011s
I20260709 13:02:33.022871  4694 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:33.019621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.035279  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.041339  1528 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:33.007676  4660 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.042466  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.052650  1531 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:33.044480  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:33.045111  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.054703  1535 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:32.951574  4610 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.017035  4650 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.051168  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.061672  1526 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.047381  4554 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:33.058388  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.036537  4679 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:33.060521  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 240338us
I20260709 13:02:33.062305  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.069142  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:33.036324  4483 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:33.039839  4576 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:33.067411  2210 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:33.071178  1683 raft_consensus.cc:2410] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:33.078495  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.071768  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.079082  1531 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.080444  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:33.088972  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 108491us
I20260709 13:02:33.093997  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:33.077325  4610 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.095625  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.061523  4650 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.110535  4650 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:33.112609  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58591.1us
I20260709 13:02:33.108333  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:33.113474  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:33.114398  2212 raft_consensus.cc:2410] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:02:33.123049  1531 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:33.083935  4483 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:33.059939  4660 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.057291  4694 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.135787  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.142062  1535 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:33.258611  1684 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:33.113867  4702 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:33.270548  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.493328  4702 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:33.482060  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.494127  4702 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:33.481318  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.495666  4530 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:33.227661  1526 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
W20260709 13:02:33.352849  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37256 (request call id 109) took 1779 ms (client timeout 1608 ms). Trace:
I20260709 13:02:33.235450  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1318) took 1622 ms. Trace:
W20260709 13:02:33.511351  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.271821  1608 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:33.257969  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.359288  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.512439  1531 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:33.512745  1678 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:33.168074  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.514063  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:33.514691  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.514765  1530 rpcz_store.cc:269] 0709 13:02:31.573105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.586498 (+ 13393us) service_pool.cc:224] Handling call
0709 13:02:33.352596 (+1766098us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000dd754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:33.352747 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649226624}
I20260709 13:02:33.249464  1529 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:33.269899  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:33.485339  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 371912us
W20260709 13:02:33.328984  4680 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.455s	user 0.009s	sys 0.005s
W20260709 13:02:33.330776  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.522245  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.523186  1526 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:33.523753  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.524147  1603 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:33.524991  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.525144  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.484879  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:33.374908  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1325) took 1632 ms. Trace:
I20260709 13:02:33.380656  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.517849  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:33.270993  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.490931  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.526502  1683 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.527895  1527 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:33.269260  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.528635  1606 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.485009  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.529480  1607 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:33.530637  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.531502  1607 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:33.292302  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:33.491632  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.533473  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.526512  1680 rpcz_store.cc:276] 0709 13:02:31.742403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.963383 (+220980us) service_pool.cc:224] Handling call
0709 13:02:33.374648 (+1411265us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54002ea4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:33.374797 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951822720}
W20260709 13:02:33.420053  4584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.463s	user 0.005s	sys 0.026s
I20260709 13:02:33.544992  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:33.330400  4674 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.581s	user 0.005s	sys 0.003s
I20260709 13:02:33.551729  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:33.134461  4629 raft_consensus.cc:2764] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:02:33.419235  1498 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57268 dropped due to backpressure: service queue is full with 50 items
I20260709 13:02:33.395825  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1326) took 1623 ms. Trace:
W20260709 13:02:33.253836  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.381965  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1645) took 1329 ms. Trace:
I20260709 13:02:33.564496  1676 rpcz_store.cc:276] 0709 13:02:32.052374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.319562 (+267188us) service_pool.cc:224] Handling call
0709 13:02:33.381766 (+1062204us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003cc3d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:33.381908 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618351488}
I20260709 13:02:33.566000  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.566570  1676 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:33.567391  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.526365  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.510737  1679 rpcz_store.cc:276] 0709 13:02:31.613274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.897237 (+1283963us) service_pool.cc:224] Handling call
0709 13:02:32.897732 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.897959 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:33.018567 (+120608us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.234931 (+216364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.235010 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.235091 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.235188 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.235359 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165760,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":112,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":291658,"threads_started":2,"wal-append.queue_time_us":467233}
I20260709 13:02:33.568302  1603 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:33.490906  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.568792  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.537386  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.137369  4483 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:33.301010  4687 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.346s	user 0.008s	sys 0.006s
I20260709 13:02:33.540002  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:33.259507  4608 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:33.541661  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:33.512068  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.545675  1526 raft_consensus.cc:2376] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11. Re-sending same reply.
I20260709 13:02:33.147512  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:33.377485  4682 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.417s	user 0.003s	sys 0.003s
W20260709 13:02:33.341737  4678 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.553s	user 0.020s	sys 0.007s
W20260709 13:02:33.307379  4683 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.358s	user 0.005s	sys 0.008s
I20260709 13:02:33.549947  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.283099  4486 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:33.358572  1433 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.553473  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.563306  4692 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:33.496666  4661 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:33.551708  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.656513  1527 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:33.228731  4694 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.560959  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.561097  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.659821  1530 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:33.488585  4641 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:33.564134  1677 rpcz_store.cc:276] 0709 13:02:31.772022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.029914 (+1257892us) service_pool.cc:224] Handling call
0709 13:02:33.030251 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.180325 (+150074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.180373 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.180434 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.180495 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.395433 (+214938us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400035054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:33.395507 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.395731 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344475904}
W20260709 13:02:33.268535  4681 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.351s	user 0.004s	sys 0.013s
I20260709 13:02:33.571019  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.571853  1676 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:33.497797  4358 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.540756  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:33.274899  4574 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:33.574056  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.667248  1528 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:33.544528  4584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.587s	user 0.005s	sys 0.029s
I20260709 13:02:33.487895  4660 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.579588  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.579944  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:33.348272  4707 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:33.669622  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.581049  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:33.670321  1601 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:33.550843  4609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.695s	user 0.004s	sys 0.039s
I20260709 13:02:33.582603  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.673275  1605 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.583513  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.674610  1532 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:33.184669  4554 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.525790  4365 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:33.587934  1602 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:33.418442  4581 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:33.589742  1606 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:33.622244  4629 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.552829  4633 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:33.622244  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.661827  4641 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:33.536738  4311 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.546234  4659 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.642243  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1574) took 2155 ms. Trace:
W20260709 13:02:33.700753  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 175) took 11464 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.659335  4606 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:02:33.644951  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:33.573231  4704 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:33.715452  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70584.5us
I20260709 13:02:33.660676  4692 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.559329  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:33.722815  1683 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:33.723587  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1329) took 1774 ms. Trace:
I20260709 13:02:33.652197  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:33.653976  4576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.029s	sys 0.044s
I20260709 13:02:33.648699  4486 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:33.580777  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.670384  1678 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:33.670516  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 89568.5us
I20260709 13:02:33.728852  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.729188  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:33.593582  4608 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:33.649644  1433 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index -1 to 5, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added, pending config changed, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:33.655877  4661 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:33.662143  4613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.945s	user 0.019s	sys 0.056s
I20260709 13:02:33.683605  4365 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:33.690692  4610 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.004s
I20260709 13:02:33.563989  1498 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57268 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1286)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1289)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 5)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1222)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1223)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1230)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1231)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1239)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1460)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1271)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1290)
I20260709 13:02:33.691617  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:33.688390  1574 leader_election.cc:336] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.064s (SENT)
I20260709 13:02:33.683187  4707 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.692929  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1612) took 1359 ms. Trace:
I20260709 13:02:33.776754  1606 rpcz_store.cc:276] 0709 13:02:32.333318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.268789 (+935471us) service_pool.cc:224] Handling call
0709 13:02:33.692851 (+424062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.778095  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.778771  1606 raft_consensus.cc:2368] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:33.779547  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.779755  1647 leader_election.cc:400] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10.
I20260709 13:02:33.780136  1606 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:33.781121  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.781297  4679 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:33.781903  4679 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:33.782249  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:33.650213  4491 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:33.782961  4491 consensus_queue.cc:1243] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:33.782801  4679 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.783490  4491 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:33.672912  4609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.840s	user 0.004s	sys 0.039s
I20260709 13:02:33.656351  4605 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:33.789907  4605 consensus_queue.cc:1243] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:33.653625  4668 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:02:33.545783  4651 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:33.757850  4530 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.792371  4530 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.792232  4651 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.793342  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.793550  4692 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.793962  1529 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.794595  4651 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.707314  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:33.707434  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12.
I20260709 13:02:33.672430  4694 raft_consensus.cc:2764] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:02:33.709722  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1302) took 2210 ms. Trace:
I20260709 13:02:33.712184  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:33.796769  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.797492  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1232) took 1081 ms. Trace:
I20260709 13:02:33.713057  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.798036  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.798214  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.799070  1601 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:33.651270  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:33.728374  4576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.030s	sys 0.044s
I20260709 13:02:33.799378  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.696549  4633 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:33.694774  4629 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:33.755458  1535 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 4: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:33.770711  1680 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:02:33.770833  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82497us
I20260709 13:02:33.641352  4331 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:33.760948  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:33.795790  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.799906  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:33.724426  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72296.7us
I20260709 13:02:33.773651  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.800235  1606 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:33.796801  1682 rpcz_store.cc:276] 0709 13:02:31.499569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.499684 (+   115us) service_pool.cc:224] Handling call
0709 13:02:31.504347 (+  4663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.504762 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.504791 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.505279 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.808581 (+303302us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:31.809345 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.809454 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.376656 (+1567202us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:33.697456 (+320800us) raft_consensus.cc:1685] finished
0709 13:02:33.697480 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.709647 (+ 12167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29407,"raft.queue_time_us":2438,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7573,"spinlock_wait_cycles":175058816,"thread_start_us":302899,"threads_started":1,"wal-append.queue_time_us":406899}
I20260709 13:02:33.759438  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 4 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.714576  4704 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.782377  1678 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:33.819407  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1330) took 1843 ms. Trace:
I20260709 13:02:33.726099  4574 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:33.783818  4491 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:33.786757  1603 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:33.696671  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1310) took 2164 ms. Trace:
W20260709 13:02:33.788623  4713 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:02:33.792780  4530 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:33.765333  4613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.062s	user 0.020s	sys 0.056s
I20260709 13:02:33.798302  1527 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.700646  1609 rpcz_store.cc:276] 0709 13:02:31.486737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.488147 (+  1410us) service_pool.cc:224] Handling call
0709 13:02:31.488453 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.488848 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.488881 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.489344 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.737933 (+248589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:31.737990 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.738066 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.328109 (+1590043us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:33.623613 (+295504us) raft_consensus.cc:1685] finished
0709 13:02:33.623634 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.642168 (+ 18534us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2560,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":263253888,"thread_start_us":248190,"threads_started":1,"wal-append.queue_time_us":329622}
I20260709 13:02:33.726800  4611 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:02:33.770067  1602 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:33.797894  1528 rpcz_store.cc:276] 0709 13:02:32.715844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.711755 (+995911us) service_pool.cc:224] Handling call
0709 13:02:33.797432 (+ 85677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.711565  4659 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:33.708384  4311 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:33.723990  1683 rpcz_store.cc:276] 0709 13:02:31.949030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.721957 (+1772927us) service_pool.cc:224] Handling call
0709 13:02:33.722334 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.723290 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.723521 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.820008  1678 rpcz_store.cc:276] 0709 13:02:31.975682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.781830 (+1806148us) service_pool.cc:224] Handling call
0709 13:02:33.782186 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.819101 (+ 36915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.819339 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.287827  4650 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.176s	user 0.012s	sys 0.000s
I20260709 13:02:33.792240  4668 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:34.295495  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 143) took 2255 ms. Trace:
I20260709 13:02:34.295584  4668 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:34.233685  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.277263  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.077s
W20260709 13:02:34.297379  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.012s	sys 0.078s
I20260709 13:02:34.295987  1604 rpcz_store.cc:276] 0709 13:02:32.039816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.040250 (+   434us) service_pool.cc:224] Handling call
0709 13:02:32.040882 (+   632us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:33.056740 (+1015858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.056832 (+    92us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:33.060787 (+  3955us) log.cc:844] Serialized 52 byte log entry
0709 13:02:33.259313 (+198526us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:33.259366 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.259470 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.295274 (+1035804us) raft_consensus.cc:1685] finished
0709 13:02:34.295292 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.295439 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13449,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":463696,"threads_started":2,"wal-append.queue_time_us":583000}
W20260709 13:02:34.289222  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.298808  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:33.946640  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.300371  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.296653  4668 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.301710  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.301872  4668 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.302034  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.302855  1604 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:34.303496  1602 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:33.808125  4716 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.539s
I20260709 13:02:34.304834  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.857134  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.233273  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:33.701164  1431 rpcz_store.cc:269] 0709 13:02:22.230789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.231033 (+   244us) service_pool.cc:224] Handling call
0709 13:02:33.695014 (+11463981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.444295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.445057 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.445114 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:02:30.445156 (+    42us) tablet.cc:662] Decoding operations
0709 13:02:30.447036 (+  1880us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.447127 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.447164 (+    37us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:02:30.488495 (+ 41331us) tablet.cc:701] Row locks acquired
0709 13:02:30.488552 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:02:30.488718 (+   166us) write_op.cc:270] Start()
0709 13:02:30.488880 (+   162us) write_op.cc:276] Timestamp: P: 1783602150488655 usec, L: 0
0709 13:02:30.488901 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.532742 (+ 43841us) log.cc:844] Serialized 6357 byte log entry
0709 13:02:31.431136 (+898394us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.749872 (+318736us) write_op.cc:301] APPLY: starting
0709 13:02:31.778588 (+ 28716us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.873123 (+ 94535us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.902659 (+ 29536us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.967107 (+ 64448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.967477 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:02:31.967523 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:31.968009 (+   486us) log.cc:844] Serialized 112 byte log entry
0709 13:02:32.058428 (+ 90419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:32.177131 (+118703us) write_op.cc:454] Released schema lock
0709 13:02:32.177326 (+   195us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:32.177937 (+   611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:32.177978 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":233891,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":249557,"apply.run_cpu_time_us":7431,"apply.run_wall_time_us":439486,"num_ops":16,"prepare.queue_time_us":240972,"prepare.run_cpu_time_us":28157,"prepare.run_wall_time_us":162899,"raft.queue_time_us":368137,"raft.run_cpu_time_us":14083,"raft.run_wall_time_us":124878,"replication_time_us":942036,"thread_start_us":603327,"threads_started":4,"wal-append.queue_time_us":158716,"wal-append.run_cpu_time_us":64294,"wal-append.run_wall_time_us":2321946}]]}
I20260709 13:02:34.306066  1532 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:33.992547  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 233536us
I20260709 13:02:34.307107  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1229) took 1592 ms. Trace:
I20260709 13:02:33.804471  4365 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.308831  1684 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:34.309139  4365 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.294816  1675 rpcz_store.cc:276] 0709 13:02:31.527756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.527916 (+   160us) service_pool.cc:224] Handling call
0709 13:02:31.528392 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.575244 (+ 46852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.575282 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.587659 (+ 12377us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.809115 (+221456us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:31.809159 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.809271 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.300239 (+1490968us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:33.679777 (+379538us) raft_consensus.cc:1685] finished
0709 13:02:33.679799 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.691596 (+ 11797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104586,"raft.queue_time_us":52443,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":27883,"spinlock_wait_cycles":96313088,"thread_start_us":140680,"threads_started":1,"wal-append.queue_time_us":268174}
I20260709 13:02:34.311046  4659 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:34.006917  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 126) took 1909 ms. Trace:
I20260709 13:02:34.072649  4661 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:34.312798  1682 rpcz_store.cc:276] 0709 13:02:32.097259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.812298 (+1715039us) service_pool.cc:224] Handling call
0709 13:02:34.006149 (+193851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.006423 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.006464 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.006534 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.006579 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.006669 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.006830 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.314003  4661 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.315096  1682 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.054616  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.993244  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:34.316598  4704 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.791810  4707 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:33.958432  4641 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.348330  1605 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.392381  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.317278  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1327) took 2482 ms. Trace:
I20260709 13:02:33.862458  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.318742  4491 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:34.342176  4719 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.808s	user 0.004s	sys 0.000s
I20260709 13:02:33.820317  4629 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.857398  4198 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.463s
W20260709 13:02:34.055315  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 233610us
I20260709 13:02:33.819999  4633 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.173988  4554 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.307668  1532 rpcz_store.cc:276] 0709 13:02:32.714666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.117309 (+1402643us) service_pool.cc:224] Handling call
0709 13:02:34.307046 (+189737us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.302415  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.414633  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.306064  1606 raft_consensus.cc:2368] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11.
I20260709 13:02:34.306223  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.799860  4576 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.311919  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.421159  1526 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:34.296873  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1287) took 1111 ms. Trace:
I20260709 13:02:34.321687  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.421737  1530 rpcz_store.cc:276] 0709 13:02:33.185930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.117420 (+931490us) service_pool.cc:224] Handling call
0709 13:02:34.296817 (+179397us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.422629  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 101020us
I20260709 13:02:34.423135  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.325325  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1328) took 2428 ms. Trace:
I20260709 13:02:34.423978  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
W20260709 13:02:34.326252  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.327409  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:33.993556  4605 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:34.332242  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.331210  1683 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.430739  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1651) took 1985 ms. Trace:
I20260709 13:02:34.431020  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1286) took 1307 ms. Trace:
I20260709 13:02:34.431282  1683 rpcz_store.cc:276] 0709 13:02:32.445892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.315861 (+1869969us) service_pool.cc:224] Handling call
0709 13:02:34.330980 (+ 15119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.430370 (+ 99390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.430666 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.334863  1529 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.000s
I20260709 13:02:34.336849  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1624) took 1009 ms. Trace:
W20260709 13:02:34.330037  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 569156us
I20260709 13:02:34.433143  1529 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:34.433184  1602 rpcz_store.cc:276] 0709 13:02:33.294944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.302851 (+1007907us) service_pool.cc:224] Handling call
0709 13:02:34.303182 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.304002 (+   820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.304222 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.433940  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.294950  4650 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:34.341634  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.342609  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:34.438282  1609 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:34.344856  1535 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.439122  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:34.346736  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1650) took 1935 ms. Trace:
I20260709 13:02:34.390787  4574 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.394532  1677 rpcz_store.cc:276] 0709 13:02:31.835334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.662204 (+1826870us) service_pool.cc:224] Handling call
0709 13:02:33.662546 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.662763 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:33.817755 (+154992us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.316581 (+498826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.316659 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:34.316721 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.316808 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.317177 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":323542,"prepare.queue_time_us":679120,"raft.queue_time_us":329810,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":316301,"threads_started":2,"wal-append.queue_time_us":474268}
W20260709 13:02:34.397945  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 74699.3us
I20260709 13:02:34.409197  1527 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:02:34.407570  1574 leader_election.cc:336] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.720s (SENT)
I20260709 13:02:34.427601  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.434218  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1274) took 1313 ms. Trace:
I20260709 13:02:34.434741  1602 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.438922  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1634) took 1027 ms. Trace:
I20260709 13:02:34.441601  1683 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.452631  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:34.453586  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1334) took 1495 ms. Trace:
I20260709 13:02:34.453703  1530 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:34.435454  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:34.451949  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.425524  1676 rpcz_store.cc:276] 0709 13:02:31.896537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.668157 (+1771620us) service_pool.cc:224] Handling call
0709 13:02:33.668457 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.677011 (+  8554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.677057 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.689583 (+ 12526us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.113701 (+424118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.113764 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.113857 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.325015 (+211158us) raft_consensus.cc:1685] finished
0709 13:02:34.325033 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.325244 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3373,"raft.queue_time_us":101,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14884,"thread_start_us":387291,"threads_started":1,"wal-append.queue_time_us":597134}
I20260709 13:02:34.452402  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1227) took 1763 ms. Trace:
I20260709 13:02:34.431435  1526 rpcz_store.cc:276] 0709 13:02:33.123998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.117869 (+993871us) service_pool.cc:224] Handling call
0709 13:02:34.430961 (+313092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.455286  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:33.811555  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:34.455394  1527 rpcz_store.cc:276] 0709 13:02:32.688746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.712822 (+1024076us) service_pool.cc:224] Handling call
0709 13:02:34.452335 (+739513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.440903  1607 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:34.457803  1605 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:34.440735  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.457973  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.454092  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.458362  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1632) took 1047 ms. Trace:
I20260709 13:02:34.458469  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:34.439661  1682 rpcz_store.cc:276] 0709 13:02:32.411880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.314408 (+1902528us) service_pool.cc:224] Handling call
0709 13:02:34.314846 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.346422 (+ 31576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.346654 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.456163  1530 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:34.346727  4727 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:34.459472  4727 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.459506  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.439997  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:34.459853  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.456573  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 114113us
I20260709 13:02:34.460664  4660 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.460968  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:34.454006  1683 rpcz_store.cc:276] 0709 13:02:32.958559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.441159 (+1482600us) service_pool.cc:224] Handling call
0709 13:02:34.441440 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.453329 (+ 11889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.453529 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.458086  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50588.5us
I20260709 13:02:34.461879  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:34.462395  1683 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.452514  1609 rpcz_store.cc:276] 0709 13:02:33.411173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.408663 (+997490us) service_pool.cc:224] Handling call
0709 13:02:34.432968 (+ 24305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.438687 (+  5719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.438855 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.462649  1574 leader_election.cc:336] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 3.146s (SENT)
I20260709 13:02:34.462551  1604 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:34.457469  4609 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:34.465109  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.451849  1529 rpcz_store.cc:276] 0709 13:02:33.120665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.766241 (+645576us) service_pool.cc:224] Handling call
0709 13:02:34.434004 (+667763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.459950  4727 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.467401  1532 raft_consensus.cc:2368] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10.
I20260709 13:02:34.471266  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.475605  4636 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:34.476148  4636 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:34.476512  4636 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:34.478554  4483 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.001s
I20260709 13:02:34.479020  4483 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:34.480108  4365 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.480770  4365 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:34.481194  4365 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.481444  1610 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:34.437501  4707 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.484441  4581 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:34.484889  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.485020  4581 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.485785  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1288) took 1299 ms. Trace:
I20260709 13:02:34.486171  1526 rpcz_store.cc:276] 0709 13:02:33.186388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.466958 (+1280570us) service_pool.cc:224] Handling call
0709 13:02:34.485723 (+ 18765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.487227  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.487345  4581 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.466745  4610 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.483755  1610 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.497959  1610 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.488015  1526 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:34.499387  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1260) took 1568 ms. Trace:
I20260709 13:02:34.428821  4605 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:34.490857  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1646) took 2163 ms. Trace:
I20260709 13:02:34.441542  4659 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.513727  1675 rpcz_store.cc:276] 0709 13:02:32.327322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.310540 (+1983218us) service_pool.cc:224] Handling call
0709 13:02:34.310859 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.311100 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:34.311126 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.311623 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.436142 (+124519us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:34.436184 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.436280 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.490571 (+ 54291us) raft_consensus.cc:1685] finished
0709 13:02:34.490601 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.490782 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124029,"threads_started":1,"wal-append.queue_time_us":165220}
W20260709 13:02:34.515219  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52598.9us
W20260709 13:02:34.516434  1574 leader_election.cc:336] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.815s (SENT)
I20260709 13:02:34.458850  1605 rpcz_store.cc:276] 0709 13:02:33.410532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.393553 (+983021us) service_pool.cc:224] Handling call
0709 13:02:34.457488 (+ 63935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.458162 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.458318 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.488916  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.517359  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.823s (SENT) [suppressed 41 similar messages]
I20260709 13:02:34.453398  4311 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.439333  4491 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.501281  1535 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:34.439558  4554 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:34.435422  4728 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:02:34.508883  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.526665  1526 raft_consensus.cc:2376] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11. Re-sending same reply.
I20260709 13:02:34.510143  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.527845  1529 raft_consensus.cc:2376] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9. Re-sending same reply.
I20260709 13:02:34.528355  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1289) took 1341 ms. Trace:
I20260709 13:02:34.528651  1529 rpcz_store.cc:276] 0709 13:02:33.186754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.470489 (+1283735us) service_pool.cc:224] Handling call
0709 13:02:34.528299 (+ 57810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.463079  4641 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.515518  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:34.461449  4726 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.517571  1530 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:34.499859  1532 rpcz_store.cc:276] 0709 13:02:32.930844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.459240 (+1528396us) service_pool.cc:224] Handling call
0709 13:02:34.499323 (+ 40083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.518477  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.495345  1679 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:34.522758  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.518085  1574 leader_election.cc:336] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.836s (SENT)
I20260709 13:02:34.467923  4722 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.529817  1610 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:34.490085  4611 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:34.531268  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.489640  4613 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:34.537117  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.541384  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.537184  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.537866  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.441279  4606 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:02:34.543179  4606 consensus_queue.cc:1243] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:34.542100  1529 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:34.544139  4311 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:34.544490  4311 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:34.544874  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:34.545647  1529 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:34.545405  4311 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.546800  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.547006  4311 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.547950  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.580475  1530 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:34.584374  1677 pending_rounds.cc:85] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 3
I20260709 13:02:34.584870  1677 pending_rounds.cc:107] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:34.585558  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1272) took 1465 ms. Trace:
W20260709 13:02:34.585690  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67629.1us
W20260709 13:02:34.586405  1574 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.853s (SENT)
I20260709 13:02:34.586054  1534 rpcz_store.cc:276] 0709 13:02:33.119960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.516323 (+1396363us) service_pool.cc:224] Handling call
0709 13:02:34.585506 (+ 69183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968}
W20260709 13:02:34.587633  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.588358  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.590473  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.598559  1532 raft_consensus.cc:2410] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:02:34.589390  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 118046us
I20260709 13:02:34.590267  4576 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.589709  4574 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.588786  4584 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.589910  4610 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.625227  4584 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:34.585695  1677 raft_consensus.cc:2889] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.585788  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.627063  1678 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.627427  1526 raft_consensus.cc:2376] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12. Re-sending same reply.
W20260709 13:02:34.622395  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 157311us
I20260709 13:02:34.623193  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1585) took 1057 ms. Trace:
I20260709 13:02:34.629628  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.630396  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:34.630750  1526 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:34.585286  4611 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.626585  4679 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:34.628726  1529 raft_consensus.cc:2410] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:34.630105  1606 rpcz_store.cc:276] 0709 13:02:33.565776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.432660 (+866884us) service_pool.cc:224] Handling call
0709 13:02:34.437646 (+  4986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.551982 (+114336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.552012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.553326 (+  1314us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.622720 (+ 69394us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.622760 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.622832 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.622874 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:34.622885 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.622993 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3749,"raft.queue_time_us":4554,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":163348,"threads_started":2,"wal-append.queue_time_us":65450}
I20260709 13:02:34.644398  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:34.646437  1528 raft_consensus.cc:2368] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 12.
W20260709 13:02:34.647372  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.532317  4659 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:34.654071  1574 leader_election.cc:336] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.543s (SENT)
W20260709 13:02:34.657536  1574 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.924s (SENT)
W20260709 13:02:34.658334  1574 leader_election.cc:336] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.978s (SENT)
I20260709 13:02:34.658691  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.628726  4584 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.668323  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1304) took 3168 ms. Trace:
I20260709 13:02:34.670768  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:34.671473  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.668681  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:34.682173  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.692412  1532 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:34.670862  1681 rpcz_store.cc:276] 0709 13:02:31.500230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.500381 (+   151us) service_pool.cc:224] Handling call
0709 13:02:31.504021 (+  3640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.506053 (+  2032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.506091 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.506629 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.797886 (+291257us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:31.797940 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.798155 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.263418 (+1465263us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:34.665528 (+1402110us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b24002553c8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcafb0 00007f4697c41488 00007f4697c41be8 00007f4697c19398 00007f4697c1476a 00007f4697c13bb6
0709 13:02:34.668124 (+  2596us) raft_consensus.cc:1685] finished
0709 13:02:34.668147 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.668267 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11648,"raft.queue_time_us":5438,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":11093,"spinlock_wait_cycles":137101824,"thread_start_us":290826,"threads_started":1,"wal-append.queue_time_us":396604}
W20260709 13:02:34.693164  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.659916  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.623152  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 159300us
I20260709 13:02:34.694984  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:34.630079  4722 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:34.697008  1574 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.767s (SENT)
I20260709 13:02:34.661199  4738 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:34.704841  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.698174  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.663311  4198 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.662750  4679 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:34.691006  4671 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.705706  1606 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:34.580353  4726 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.662778  4613 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:34.709077  1498 connection.cc:256] RPC call timeout handler was delayed by -1.4333878989999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:02:34.703663  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.710222  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.714681  1498 connection.cc:256] RPC call timeout handler was delayed by -1.4315878989999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:02:34.715047  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3865878990000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:02:34.715512  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3523878990000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:02:34.715803  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3190878989999533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:02:34.716106  1498 connection.cc:256] RPC call timeout handler was delayed by -1.291187898999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:02:34.716157  1574 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.777s (SENT)
W20260709 13:02:34.716511  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2839878989999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:02:34.716629  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:34.716835  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2641878989999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:02:34.714973  1532 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
W20260709 13:02:34.717133  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2524878989999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:02:34.717439  1498 connection.cc:256] RPC call timeout handler was delayed by -1.234487898999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:02:34.717852  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:34.718237  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2227878989999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:02:34.718624  1498 connection.cc:256] RPC call timeout handler was delayed by -1.191287898999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:02:34.718884  1498 connection.cc:256] RPC call timeout handler was delayed by -1.167887898999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
I20260709 13:02:34.665325  4313 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:34.720494  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:34.719233  1498 connection.cc:256] RPC call timeout handler was delayed by -1.1642878989999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 13:02:34.713476  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:34.704551  4728 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:34.721405  1498 connection.cc:256] RPC call timeout handler was delayed by -1.1624878989999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 13:02:34.722332  1527 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:02:34.704049  4734 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.724139  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0751878989999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:02:34.724532  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0265878989999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:02:34.724817  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0229878989999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:02:34.722854  4741 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.726087  4747 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.726135  4741 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.726751  4747 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.704777  4661 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:34.728396  4661 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.729427  1526 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:34.730043  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.730508  4661 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.731159  4659 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.731272  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.731691  4659 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.732187  4659 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.732678  4554 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.652267  4605 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.733575  4605 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.734138  4659 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.734807  4636 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.733618  1530 raft_consensus.cc:606] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.735949  1530 raft_consensus.cc:614] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:34.734608  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.711179  4311 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.737408  4311 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.738659  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:34.738785  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:34.739497  4311 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.728962  4741 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.741235  4734 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:34.706840  4365 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.721993  4198 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.729032  4747 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.725482  4610 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.745196  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:34.746371  1606 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 6: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:34.746266  4728 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.747704  1677 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:34.748106  4728 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.743659  4679 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.749200  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:34.749817  1677 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:34.707137  4738 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:34.749351  4749 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:34.725121  1574 leader_election.cc:336] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.800s (SENT)
I20260709 13:02:34.766288  4738 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.768859  4613 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.770282  4608 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:34.772218  4609 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:34.772642  4609 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.774019  4584 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.776876  1681 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.777614  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.773494  4609 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.778793  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:34.779212  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.725091  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0103878989999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:02:34.779884  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.782058  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.751756  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.766978  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:34.785036  1606 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:34.785652  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:34.787503  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1332) took 1829 ms. Trace:
I20260709 13:02:34.793519  1606 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:34.768088  4736 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:02:34.793357  1681 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:34.799520  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.805903  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.814759  1678 rpcz_store.cc:276] 0709 13:02:32.958020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.330044 (+1372024us) service_pool.cc:224] Handling call
0709 13:02:34.350622 (+ 20578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.627516 (+276894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.787190 (+159674us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540037fad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:34.787418 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635264768}
I20260709 13:02:34.794675  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1296) took 1015 ms. Trace:
I20260709 13:02:34.831785  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 124) took 3011 ms. Trace:
I20260709 13:02:34.831619  1529 rpcz_store.cc:276] 0709 13:02:33.779418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.547723 (+768305us) service_pool.cc:224] Handling call
0709 13:02:34.794479 (+246756us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b54000f7654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:34.794606 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182794112}
I20260709 13:02:34.804528  4311 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.841383  1602 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.841904  1526 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.842048  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1604) took 1062 ms. Trace:
I20260709 13:02:34.842518  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1223) took 2407 ms. Trace:
I20260709 13:02:34.793807  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1301) took 1013 ms. Trace:
I20260709 13:02:34.843000  1528 rpcz_store.cc:276] 0709 13:02:33.780744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.453842 (+673098us) service_pool.cc:224] Handling call
0709 13:02:34.793595 (+339753us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000de654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:34.793743 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430715648}
I20260709 13:02:34.844659  1528 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:02:34.826989  4633 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.842890  1526 rpcz_store.cc:276] 0709 13:02:32.434783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.817316 (+2382533us) service_pool.cc:224] Handling call
0709 13:02:34.841757 (+ 24441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.842294 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.842459 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.796880  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1656) took 1710 ms. Trace:
I20260709 13:02:34.847429  1680 rpcz_store.cc:276] 0709 13:02:33.086167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.570805 (+484638us) service_pool.cc:224] Handling call
0709 13:02:34.796626 (+1225821us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400404f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:34.796796 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243262848}
I20260709 13:02:34.809379  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 5) took 1929 ms. Trace:
I20260709 13:02:34.842386  1602 rpcz_store.cc:276] 0709 13:02:33.779152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.840892 (+1061740us) service_pool.cc:224] Handling call
0709 13:02:34.841206 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.841806 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.841980 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.820852  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1603) took 1041 ms. Trace:
I20260709 13:02:34.849790  1606 rpcz_store.cc:276] 0709 13:02:33.778912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.792907 (+1013995us) service_pool.cc:224] Handling call
0709 13:02:34.793199 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.820427 (+ 27228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.820761 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.851171  1602 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:34.851428  1606 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:34.822546  4584 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.804371  4661 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:34.858355  4661 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:34.858867  4661 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.860615  2210 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:34.862627  4726 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.794515  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.826782  4636 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:34.830525  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.767562  4722 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:34.865248  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70824.5us
I20260709 13:02:34.867539  4581 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.845448  4311 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.868516  4311 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.796898  1607 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:34.870656  1607 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.873148  1607 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:34.837754  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:34.805011  4365 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.802752  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:34.879734  1527 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 4.
I20260709 13:02:34.881419  1527 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.848799  1530 rpcz_store.cc:276] 0709 13:02:32.879965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.597695 (+1717730us) service_pool.cc:224] Handling call
0709 13:02:34.806129 (+208434us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400070dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698073853 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:34.809201 (+  3072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235369216}
I20260709 13:02:34.840698  4608 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.855203  1606 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:34.885349  4633 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:34.886554  1675 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:34.856020  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1224) took 2293 ms. Trace:
I20260709 13:02:34.887501  4716 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:34.887217  1529 rpcz_store.cc:276] 0709 13:02:32.562494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.833052 (+2270558us) service_pool.cc:224] Handling call
0709 13:02:34.850238 (+ 17186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.850430 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.850457 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.855610 (+  5153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.855682 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.855773 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.855932 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.888797  4734 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.889634  1529 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:34.890271  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.890448  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1236) took 2173 ms. Trace:
W20260709 13:02:34.890719  4358 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.221s	user 0.013s	sys 0.000s
I20260709 13:02:34.890942  1529 rpcz_store.cc:276] 0709 13:02:32.717051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.888921 (+2171870us) service_pool.cc:224] Handling call
0709 13:02:34.889301 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.890114 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.890347 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.829517  4707 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.784449  4611 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.892638  4650 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:34.893447  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:34.894646  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 123) took 3080 ms. Trace:
I20260709 13:02:34.895007  1679 rpcz_store.cc:276] 0709 13:02:31.814657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.627523 (+1812866us) service_pool.cc:224] Handling call
0709 13:02:33.627820 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.535853 (+908033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.894427 (+358574us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002d4bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:34.894590 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959693056}
I20260709 13:02:34.896330  1676 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:34.864468  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.864279  1535 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:34.897292  1526 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.876828  1678 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:02:34.874701  4702 consensus_meta.cc:287] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.380s	user 0.012s	sys 0.001s
W20260709 13:02:34.897888  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.885494  1606 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:34.888170  4716 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:34.896184  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:34.902115  1679 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:02:34.904109  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:34.832357  1684 rpcz_store.cc:276] 0709 13:02:31.820424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.665632 (+1845208us) service_pool.cc:224] Handling call
0709 13:02:33.681794 (+ 16162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.309407 (+627613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.831478 (+522071us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54001405d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:34.831710 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441310464}
I20260709 13:02:34.877912  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1225) took 2268 ms. Trace:
W20260709 13:02:34.904574  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 203652us
I20260709 13:02:34.905097  1528 rpcz_store.cc:276] 0709 13:02:32.610045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.843926 (+2233881us) service_pool.cc:224] Handling call
0709 13:02:34.844316 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.877527 (+ 33211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.877832 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.906731  1528 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:34.907192  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1239) took 2189 ms. Trace:
I20260709 13:02:34.907440  1528 rpcz_store.cc:276] 0709 13:02:32.717922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.906141 (+2188219us) service_pool.cc:224] Handling call
0709 13:02:34.906421 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.907008 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.907150 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.898748  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1230) took 2183 ms. Trace:
I20260709 13:02:34.876892  1680 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.908180  1526 rpcz_store.cc:276] 0709 13:02:32.714996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.847136 (+2132140us) service_pool.cc:224] Handling call
0709 13:02:34.897107 (+ 49971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.898524 (+  1417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.898697 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.901043  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1231) took 2167 ms. Trace:
W20260709 13:02:34.803783  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 141288us
I20260709 13:02:34.908998  1527 rpcz_store.cc:276] 0709 13:02:32.715313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.880791 (+2165478us) service_pool.cc:224] Handling call
0709 13:02:34.881215 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.881913 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.882155 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.928248  1529 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:34.910323  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.854128  4609 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:34.933703  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.940217  1526 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:34.915205  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.933657  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1237) took 2216 ms. Trace:
I20260709 13:02:34.940997  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1240) took 2222 ms. Trace:
I20260709 13:02:34.941259  1529 rpcz_store.cc:276] 0709 13:02:32.717351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.892014 (+2174663us) service_pool.cc:224] Handling call
0709 13:02:34.928057 (+ 36043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.933391 (+  5334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.933599 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.941226  1606 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:34.940263  1530 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:34.941367  1526 rpcz_store.cc:276] 0709 13:02:32.718211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.908916 (+2190705us) service_pool.cc:224] Handling call
0709 13:02:34.936389 (+ 27473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.940737 (+  4348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.940943 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.937389  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 112) took 2109 ms. Trace:
I20260709 13:02:34.945839  1527 rpcz_store.cc:276] 0709 13:02:32.828009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.932524 (+2104515us) service_pool.cc:224] Handling call
0709 13:02:34.936675 (+  4151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.936919 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.936957 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.937018 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.937084 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.937174 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.937317 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.950007  1527 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.950913  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1444) took 2120 ms. Trace:
I20260709 13:02:34.951402  1527 rpcz_store.cc:276] 0709 13:02:32.830369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.949389 (+2119020us) service_pool.cc:224] Handling call
0709 13:02:34.949768 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.950632 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.950851 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.953763  1527 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:34.954617  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1248) took 2122 ms. Trace:
I20260709 13:02:34.955118  1527 rpcz_store.cc:276] 0709 13:02:32.831914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.953155 (+2121241us) service_pool.cc:224] Handling call
0709 13:02:34.953547 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.954336 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.954557 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.928352  4707 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.966068  1527 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.868728  4581 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:34.891379  4597 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.943672  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1440) took 2114 ms. Trace:
I20260709 13:02:34.974748  1530 rpcz_store.cc:276] 0709 13:02:32.829415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.932664 (+2103249us) service_pool.cc:224] Handling call
0709 13:02:34.932962 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.943397 (+ 10435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.943605 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80768}
I20260709 13:02:34.976398  1530 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:34.962857  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:34.963466  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:34.933104  4752 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.912953  4734 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:34.969722  4530 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
W20260709 13:02:34.970803  4704 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.006s
I20260709 13:02:34.972877  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1443) took 2142 ms. Trace:
I20260709 13:02:35.004230  1526 rpcz_store.cc:276] 0709 13:02:32.830128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.945623 (+2115495us) service_pool.cc:224] Handling call
0709 13:02:34.972434 (+ 26811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.972591 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.972614 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.972650 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.972675 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.972720 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.972822 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.973817  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1449) took 2088 ms. Trace:
I20260709 13:02:34.974436  4747 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:02:34.942094  4716 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:34.980913  1535 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:35.024847  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1257) took 2095 ms. Trace:
I20260709 13:02:34.985375  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1255) took 2056 ms. Trace:
I20260709 13:02:35.026188  1530 rpcz_store.cc:276] 0709 13:02:32.929173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.975795 (+2046622us) service_pool.cc:224] Handling call
0709 13:02:34.976186 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.985098 (+  8912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.985315 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.028069  1530 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:35.028792  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1453) took 2025 ms. Trace:
I20260709 13:02:35.029366  1530 rpcz_store.cc:276] 0709 13:02:33.003618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.027218 (+2023600us) service_pool.cc:224] Handling call
0709 13:02:35.027615 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.028498 (+   883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.028732 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.983376  4661 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.032533  4661 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.005442  1527 rpcz_store.cc:276] 0709 13:02:32.885932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.965465 (+2079533us) service_pool.cc:224] Handling call
0709 13:02:34.965839 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.966650 (+   811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.973760 (+  7110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.882907  4629 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.036798  4629 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.039788  1683 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.916527  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:35.041292  1607 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:34.910699  1498 leader_election.cc:400] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:34.909536  1528 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.043442  1498 leader_election.cc:403] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.043992  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1241) took 2325 ms. Trace:
I20260709 13:02:34.930140  4650 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:02:35.044793  4661 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.928567  4608 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:02:35.019893  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.047653  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:35.048439  1680 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.910046  4702 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:35.048746  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.049559  1607 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.051263  4702 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:35.052313  1608 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 4: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:34.935075  4584 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:35.054050  4584 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.054512  4584 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.060176  4584 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.044486  1528 rpcz_store.cc:276] 0709 13:02:32.718479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.909083 (+2190604us) service_pool.cc:224] Handling call
0709 13:02:34.909376 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.043670 (+134294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.043926 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.044512  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 133970us
I20260709 13:02:35.064477  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.065924  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.025321  1535 rpcz_store.cc:276] 0709 13:02:32.929756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.980171 (+2050415us) service_pool.cc:224] Handling call
0709 13:02:34.980532 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.024476 (+ 43944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.024771 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.077875  1680 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:34.942145  4633 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:02:34.948019  4636 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:34.985554  4752 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.090701  1526 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:35.100011  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1462) took 2045 ms. Trace:
I20260709 13:02:35.100752  1607 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:35.103071  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1461) took 2048 ms. Trace:
I20260709 13:02:35.100435  1526 rpcz_store.cc:276] 0709 13:02:33.054799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.090168 (+2035369us) service_pool.cc:224] Handling call
0709 13:02:35.090510 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.098609 (+  8099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.099949 (+  1340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.962961  4726 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:35.006728  4734 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.995620  4692 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:02:35.002902  4313 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.983908  4483 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:35.000953  4597 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.094254  4581 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.108065  1526 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:35.104256  4722 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.975281  4707 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.060159  4716 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:35.115190  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 275422us
I20260709 13:02:35.091910  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:34.966681  4659 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:02:35.168018  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.103855  1535 rpcz_store.cc:276] 0709 13:02:33.054584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.073570 (+2018986us) service_pool.cc:224] Handling call
0709 13:02:35.102483 (+ 28913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.102710 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.102750 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.102798 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:35.102837 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.102910 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.103018 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.101418  4752 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.022573  4530 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.101151  4554 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.088344  4750 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:35.028488  4704 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.177448  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1271) took 2057 ms. Trace:
I20260709 13:02:35.204494  1606 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:35.131654  4734 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.112952  4650 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:35.111351  4756 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:35.263904  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.248638  1533 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:35.266520  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.131301  4613 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.176395  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 242038us
I20260709 13:02:35.174495  4608 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.097962  4751 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:02:35.331841  1526 rpcz_store.cc:276] 0709 13:02:33.119585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.105981 (+1986396us) service_pool.cc:224] Handling call
0709 13:02:35.107154 (+  1173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.174758 (+ 67604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.177377 (+  2619us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.247661  4746 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 13:02:35.335222  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 243385us
I20260709 13:02:35.444613  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.249056  4483 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:35.344780  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:35.177753  4574 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.177347  4753 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.445331  1607 raft_consensus.cc:2376] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8. Re-sending same reply.
W20260709 13:02:35.368348  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 101916us
I20260709 13:02:35.469846  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:35.379527  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.446161  1534 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 10. Ops: []
W20260709 13:02:35.328205  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 365198us
W20260709 13:02:35.441387  4727 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.929s	user 0.001s	sys 0.015s
I20260709 13:02:35.466219  4483 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:35.448851  1531 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:35.449900  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1661) took 1933 ms. Trace:
I20260709 13:02:35.230149  4722 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.447314  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.352556  4581 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:35.486127  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 347445us
I20260709 13:02:35.481501  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:35.480464  1682 rpcz_store.cc:276] 0709 13:02:33.516940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.459331 (+942391us) service_pool.cc:224] Handling call
0709 13:02:34.459631 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.459848 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:34.460165 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.440628 (+980463us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.449197 (+  8569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.449420 (+   223us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.449508 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.449695 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.449842 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79703,"prepare.queue_time_us":148276,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":122159,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":18089,"thread_start_us":903290,"threads_started":3,"wal-append.queue_time_us":128651}
I20260709 13:02:35.441556  4611 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:35.333420  4738 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:02:35.487768  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:35.481456  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 136791us
I20260709 13:02:35.499843  1607 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:35.500169  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.353421  4554 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:35.493968  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.477337  4727 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.359001  4748 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:35.466087  4613 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.496371  4775 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:35.504526  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57331.5us
I20260709 13:02:35.519968  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.520418  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.505878  1526 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.477550  4753 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.445149  4650 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:35.505123  4610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.013s	sys 0.035s
W20260709 13:02:35.516101  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46341.6us
I20260709 13:02:35.520215  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:35.505321  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:35.482416  4747 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.523818  4659 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.520849  4748 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.524430  4784 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.525028  4758 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:02:35.521883  4633 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.524128  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.534344  4613 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.526436  4679 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.534543  4584 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.514580  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.538141  4554 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.580557  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:35.589596  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75147.8us
I20260709 13:02:35.589967  1682 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:35.538388  4311 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.000s
I20260709 13:02:35.539428  4704 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.541538  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1665) took 1110 ms. Trace:
W20260709 13:02:35.542040  4609 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.002s
I20260709 13:02:35.544862  4707 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.472795  4574 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.599704  4574 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.527627  4530 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.529258  4650 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:35.530615  4610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.013s	sys 0.035s
W20260709 13:02:35.548388  1574 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.852s (SENT)
I20260709 13:02:35.603350  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.549508  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1591) took 1982 ms. Trace:
I20260709 13:02:35.604066  1609 rpcz_store.cc:276] 0709 13:02:33.567451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.463110 (+895659us) service_pool.cc:224] Handling call
0709 13:02:34.492564 (+ 29454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.512778 (+ 20214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.512816 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.524549 (+ 11733us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.703864 (+179315us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:34.705364 (+  1500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.705435 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.549236 (+843801us) raft_consensus.cc:1685] finished
0709 13:02:35.549264 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.549436 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3066,"raft.queue_time_us":21968,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12403,"thread_start_us":113899,"threads_started":1,"wal-append.queue_time_us":277853}
I20260709 13:02:35.583566  4769 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.526619  4765 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.448203  4608 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.551163  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:35.552100  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:35.552791  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 104648us
I20260709 13:02:35.519276  4581 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.607137  4641 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.636749  1684 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:35.548943  4661 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10.
I20260709 13:02:35.637890  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.535393  4483 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.638487  1607 raft_consensus.cc:2376] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12. Re-sending same reply.
I20260709 13:02:35.638855  4483 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.639417  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:35.551755  4659 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.640093  4659 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.640229  4610 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.601751  4311 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.641404  1535 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.642668  4311 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:35.642979  4763 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:02:35.644383  4650 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.507642  4738 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.590395  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:35.653201  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62880us
W20260709 13:02:35.580385  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56383.3us
I20260709 13:02:35.467593  4756 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.593191  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:35.583406  4491 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.595978  1677 rpcz_store.cc:276] 0709 13:02:34.431197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.752608 (+321411us) service_pool.cc:224] Handling call
0709 13:02:34.754905 (+  2297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.755373 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:34.755414 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.756136 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.170371 (+414235us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:35.170433 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.170546 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.541328 (+370782us) raft_consensus.cc:1685] finished
0709 13:02:35.541348 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.541474 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8743,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":18245,"thread_start_us":342893,"threads_started":1,"wal-append.queue_time_us":721818}
I20260709 13:02:35.550446  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:35.579730  4783 raft_consensus.cc:2764] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:35.606577  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1460) took 2552 ms. Trace:
I20260709 13:02:35.656064  1528 rpcz_store.cc:276] 0709 13:02:33.054297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.062136 (+2007839us) service_pool.cc:224] Handling call
0709 13:02:35.062422 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.062698 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:35.334676 (+271978us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.606216 (+271540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.606267 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.606309 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.606373 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.606518 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":295823,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":80,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1612,"thread_start_us":542784,"threads_started":2}
I20260709 13:02:35.557811  4747 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.615696  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1290) took 2428 ms. Trace:
I20260709 13:02:35.658491  1526 rpcz_store.cc:276] 0709 13:02:33.187106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.441495 (+2254389us) service_pool.cc:224] Handling call
0709 13:02:35.441815 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.522142 (+ 80327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.615439 (+ 93297us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b54000dcd54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:35.615626 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146800512}
I20260709 13:02:35.588871  4679 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:35.634857  4486 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.594537  4726 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.646744  2175 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:35.701328  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54696.3us
I20260709 13:02:35.587764  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:35.699612  1678 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.647893  1607 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
W20260709 13:02:35.648959  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 100626us
I20260709 13:02:35.698719  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:35.704229  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.704737  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.705101  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.698812  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.647532  1609 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:35.700757  1526 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:35.706445  1526 pending_rounds.cc:85] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:02:35.706806  1526 pending_rounds.cc:107] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:02:35.707100  1526 raft_consensus.cc:2889] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.707998  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1313) took 1269 ms. Trace:
I20260709 13:02:35.708220  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1626) took 2412 ms. Trace:
I20260709 13:02:35.699661  1528 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.705283  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.708606  1526 rpcz_store.cc:276] 0709 13:02:34.438575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.659631 (+1221056us) service_pool.cc:224] Handling call
0709 13:02:35.698611 (+ 38980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.707680 (+  9069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.707925 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.708717  1604 rpcz_store.cc:276] 0709 13:02:33.295579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.303503 (+1007924us) service_pool.cc:224] Handling call
0709 13:02:34.462254 (+158751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.463938 (+  1684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.708012 (+1244074us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400085f50. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:35.708167 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350198528}
I20260709 13:02:35.700719  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:35.710479  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.710708  1677 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:35.712754  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:35.712738  1679 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:35.714252  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:35.714389  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60158.9us
I20260709 13:02:35.715098  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1307) took 1522 ms. Trace:
I20260709 13:02:35.715490  1528 rpcz_store.cc:276] 0709 13:02:34.192760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.658245 (+1465485us) service_pool.cc:224] Handling call
0709 13:02:35.699092 (+ 40847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.714851 (+ 15759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.715046 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.715642  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.717114  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.718632  1526 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.581251  4784 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.719321  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1464) took 1102 ms. Trace:
I20260709 13:02:35.721601  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:35.722395  1526 rpcz_store.cc:276] 0709 13:02:34.617409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.718100 (+1100691us) service_pool.cc:224] Handling call
0709 13:02:35.718452 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.719086 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.719269 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.722020  1677 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:35.723151  1609 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:35.726027  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.726320  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:35.727917  1528 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:35.730273  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.721570  4486 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.711941  4311 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.711876  4774 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.708295  4726 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.725113  4783 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.651060  4769 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.731320  4491 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.728554  4584 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.730545  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1468) took 1087 ms. Trace:
I20260709 13:02:35.730298  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1467) took 1106 ms. Trace:
I20260709 13:02:35.707329  4530 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.734751  1682 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:35.774415  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:35.775199  1682 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.762866  1526 rpcz_store.cc:276] 0709 13:02:34.636733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.723495 (+1086762us) service_pool.cc:224] Handling call
0709 13:02:35.723835 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.724142 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.724171 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.724221 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:35.724255 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.724309 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.724410 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2639,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5182,"spinlock_wait_cycles":74368}
I20260709 13:02:35.718349  4633 raft_consensus.cc:2764] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:35.698292  4772 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.722174  4661 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.722029  4707 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:35.740990  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.730360  4668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.014s	sys 0.006s
I20260709 13:02:35.744295  4726 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.733132  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.733225  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:35.751276  4740 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.731629  4692 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:02:35.731248  4775 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:35.764402  1528 rpcz_store.cc:276] 0709 13:02:34.624078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.722675 (+1098597us) service_pool.cc:224] Handling call
0709 13:02:35.723964 (+  1289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.729949 (+  5985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.730231 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13056}
I20260709 13:02:35.790189  1528 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:35.737803  4704 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.776722  1526 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:35.779801  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46745.9us
I20260709 13:02:35.794044  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1472) took 1145 ms. Trace:
I20260709 13:02:35.794143  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.738168  4311 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.796190  4311 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:35.784461  4668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.014s	sys 0.007s
W20260709 13:02:35.801283  4781 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:02:35.802590  4762 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:02:35.780804  1574 leader_election.cc:336] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.724s (SENT)
I20260709 13:02:35.805138  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:35.806166  1574 leader_election.cc:336] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.899s (SENT)
W20260709 13:02:35.806941  1574 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.919s (SENT)
I20260709 13:02:35.807291  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.758517  4722 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.794376  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1473) took 1137 ms. Trace:
I20260709 13:02:35.794823  1682 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:35.794416  1526 rpcz_store.cc:276] 0709 13:02:34.649268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.776119 (+1126851us) service_pool.cc:224] Handling call
0709 13:02:35.776547 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.793772 (+ 17225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.793981 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.795061  4530 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.795570  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.810758  1528 rpcz_store.cc:276] 0709 13:02:34.657101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.789264 (+1132163us) service_pool.cc:224] Handling call
0709 13:02:35.789656 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.790647 (+   991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.794320 (+  3673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.811877  1682 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.812079  1526 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:35.812247  1574 leader_election.cc:336] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.074s (SENT)
I20260709 13:02:35.817096  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1474) took 1137 ms. Trace:
I20260709 13:02:35.777925  4748 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.817531  1526 rpcz_store.cc:276] 0709 13:02:34.679319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.811440 (+1132121us) service_pool.cc:224] Handling call
0709 13:02:35.811723 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.816814 (+  5091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.817039 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.818943  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.816896  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:35.824174  4787 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.825002  1498 leader_election.cc:400] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11.
I20260709 13:02:35.778736  4661 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:35.787554  4783 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.830297  1498 leader_election.cc:403] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.784395  4707 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:35.825562  1574 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.132s (SENT)
I20260709 13:02:35.821486  1680 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:35.815047  1677 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:02:35.793614  4704 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.835376  1677 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: [9.5-12.6]
I20260709 13:02:35.825223  4739 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.812747  4774 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:35.815196  4609 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.809813  4727 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:35.843686  1574 leader_election.cc:336] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 3.172s (SENT)
I20260709 13:02:35.825337  4491 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.825991  4530 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:35.834267  4661 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.834916  4606 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.832803  4707 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.845800  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:35.834892  4608 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.835136  4753 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.832973  4748 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.838315  4704 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:35.862866  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.842289  4581 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11.
I20260709 13:02:35.893424  4734 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:35.894508  4764 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.446s	user 0.001s	sys 0.000s
I20260709 13:02:35.943244  1684 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.896870  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1599) took 2124 ms. Trace:
I20260709 13:02:35.944440  1610 rpcz_store.cc:276] 0709 13:02:33.773509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.498973 (+725464us) service_pool.cc:224] Handling call
0709 13:02:34.499299 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.538029 (+ 38730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.896644 (+1358615us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b540003d9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:35.896816 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69436160}
I20260709 13:02:35.882548  4530 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:35.896531  4716 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
W20260709 13:02:35.899250  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.900614  4727 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.901276  4747 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.901357  4784 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.895721  4772 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.905362  4659 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.908180  4715 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:35.784734  4679 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.899940  4728 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:35.926147  4753 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.931790  1679 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:35.979751  4636 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.979745  4753 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:35.958381  4606 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.980512  4636 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.980942  4606 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:35.982667  4753 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:35.932775  2211 raft_consensus.cc:2368] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:02:35.983174  4606 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:35.934751  4734 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.920648  4748 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.937247  4769 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.938362  4597 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.939146  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:35.940629  4311 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.942360  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1670) took 1453 ms. Trace:
I20260709 13:02:35.986235  1682 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.986418  1675 rpcz_store.cc:276] 0709 13:02:34.488916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.515263 (+ 26347us) service_pool.cc:224] Handling call
0709 13:02:35.942152 (+1426889us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400140ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:35.942301 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816485248}
W20260709 13:02:35.949404  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.949065  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.950412  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53915.1us
I20260709 13:02:35.804183  4775 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:35.987767  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:35.970767  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.943943  4554 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:35.791841  4740 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:35.977800  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 152911us
I20260709 13:02:35.891706  4774 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:35.958220  4715 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:35.983528  4659 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.989471  1675 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:35.956652  4727 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.000715  4715 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.001621  4727 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.001852  4715 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.002259  4597 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:35.992620  4775 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:35.994302  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1660) took 2477 ms. Trace:
I20260709 13:02:35.994609  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:35.995424  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1643) took 1485 ms (client timeout 1792 ms). Trace:
I20260709 13:02:36.011703  1676 rpcz_store.cc:276] 0709 13:02:33.516627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.464159 (+947532us) service_pool.cc:224] Handling call
0709 13:02:34.464532 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.910476 (+445944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.994014 (+1083538us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54000be0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:35.994241 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992627968}
W20260709 13:02:35.985770  4752 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.654s	user 0.017s	sys 0.009s
I20260709 13:02:36.015115  4752 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:36.017325  4752 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:36.018090  2210 raft_consensus.cc:2368] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
W20260709 13:02:36.003115  1574 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.214s (SENT)
I20260709 13:02:36.017982  4661 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.018720  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:36.003614  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:36.020702  4802 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.022167  4802 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:36.024823  4802 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.025889  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.026829  4606 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.027917  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:35.979404  4728 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:36.020941  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:36.028517  4661 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:35.997148  4748 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:36.011893  1605 rpcz_store.cc:269] 0709 13:02:34.509992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.518169 (+  8177us) service_pool.cc:224] Handling call
0709 13:02:35.995237 (+1477068us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540003bbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:35.995368 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826291968}
I20260709 13:02:36.013973  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:36.037638  4799 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:36.040198  4311 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:36.042652  4760 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.500s	user 0.001s	sys 0.001s
I20260709 13:02:36.030850  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.033231  1675 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.031577  4606 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.045248  1676 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:36.046197  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.047183  2178 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:36.059195  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.061102  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.062719  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.063318  1526 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:36.060312  4597 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.069078  4660 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:36.070662  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:36.071692  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:02:36.076591  1684 raft_consensus.cc:606] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:36.077385  1684 raft_consensus.cc:614] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.057791  4659 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:36.079965  4748 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.080365  4748 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.081125  4748 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.081478  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.082315  4748 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:36.087127  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1620) took 2793 ms (client timeout 1623 ms). Trace:
W20260709 13:02:36.087765  1608 rpcz_store.cc:269] 0709 13:02:33.293694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.513829 (+220135us) service_pool.cc:224] Handling call
0709 13:02:36.086850 (+2573021us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540003c0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.087033 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3535453952}
I20260709 13:02:36.091073  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:36.092505  4757 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.624s	user 0.001s	sys 0.003s
I20260709 13:02:36.092372  4802 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:36.093262  4802 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.093734  4802 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:36.048437  4311 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.094523  4311 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.094564  4802 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.095368  4311 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:36.096503  4311 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.097872   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:36.100514  4740 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.102706  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.104329  4784 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:36.104817  4784 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:36.105656  4784 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.106388  4756 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.107887  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:36.092494  1684 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.111743  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.067600  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.068264  4554 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.061745  1530 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 9.
I20260709 13:02:36.113654  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.114368  1530 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:36.065842  1528 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:36.115370  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.073221  4727 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:36.075505  1526 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 5.
I20260709 13:02:36.075634  4660 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.138737  1675 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:36.050516  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:36.174887  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.174546  1684 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.111666  1679 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:36.128607  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61653.1us
I20260709 13:02:36.175567  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:36.044597  4738 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.083600  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.129899  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.177160  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.128808  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.179605  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.182056  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.182173  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.175526  1528 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.183029  1526 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.183911  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.184793  1528 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:36.097685  4311 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.190193  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.186071  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.191388  1528 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.191342  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.186650  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.192667  1530 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:36.185714  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56982.4us
I20260709 13:02:36.174427  4597 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:36.185348  4782 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.633s	user 0.003s	sys 0.000s
I20260709 13:02:36.051198  4726 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.173995  4661 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.128980  4554 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.181268  4734 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:36.221071  1528 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:36.067621  4707 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.194211  4783 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.189009  4668 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.193925  4581 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.057698  4775 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:02:36.054517  4704 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.194149  4491 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.215458  1526 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.245298  1648 leader_election.cc:400] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:02:36.249293  1648 leader_election.cc:403] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:36.249120  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.251744  2176 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.252982  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.253650  1526 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:36.254328  1530 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:36.254344  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.221796  4554 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.260203  1526 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.255771  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.266878  1530 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.228785  4581 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.254104  4727 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8.
I20260709 13:02:36.245522  4734 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:36.228575  4661 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.179785  4728 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:36.296802  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1644) took 1782 ms (client timeout 1935 ms). Trace:
W20260709 13:02:36.323880  1603 rpcz_store.cc:269] 0709 13:02:34.514914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.530930 (+ 16016us) service_pool.cc:224] Handling call
0709 13:02:36.296548 (+1765618us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54001734d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.296726 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264982784}
W20260709 13:02:36.297353  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1246) took 3577 ms (client timeout 2379 ms). Trace:
I20260709 13:02:36.292191  1526 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:36.325802  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.326579  1526 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:36.301064  4636 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:36.325142  1533 rpcz_store.cc:269] 0709 13:02:32.719943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.860365 (+140422us) service_pool.cc:224] Handling call
0709 13:02:36.297154 (+3436789us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.297270 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5461226880}
I20260709 13:02:36.327663  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.329279  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.329473  1526 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.330008  1533 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.331022  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.307150  1530 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:36.309768  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.333189  4727 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.333290  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.333999  4727 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.334889  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.335180  4727 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.336388  4483 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:36.337167  4738 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:36.335829  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.337723  4738 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.338176  4772 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.338694  4772 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.336993  4483 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.339592  4772 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.340647  4483 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.343503  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.344324  4659 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.344720  4659 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.345050  4659 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.338779  4738 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.352835  4659 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.354024  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.355145  4740 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.355548  4740 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:36.355929  4740 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.366466  4740 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.368813  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.369614  1530 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:36.372107  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.373018  4756 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.373574  4756 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:36.374393  4756 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:36.375912  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.378726  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.382028  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.252848  4530 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:02:36.293969  4581 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.384554  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1341) took 2740 ms. Trace:
I20260709 13:02:36.386674  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.294659  4358 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:36.389500  1683 rpcz_store.cc:276] 0709 13:02:33.644017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.494931 (+850914us) service_pool.cc:224] Handling call
0709 13:02:34.495219 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.040377 (+545158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.384303 (+1343926us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54002e95d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.384482 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251328256}
I20260709 13:02:36.390100  1526 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:36.392355  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:36.392756  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.393151  1526 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:36.268323  4660 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:02:36.309279  4597 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:36.299083  4805 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:36.382752  4813 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:02:36.381811  4365 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:36.431939  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 240650us
I20260709 13:02:36.388883  4728 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.396193  4358 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:36.382907  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.436890  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1222) took 4040 ms. Trace:
I20260709 13:02:36.441048  1530 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:36.442987  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.443410  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1674) took 1702 ms. Trace:
I20260709 13:02:36.443845  1678 rpcz_store.cc:276] 0709 13:02:34.740783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.898350 (+157567us) service_pool.cc:224] Handling call
0709 13:02:34.902342 (+  3992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.703729 (+801387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.443166 (+739437us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540041ad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.443353 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728807680}
I20260709 13:02:36.444563  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.432792  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.439416  1532 rpcz_store.cc:276] 0709 13:02:32.395960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.718808 (+2322848us) service_pool.cc:224] Handling call
0709 13:02:34.719113 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.723513 (+  4400us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:35.168002 (+444489us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.432691 (+264689us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.433410 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.433581 (+   171us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:35.433626 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.433720 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.071355 (+637635us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:36.436529 (+365174us) raft_consensus.cc:1685] finished
0709 13:02:36.436647 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.436817 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386889,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4254,"raft.queue_time_us":41571,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":17825,"spinlock_wait_cycles":3600640,"thread_start_us":467365,"threads_started":3,"wal-append.queue_time_us":266696}
I20260709 13:02:36.445288  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1275) took 3324 ms. Trace:
I20260709 13:02:36.445701  1535 rpcz_store.cc:276] 0709 13:02:33.120918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.264459 (+2143541us) service_pool.cc:224] Handling call
0709 13:02:35.336582 (+ 72123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.641788 (+305206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.445068 (+803280us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.445232 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700556672}
I20260709 13:02:36.437841  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:36.446965  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1617) took 1534 ms (client timeout 1583 ms). Trace:
I20260709 13:02:36.431197  4365 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.447409  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:36.447355  1606 rpcz_store.cc:269] 0709 13:02:34.912185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.963154 (+ 50969us) service_pool.cc:224] Handling call
0709 13:02:36.446797 (+1483643us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400086e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.446910 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520050048}
I20260709 13:02:36.445297  1530 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:36.448459  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:36.444341  4811 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:02:36.450850  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.451995  1532 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:36.452337  1526 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:36.467027  1526 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:36.454905  1530 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:36.474709  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.480089  1535 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:36.435001  4805 raft_consensus.cc:697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:36.482801  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.483423  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:36.484975  1530 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.450615  4802 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.462850  4365 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.508417  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:36.513612  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66290.3us
I20260709 13:02:36.517933  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:36.515879  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1221) took 4120 ms. Trace:
I20260709 13:02:36.519285  1534 rpcz_store.cc:276] 0709 13:02:32.395619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.597857 (+2202238us) service_pool.cc:224] Handling call
0709 13:02:34.644123 (+ 46266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.470789 (+826666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.515640 (+1044851us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54003d2cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.515822 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844031232}
I20260709 13:02:36.508203  4756 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.522073  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.523572  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.508074  4753 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.512189  4726 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.508149  4606 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.513794  4358 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.507974  4769 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:36.528940  4769 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.464131  4734 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:36.529145  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.524923  4483 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.529556  4740 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.529822  4483 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.530227  4483 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.527935  4753 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:36.532167  4753 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.529361  4769 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.536374  4726 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.536573  4816 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:36.538823  4581 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.539353  4805 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:36.540278  4704 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:36.545424  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1282) took 3422 ms (client timeout 1853 ms). Trace:
I20260709 13:02:36.513540  4727 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:36.548774  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 354422us
W20260709 13:02:36.545903  1531 rpcz_store.cc:269] 0709 13:02:33.122816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.521959 (+399143us) service_pool.cc:224] Handling call
0709 13:02:36.545207 (+3023248us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400440554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.545352 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4320727936}
I20260709 13:02:36.553242  1531 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:36.557338  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.558889  4814 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:36.560675  4814 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:36.561614  4661 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:36.561673  4554 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:36.505473  4597 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.520733  4756 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.554105  1533 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.575148  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:36.599370  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.621711  1530 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
W20260709 13:02:36.622627  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47618.3us
I20260709 13:02:36.595857  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:36.543025  4707 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.646034  1678 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:36.636225  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:36.632395  1606 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 7: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:36.629755  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 626617us
W20260709 13:02:36.654925  1574 leader_election.cc:336] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.916s (SENT)
W20260709 13:02:36.656479  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.656889  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.657253  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.657960  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.658555  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.623857  1527 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.668650  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1356) took 1016 ms. Trace:
I20260709 13:02:36.669047  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.668957  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.670019  1533 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:36.671399  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.672138  1533 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:36.673259  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.673995  1533 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:36.577728  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1610) took 2258 ms. Trace:
I20260709 13:02:36.596325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:36.588984  4812 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:02:36.553501  4704 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.669121  1680 rpcz_store.cc:276] 0709 13:02:35.652536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.844919 (+192383us) service_pool.cc:224] Handling call
0709 13:02:35.915457 (+ 70538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.993621 (+ 78164us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:35.993945 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.128281 (+134336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.128347 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:36.128394 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.668419 (+540025us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54001126d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.668472 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.668591 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6798,"prepare.queue_time_us":932,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":45722,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5976,"spinlock_wait_cycles":178991488,"thread_start_us":133799,"threads_started":1,"wal-append.queue_time_us":178189}
I20260709 13:02:36.549029  4727 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.576537  4770 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.991s	user 0.003s	sys 0.000s
I20260709 13:02:36.595319  4313 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.702499  1606 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.692261  2212 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:02:36.691547  1528 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.711994  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.713016  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.714129  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.715085  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.546638  4738 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:02:36.716435  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:36.716977  1606 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.703831  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.719172  1533 raft_consensus.cc:2376] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11. Re-sending same reply.
I20260709 13:02:36.719270  1530 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:36.681386  1602 rpcz_store.cc:276] 0709 13:02:34.319476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.852187 (+532711us) service_pool.cc:224] Handling call
0709 13:02:34.852456 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.898931 (+ 46475us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:34.943156 (+ 44225us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.371659 (+428503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.371747 (+    88us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.371818 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.577382 (+1205564us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540024b3d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.577452 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.577650 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51023,"prepare.queue_time_us":48710,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":35,"raft.queue_time_us":108126,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":23749,"spinlock_wait_cycles":106382592,"thread_start_us":389869,"threads_started":1,"wal-append.queue_time_us":596440,"wal-append.run_cpu_time_us":1305,"wal-append.run_wall_time_us":1005575}
I20260709 13:02:36.720315  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.721045  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:36.721460  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.721813  1603 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:02:36.722180  1603 pending_rounds.cc:85] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 3
I20260709 13:02:36.722208  1533 raft_consensus.cc:2368] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:02:36.722512  1603 pending_rounds.cc:107] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:02:36.722767  1603 raft_consensus.cc:2889] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.723078  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.593063  4608 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.724148  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.730485  1533 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:36.720322  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:36.627784  4606 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.753790  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:36.562649  4661 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:36.757287  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.716699  4783 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:02:36.768154  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:36.838097  1603 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.567821  4769 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.711165  4727 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:36.794530  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.561553  4753 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.763101  4739 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.809087  4700 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.809154  1574 leader_election.cc:336] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 3.130s (SENT)
I20260709 13:02:36.811751  1606 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.865238  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:36.866291  1606 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.564072  4641 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.751650  4313 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:36.831949  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.589913  4659 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.701284  4704 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.842535  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 327361us
W20260709 13:02:36.848735  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 325250us
W20260709 13:02:36.846017  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.845745  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:36.903563  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:36.903920  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58297.7us
W20260709 13:02:36.836655  4823 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:02:36.831149  4661 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:36.864485  4715 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.011s
W20260709 13:02:36.863757  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54640us
I20260709 13:02:36.877054  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:36.826082  4775 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.879256  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:36.902314  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1351) took 1252 ms. Trace:
I20260709 13:02:36.900882  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1441) took 4071 ms. Trace:
I20260709 13:02:36.943470  1531 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.943231  1682 rpcz_store.cc:276] 0709 13:02:35.650169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.826107 (+175938us) service_pool.cc:224] Handling call
0709 13:02:35.841712 (+ 15605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.986683 (+144971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.899757 (+913074us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400035054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:36.902255 (+  2498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331835136}
I20260709 13:02:36.906961  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:36.859542  1678 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:36.941160  1574 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 3.145s (SENT)
I20260709 13:02:36.946316  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:36.947031  2211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41274 (request call id 119) took 1381 ms. Trace:
I20260709 13:02:36.864820  4576 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:36.943805  1529 rpcz_store.cc:276] 0709 13:02:32.829667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.942855 (+2113188us) service_pool.cc:224] Handling call
0709 13:02:34.970720 (+ 27865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.971111 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.971189 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.971619 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.179108 (+207489us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:35.179179 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.179277 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.575693 (+1396416us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:36.848590 (+272897us) raft_consensus.cc:1685] finished
0709 13:02:36.848612 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.900792 (+ 52180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7712,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":11495680,"thread_start_us":206954,"threads_started":1,"wal-append.queue_time_us":516188}
I20260709 13:02:36.947427  2211 rpcz_store.cc:276] 0709 13:02:35.560306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.583388 (+ 23082us) service_pool.cc:224] Handling call
0709 13:02:36.941210 (+1357822us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400600254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:36.941340 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538189568}
I20260709 13:02:36.834112  4608 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.907702  4704 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.931622  1603 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:36.936713  4613 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.879201  4739 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:36.879698  4737 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:02:36.960860  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:36.958222  4576 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.089476  4753 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:36.938745  4747 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.901925  4641 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.079648  1531 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:37.019780  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:36.940640  4748 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:02:36.940868  4726 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:02:36.940352  4787 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:02:37.095381  1607 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:36.899272  4700 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:37.026980  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:37.115676  1529 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.099130  1603 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:37.119421  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.120985  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.123651  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.157853  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.125082  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.091812  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:37.105675  4365 consensus_meta.cc:287] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.576s	user 0.019s	sys 0.003s
I20260709 13:02:37.064779  4650 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.210299  1605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.050s	sys 0.054s
I20260709 13:02:36.988865  4716 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:37.143405  4819 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:02:36.947656  4740 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:02:37.097002  4747 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.096380  4613 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:37.147346  4830 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:02:37.147902  4820 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:02:37.150092  4611 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:37.155400  4358 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.103654  1606 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:37.218922  4660 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:37.242202  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.163815  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:37.166327  4728 consensus_meta.cc:287] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.004s
I20260709 13:02:37.166430  4608 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.167757  4313 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.168782  4769 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.169516  4554 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.170109  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:37.255990  1534 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.171712  4700 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:37.239214  4611 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:37.092080  4661 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.181331  1531 raft_consensus.cc:2376] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12. Re-sending same reply.
I20260709 13:02:37.181941  1603 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:37.179710  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.009s
W20260709 13:02:37.274389  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.010s	sys 0.010s
I20260709 13:02:37.190267  1529 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:36.954272  4775 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.276340  1535 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:37.140187  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.210829  1605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.050s	sys 0.054s
I20260709 13:02:37.210173  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.216187  1532 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: [7.4-9.6]
I20260709 13:02:37.281572  1532 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:37.132735  4748 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:37.221364  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.225509   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:37.238158  4483 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.000s
I20260709 13:02:37.287513  4483 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.288803  4739 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.289816  4483 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.234086  4613 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.228544  4747 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.297165  2212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41288 (request call id 53) took 1189 ms. Trace:
I20260709 13:02:37.297598  2212 rpcz_store.cc:276] 0709 13:02:36.107454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.107592 (+   138us) service_pool.cc:224] Handling call
0709 13:02:37.296924 (+1189332us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540088a4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:37.297085 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341685504}
I20260709 13:02:37.298700  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1506) took 1074 ms. Trace:
I20260709 13:02:37.299256  1526 rpcz_store.cc:276] 0709 13:02:36.224337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.468093 (+243756us) service_pool.cc:224] Handling call
0709 13:02:36.468486 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.468768 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.468810 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.469486 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.908713 (+439227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.908753 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.909065 (+   312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.298474 (+389409us) raft_consensus.cc:1685] finished
0709 13:02:37.298493 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.298644 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":438664,"threads_started":1,"wal-append.queue_time_us":754326}
I20260709 13:02:37.300086  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.301230  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.301905  1526 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:37.302201  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.302915  1608 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:02:37.247864  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 342079us
I20260709 13:02:37.306703  4608 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:37.307024  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:37.307579  4608 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:37.250262  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.368814  1606 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:37.369884  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.371434  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.246798  4797 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.393486  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.394219  1606 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.394299  1528 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:37.210065  4365 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.110349  4756 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.219996  4650 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.225965  4716 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.244401  4660 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:37.248948  1602 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:37.411370  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.308828  4728 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.308939  4313 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.412688  4313 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:37.414179  4597 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.414426  4313 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.414760  4597 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.402777  4715 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:37.416890  4715 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:37.309504  4787 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.312238  4769 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.313180  4581 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.314850  4747 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.303901  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.419178  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.317754  4576 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.320334  4613 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:37.325091  4641 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.327764  4775 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.330621  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:37.316642  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1483) took 1251 ms (client timeout 1594 ms). Trace:
I20260709 13:02:37.285333  4198 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.333559  1680 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.333841  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.334496  1683 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:37.335070  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:37.337175  1529 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:37.285878  4700 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:37.338232  1531 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.339465  4727 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.345825  1532 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:37.439442  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:37.439570  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:37.440418  1532 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:37.359226  4822 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.419s	user 0.000s	sys 0.003s
I20260709 13:02:37.364765  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:37.364985  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:02:37.364961  1603 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:37.303361  1526 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.393579  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 52) took 8629 ms. Trace:
I20260709 13:02:37.399230  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.401863  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:37.453104  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.402601  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:37.403721  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 496806us
I20260709 13:02:37.316646  4611 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.420976  1684 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:37.421271  1602 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.422221  1679 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:37.460417  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:37.427664  1606 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:37.461244  1529 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:37.429257  1527 rpcz_store.cc:269] 0709 13:02:36.065108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.083294 (+ 18186us) service_pool.cc:224] Handling call
0709 13:02:37.316479 (+1233185us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540027c4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:37.316588 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945869568}
W20260709 13:02:37.463351  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98683us
I20260709 13:02:37.431149  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:37.462334  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.464627  1535 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.465020  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:37.436290  1675 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:37.437460  1607 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.415813  4313 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.412930  4728 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.443142  1678 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:37.419857  4787 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.440877  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:37.428550  4756 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:37.454840  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.444732  4581 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.420488  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.446527  1433 rpcz_store.cc:276] 0709 13:02:28.764230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.764559 (+   329us) service_pool.cc:224] Handling call
0709 13:02:37.393515 (+8628956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:34.516629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:34.708625 (+191996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:34.708671 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:02:34.708699 (+    28us) tablet.cc:662] Decoding operations
0709 13:02:34.774405 (+ 65706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:34.774488 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:34.774521 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:34.774938 (+   417us) tablet.cc:701] Row locks acquired
0709 13:02:34.774956 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:34.775099 (+   143us) write_op.cc:270] Start()
0709 13:02:34.775310 (+   211us) write_op.cc:276] Timestamp: P: 1783602154775050 usec, L: 0
0709 13:02:34.775343 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.861764 (+ 86421us) log.cc:844] Serialized 1615 byte log entry
0709 13:02:36.000288 (+1138524us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.050804 (+ 50516us) write_op.cc:301] APPLY: starting
0709 13:02:36.050900 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.051034 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.051177 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.051652 (+   475us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.079400 (+ 27748us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:02:36.079458 (+    58us) write_op.cc:312] APPLY: finished
0709 13:02:36.090458 (+ 11000us) log.cc:844] Serialized 34 byte log entry
0709 13:02:36.090651 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.090756 (+   105us) write_op.cc:454] Released schema lock
0709 13:02:36.090798 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.091188 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.091218 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95683,"reported_tablets":4,"spinlock_wait_cycles":300800,"child_traces":[["op",{"apply.queue_time_us":49905,"apply.run_cpu_time_us":2186,"apply.run_wall_time_us":40353,"num_ops":3,"prepare.queue_time_us":257062,"prepare.run_cpu_time_us":24306,"prepare.run_wall_time_us":686735,"raft.queue_time_us":193788,"raft.run_cpu_time_us":16536,"raft.run_wall_time_us":51175,"replication_time_us":1222264,"thread_start_us":675610,"threads_started":4,"wal-append.queue_time_us":782573,"wal-append.run_cpu_time_us":47527,"wal-append.run_wall_time_us":1463634}]]}
W20260709 13:02:37.435303  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 101562us
I20260709 13:02:37.501348  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.502679  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:37.505577  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.505810  1534 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.504698  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:37.466923  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:37.465556  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.468022  1526 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:37.507925  1606 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:37.469372  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:37.471012  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:37.509892  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.481166  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:37.457118  4358 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:02:37.455021  1681 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.462728  4775 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.469938  4641 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:37.455724  1530 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:37.496411  1603 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.524356  1529 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:37.524299  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.525249  1606 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:37.430414  4715 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.482458  4608 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.511781  1607 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:37.512856  1535 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:37.424402  4769 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.457914  4827 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:37.452446  4700 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.520051  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:37.510708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43867.6us
I20260709 13:02:37.470412  4576 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:37.496888  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56111.8us
I20260709 13:02:37.501236  4597 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.482967  4753 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:37.484547  4728 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:37.459817  4679 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:02:37.586189  4679 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:37.542217  1603 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:37.544556  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:37.590139  1610 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.590312  1680 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:37.506748  4483 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.591423  4483 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:37.563298  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.518002  4824 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:37.592353  4824 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:37.592897  4824 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.592562  4483 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.593076  1606 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:02:37.496320  4787 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.518671  4611 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.485534  4311 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:02:37.521543  4606 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:37.523700  4802 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.568418  1681 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:02:37.523640  4772 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:37.547060  4704 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:02:37.566974  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:37.577564  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:37.579900  4839 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:37.580456  4700 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.581954  4769 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.563964  4660 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.584589  4358 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:37.584671  4842 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:37.564374  4715 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.591508  1610 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:37.608420  4606 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.495002  4734 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:02:37.527137  4783 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.597455  1602 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:37.602527  1608 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:37.556207  4775 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:37.506978  4756 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.609879  2178 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:37.611601  4365 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.612692  4727 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.614264  4716 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:37.615011  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.645522  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.644876  4828 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:37.629810  4606 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.614733  4650 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.615087  4772 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:37.648413  4365 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.650348  4772 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.519709  4530 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.608659  4802 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:37.640816  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 73899.5us
W20260709 13:02:37.641752  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64266.3us
I20260709 13:02:37.656701  4802 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.630251  4748 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.597965  4597 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.640990  4837 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:02:37.629122  4660 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.619829  4704 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.629397  4358 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:37.655227  4747 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:37.655599  4613 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:37.651724  4828 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:37.649315  4554 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:37.750768  1604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.045s
W20260709 13:02:37.751499  1604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.016s	sys 0.045s
I20260709 13:02:37.734685  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:37.754544  1527 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:02:37.642284  4844 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.624377  4700 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:37.735298  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:37.737484  4748 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:37.721953  2177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.022s	sys 0.010s
I20260709 13:02:37.767151  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1633) took 1172 ms. Trace:
I20260709 13:02:37.753661  4576 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.741832  4597 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.764418  4740 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.775339  1604 rpcz_store.cc:276] 0709 13:02:36.594796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.598180 (+  3384us) service_pool.cc:224] Handling call
0709 13:02:36.645435 (+ 47255us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:36.645792 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.645817 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.686220 (+ 40403us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.808739 (+122519us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18003cb500. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:37.241613 (+432874us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.752074 (+510461us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.752390 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.752556 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.752613 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:37.766665 (+ 14052us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.766870 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70631,"prepare.queue_time_us":112212,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":15344,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":27040,"spinlock_wait_cycles":2923904,"thread_start_us":947788,"threads_started":2,"wal-append.queue_time_us":718132}
W20260709 13:02:37.770038  2177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.022s	sys 0.011s
I20260709 13:02:37.836449  1606 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.835659  1607 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:37.838455  1607 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:02:37.815905  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 295966us
I20260709 13:02:37.817600  1604 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 13:02:37.821045  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.012s
W20260709 13:02:37.821511  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 86345.7us
I20260709 13:02:37.841966  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:37.842664  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.013s	sys 0.012s
W20260709 13:02:37.843083  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 535172us
I20260709 13:02:37.826021  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1632) took 1231 ms. Trace:
I20260709 13:02:37.843901  1605 rpcz_store.cc:276] 0709 13:02:36.594471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.597347 (+  2876us) service_pool.cc:224] Handling call
0709 13:02:36.597682 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.597943 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:37.277881 (+679938us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.822126 (+544245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.822217 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.822278 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.822365 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.822525 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":755414,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":5903,"thread_start_us":1130469,"threads_started":2}
W20260709 13:02:37.845348  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.755864  1532 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:37.779935  4554 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:37.863772  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.854156  4530 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.869218  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.872525  4530 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.873741  4826 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.874589  4826 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.875177  4530 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:37.879508  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1635) took 1280 ms. Trace:
I20260709 13:02:37.790634  4747 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:02:37.858348  4641 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.778322  4844 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.765414  4775 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.855731  4849 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:37.888816  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.879961  1609 rpcz_store.cc:276] 0709 13:02:36.599639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.627652 (+ 28013us) service_pool.cc:224] Handling call
0709 13:02:36.628042 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.628396 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.628438 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.629020 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.149763 (+520743us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4800240258. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:02:37.274902 (+125139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.274962 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.275064 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.870174 (+595110us) raft_consensus.cc:1685] finished
0709 13:02:37.870200 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.879444 (+  9244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16819,"raft.run_cpu_time_us":2829,"raft.run_wall_time_us":489527,"spinlock_wait_cycles":41571072,"thread_start_us":645511,"threads_started":1,"wal-append.queue_time_us":791010}
I20260709 13:02:37.830412  4740 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.896489  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:37.904575  1684 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:02:37.904915  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.900919  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 160649us
W20260709 13:02:37.907157  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.920223  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.930431  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.909965  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 397577us
I20260709 13:02:37.932356  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:37.869467  4846 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:37.939616  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:37.940773  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.016s	sys 0.015s
W20260709 13:02:37.941184  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.016s	sys 0.015s
I20260709 13:02:37.937444  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:37.937758  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.942728  1609 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.840793  4358 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.879623  4737 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:02:38.003333  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1331) took 1325 ms. Trace:
W20260709 13:02:37.999193  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 128093us
I20260709 13:02:38.005945  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:37.992864  1605 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:37.998255  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58716.2us
I20260709 13:02:38.004019  1528 rpcz_store.cc:276] 0709 13:02:36.678258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.714883 (+ 36625us) service_pool.cc:224] Handling call
0709 13:02:38.003097 (+1288214us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540020a154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:38.003258 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560581504}
I20260709 13:02:37.862412  4748 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.902973  4756 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:38.020346  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:38.023171  1607 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.914661  4849 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:38.027839  4313 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.541s	user 0.015s	sys 0.002s
I20260709 13:02:37.938406  4530 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.035631  4862 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:38.014106  4311 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:38.037325  4856 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:38.040248  4737 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:38.041838  4650 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:38.048461  4817 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:38.050266  4863 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:38.050558  1605 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.892485  4828 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:37.909612  4608 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:02:38.056612  4787 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.059538  4860 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:38.060384  4756 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:38.061118  4554 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:38.070842  1609 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8.
I20260709 13:02:38.073616  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:38.215225  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 210272us
I20260709 13:02:38.216182  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:38.074506  1676 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:38.076537  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:37.893802  4641 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.083002  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:38.218206  1609 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:38.218382  1604 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.087057  1678 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.217893  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:38.219828  1609 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:38.220424  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:37.999794  4707 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:38.099448  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 158326us
I20260709 13:02:38.165773  4783 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:38.097971  4650 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:38.172531  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 166723us
I20260709 13:02:38.221644  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:38.221891  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:38.189525  4817 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:02:38.212981  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.090601  4824 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:38.239487  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.024340  4802 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:38.236743  1601 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:38.239176  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1675) took 1117 ms. Trace:
I20260709 13:02:38.240662  1679 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:38.223842  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:38.230054  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:38.250352  1602 rpcz_store.cc:276] 0709 13:02:37.121806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.642695 (+520889us) service_pool.cc:224] Handling call
0709 13:02:37.644806 (+  2111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.648857 (+  4051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.649057 (+   200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.653515 (+  4458us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.891478 (+237963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.934501 (+ 43023us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.934807 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.934899 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.238675 (+303776us) raft_consensus.cc:1685] finished
0709 13:02:38.238700 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.239110 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":954,"prepare.queue_time_us":42820,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":100603,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":3759,"thread_start_us":150300,"threads_started":1,"wal-append.queue_time_us":567350}
I20260709 13:02:38.229723  1684 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:38.167140  4311 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:38.253095  1684 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:38.225616  4772 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:02:38.284296  1678 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:38.292109  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:38.293044  1678 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:38.288177  1604 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:38.217860  4704 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.251394  4817 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.229110  4650 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.277159  1679 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:02:38.224062  4365 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 13:02:38.224246  4783 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.300676  1605 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:38.096747  4852 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.148s
W20260709 13:02:38.317693  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.225499  4641 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.227895  4787 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.236975  4740 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:38.326380  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47705.8us
I20260709 13:02:38.285910  4608 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:02:38.312302  4597 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.254448  4611 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:02:38.329031  4483 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:38.341553  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 155293us
I20260709 13:02:38.338312  4365 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.311133  4772 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:38.412899  4855 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:02:38.338038  4858 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:02:38.352898  4313 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:02:38.406527  4769 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:38.443125  4769 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:38.441556  4864 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:02:38.597746  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.014s
W20260709 13:02:38.692101  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.014s
I20260709 13:02:38.692427  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1518) took 1781 ms. Trace:
W20260709 13:02:38.692622  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 681733us
I20260709 13:02:38.693974  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:38.692951  1533 rpcz_store.cc:276] 0709 13:02:36.910914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.315821 (+404907us) service_pool.cc:224] Handling call
0709 13:02:37.367391 (+ 51570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.367891 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.367927 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.466242 (+ 98315us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b18001ab1e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a
0709 13:02:37.575599 (+109357us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:37.580665 (+  5066us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.884228 (+303563us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.884282 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.884373 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.691687 (+807314us) raft_consensus.cc:1685] finished
0709 13:02:38.691735 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.691995 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4591,"spinlock_wait_cycles":56677120,"thread_start_us":303206,"threads_started":1,"wal-append.queue_time_us":667376}
W20260709 13:02:38.348235  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62532us
W20260709 13:02:38.609707  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.706445  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.448307  4311 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.709298  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:38.710645  4888 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:38.613060  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.612470  4611 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:02:38.512564  4581 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.994s	user 0.013s	sys 0.003s
I20260709 13:02:38.733253  4581 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.451359  4313 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.521806  4772 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:38.783430  4313 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:38.785667  4313 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.525125  4802 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:38.506541  4817 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.513792  4824 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.562805  4844 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:38.333483  4849 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.500388  4850 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:38.440649  4858 consensus_queue.cc:1243] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:02:38.556507  4867 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 13:02:38.358129  4876 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:02:38.514348  4874 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.012s
W20260709 13:02:38.514235  4882 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:38.606307  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1670) took 1699 ms. Trace:
I20260709 13:02:38.638613  4856 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:38.521641  4606 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.003s
W20260709 13:02:38.644503  4827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.012s	sys 0.023s
I20260709 13:02:38.640146  4865 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:02:38.520226  4660 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.004s
I20260709 13:02:38.664352  1682 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:38.676591  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 265337us
I20260709 13:02:38.679445  4878 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:38.838066  4878 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.688206  4881 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:38.840955  4850 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:38.696210  4885 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.841868  4881 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:38.842439  4850 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.842972  4850 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:38.841260  4650 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:38.607247  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.028s	sys 0.052s
W20260709 13:02:38.844818  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.028s	sys 0.053s
I20260709 13:02:38.846227  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 136) took 1107 ms. Trace:
W20260709 13:02:38.700448  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60563.5us
I20260709 13:02:38.847337  4871 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.848133  4871 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.717830  4611 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:38.850375  4611 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:38.849782  4850 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:38.852011  4611 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.853467  4856 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:38.735466  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 380874us
I20260709 13:02:38.853812  4850 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:38.855602  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.857180  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:38.782270  4859 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:38.511077  4769 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:38.800964  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1527) took 1396 ms. Trace:
I20260709 13:02:39.166026  1534 rpcz_store.cc:276] 0709 13:02:37.404462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.544957 (+140495us) service_pool.cc:224] Handling call
0709 13:02:37.574988 (+ 30031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.578570 (+  3582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.578616 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.607992 (+ 29376us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.859614 (+251622us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:37.859670 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.859774 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.555728 (+695954us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:38.800072 (+244344us) raft_consensus.cc:1685] finished
0709 13:02:38.800128 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.800686 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3097,"raft.queue_time_us":39335,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":34711296,"thread_start_us":228345,"threads_started":1,"wal-append.queue_time_us":405491}
I20260709 13:02:38.820128  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1529) took 1415 ms. Trace:
I20260709 13:02:39.412097  1535 rpcz_store.cc:276] 0709 13:02:37.405060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.547314 (+142254us) service_pool.cc:224] Handling call
0709 13:02:37.547667 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.828910 (+281243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.828944 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.829536 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.130612 (+301076us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:38.130654 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.130769 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.819693 (+688924us) raft_consensus.cc:1685] finished
0709 13:02:38.819729 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.819952 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36359,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":89,"thread_start_us":529935,"threads_started":2,"wal-append.queue_time_us":483137}
I20260709 13:02:38.865725  4892 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:38.889132  4893 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:39.418331  4892 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:39.419239  4892 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.896579  4881 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:38.781329  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65567.3us
I20260709 13:02:38.841156  4878 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:38.833123  1603 rpcz_store.cc:276] 0709 13:02:36.906964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.590484 (+683520us) service_pool.cc:224] Handling call
0709 13:02:37.591060 (+   576us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.935431 (+344371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.935462 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:38.005112 (+ 69650us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.350680 (+345568us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:38.603604 (+252924us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.604954 (+  1350us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.605338 (+   384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.605528 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.605639 (+   111us) raft_consensus.cc:1685] finished
0709 13:02:38.605661 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.605953 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37578,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":10961,"raft.queue_time_us":82251,"raft.run_cpu_time_us":726,"raft.run_wall_time_us":11877,"thread_start_us":588506,"threads_started":2,"wal-append.queue_time_us":353954}
I20260709 13:02:38.862982  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:38.846685  1675 rpcz_store.cc:276] 0709 13:02:37.738857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.739040 (+   183us) service_pool.cc:224] Handling call
0709 13:02:37.739386 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.096735 (+357349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.096782 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.105238 (+  8456us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.845530 (+740292us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:38.845659 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.845793 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.845866 (+    73us) raft_consensus.cc:1685] finished
0709 13:02:38.845881 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.846128 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42495,"raft.queue_time_us":35470,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":37818,"thread_start_us":1085497,"threads_started":2,"wal-append.queue_time_us":342808}
I20260709 13:02:38.909870  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:38.892720  4608 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:39.488305  4608 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:39.489674  4608 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.491215  4608 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.853994  4611 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.493583  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:39.494827  4198 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.495232  4198 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.495429  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:38.818262  4313 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:38.967439  4880 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.546s	user 0.002s	sys 0.004s
I20260709 13:02:38.897269  4726 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:39.498772  4726 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:38.840860  4606 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:38.886816  4797 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:39.503623  4606 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:38.930652  4483 consensus_meta.cc:287] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.012s
I20260709 13:02:39.515477  4483 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:38.843010  4827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.013s	sys 0.024s
I20260709 13:02:38.854023  4856 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:38.889737  4865 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.851034  4871 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:39.085811  4311 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.547482  4311 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.100158  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1673) took 2149 ms. Trace:
I20260709 13:02:39.121690  4737 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:39.551298  4737 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:39.552577  4311 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.550938  1610 rpcz_store.cc:276] 0709 13:02:36.951054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.625553 (+674499us) service_pool.cc:224] Handling call
0709 13:02:37.625964 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.626498 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.626536 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.630153 (+  3617us) log.cc:844] Serialized 52 byte log entry
0709 13:02:39.095923 (+1465770us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18000cc280. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:39.096928 (+  1005us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:39.097007 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.097109 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.099458 (+  2349us) raft_consensus.cc:1685] finished
0709 13:02:39.099481 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.099857 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26830,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":12975488,"thread_start_us":594,"threads_started":1,"wal-append.queue_time_us":1451012}
I20260709 13:02:39.552786  4737 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.130666  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:39.151818  4885 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:39.152537  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.158558  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.179108   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.181440  4597 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.195755  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1647) took 2254 ms. Trace:
I20260709 13:02:39.211516  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.223419  4908 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.229502  4907 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:39.230432  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.234365  4888 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:39.243391  4909 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.562870  4597 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.564253  4909 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.564442  4885 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.259817  1683 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:39.265174  4581 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.566742  4885 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.567143  4581 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.568300  4907 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.569650  4581 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.570399  4581 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.570595  4907 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.571025  4581 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.571347  4907 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.571476  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:39.277033  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1379) took 1191 ms. Trace:
I20260709 13:02:39.572268  1679 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:39.572991  4888 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:39.573680  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.574141  4909 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.574717  4909 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.564248  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:39.575763  1648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.154s (SENT) [suppressed 11 similar messages]
I20260709 13:02:39.572233  1682 rpcz_store.cc:276] 0709 13:02:38.085580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.239894 (+154314us) service_pool.cc:224] Handling call
0709 13:02:38.283687 (+ 43793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.837361 (+553674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.276675 (+439314us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400404a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:39.276962 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762509056}
I20260709 13:02:39.566757  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:39.286037  4824 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.290228  4783 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:39.291958  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1656) took 2150 ms (client timeout 1923 ms). Trace:
W20260709 13:02:39.319921  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1649) took 2361 ms (client timeout 3080 ms). Trace:
I20260709 13:02:39.523836  4865 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:39.345451  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.347935  4707 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:39.350015  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:39.366554  4650 consensus_meta.cc:287] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.005s
W20260709 13:02:39.368258  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.580873  1608 rpcz_store.cc:269] 0709 13:02:36.958076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.505278 (+547202us) service_pool.cc:224] Handling call
0709 13:02:39.319558 (+1814280us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400248954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:39.319730 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221284736}
W20260709 13:02:39.591876  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.391367  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1681) took 2057 ms. Trace:
I20260709 13:02:39.396669  4848 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:39.422250  4892 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:39.422899  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.598575  4908 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.601222  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:39.423182  1647 connection.cc:256] RPC call timeout handler was delayed by -1.4418210349999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:02:39.423475  4858 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.602972  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:39.423571  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.603574  4858 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.603932  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:39.604547  1676 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:39.433454  4828 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.436618  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:39.437510  4860 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:39.437932  4358 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.439145  4817 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.442631  4716 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:39.447373  4613 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:39.449751  4748 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.451002  4679 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:39.461237  4728 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.464432  4802 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.463843  1432 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.466135  4661 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.481483  4576 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:39.483065  4846 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:39.484736  4700 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:39.486421  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.486478  4739 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:39.495656  4198 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.500135  4726 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.501521  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1698) took 1610 ms. Trace:
I20260709 13:02:39.504612  4797 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:38.780530  4826 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.905s	user 0.004s	sys 0.023s
I20260709 13:02:39.508451  4606 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.559345  4737 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.575853  1684 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:39.577370  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:39.560238  1606 rpcz_store.cc:276] 0709 13:02:36.941268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.593868 (+652600us) service_pool.cc:224] Handling call
0709 13:02:37.836207 (+242339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.836994 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.195349 (+1358355us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003be2d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:39.195583 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556654464}
I20260709 13:02:39.575307  4909 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:39.325016  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.580823  1601 rpcz_store.cc:269] 0709 13:02:37.141233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.365624 (+224391us) service_pool.cc:224] Handling call
0709 13:02:39.291446 (+1925822us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540030a2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:39.291751 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798207360}
I20260709 13:02:39.597820  4707 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:39.597705  4848 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.592850  1607 rpcz_store.cc:276] 0709 13:02:37.334326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.839064 (+504738us) service_pool.cc:224] Handling call
0709 13:02:37.839311 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.025785 (+186474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.390830 (+1365045us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400172ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:39.391165 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422070144}
W20260709 13:02:39.613480  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.562253  4313 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:39.780642  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 203347us
W20260709 13:02:39.776381  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.744268  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:39.605914  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:39.744874  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:39.575361  4888 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:39.795423  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 300112us
W20260709 13:02:39.740733  1560 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:37403 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:37403 timed out after 15.000s (SENT)
W20260709 13:02:39.816553  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 223173us
I20260709 13:02:39.838714  1609 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:39.591221  4311 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.777766  4613 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:39.776302  1680 rpcz_store.cc:276] 0709 13:02:37.890918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.891126 (+   208us) service_pool.cc:224] Handling call
0709 13:02:37.908604 (+ 17478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.914859 (+  6255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.914905 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.938683 (+ 23778us) log.cc:844] Serialized 52 byte log entry
0709 13:02:38.286978 (+348295us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:38.287021 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.287090 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.953593 (+666503us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:39.501005 (+547412us) raft_consensus.cc:1685] finished
0709 13:02:39.501033 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.501354 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5823,"raft.queue_time_us":150435,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":19717888,"thread_start_us":167499,"threads_started":1,"wal-append.queue_time_us":318918}
I20260709 13:02:39.844959  1678 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:39.777182  4716 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:39.777210  4797 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:39.844412  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:39.872074  1684 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:39.872372  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56467.3us
I20260709 13:02:39.616811  4650 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.606123  4858 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.777802  4908 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.876555  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.807549  4826 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.779844  4597 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.880553  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:39.880643  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.878154  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.843837  4892 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:39.689713  4907 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.607017  4783 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
I20260709 13:02:39.606727  4824 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.889569  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.877781  4888 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:39.606197  4828 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.597707  4870 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.303s
I20260709 13:02:39.875909  4581 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.869758  4860 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.869470  4817 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.906240  4919 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.907361  1602 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:39.908568  4726 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.843982  4606 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.866153  4679 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.872772  4802 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.843446  4358 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.020884  1601 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.100181  4483 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:40.113057  4483 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:39.940045  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:39.987795  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.911079  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:40.120560  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.061353  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 188163us
I20260709 13:02:39.877657  4885 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.970724  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:39.979239  1608 raft_consensus.cc:2376] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 8. Re-sending same reply.
W20260709 13:02:40.133605  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 193707us
W20260709 13:02:39.979416  1464 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b40 after lost signal to thread 434
I20260709 13:02:40.126313  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:40.136541  1464 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d40 after lost signal to thread 1467
W20260709 13:02:40.138278  1464 debug-util.cc:398] Leaking SignalData structure 0x7b08002be360 after lost signal to thread 1559
I20260709 13:02:40.138896  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:40.117735  4608 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.006s
I20260709 13:02:39.904018  4908 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.154686  4908 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.156903  4907 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.157198  4908 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.130259  4888 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.158023  4848 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.158403  4888 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.116904  4797 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.159245  4907 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.160069  4797 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.159875  4907 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.158034  4885 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.135059  4597 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.162907  4783 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.162798  4597 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.163596  4783 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.100471  4716 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.165216  4716 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.165637  4597 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.165848  4783 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.141917  4613 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.142956  4909 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.144618  4700 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.167629  4613 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.167435  4700 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.169843  4700 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.166380  4597 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.172581  4850 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:40.172508  4597 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:40.126073  4576 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.149955  4358 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.150419  4748 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.189659  4748 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.193053  4783 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.193922  4783 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.195427  4748 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.151710  4606 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.153388  4860 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.016721  4650 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.197578  4817 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.199326  4650 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:39.899209  4827 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.255s
I20260709 13:02:40.200435  4802 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.045368  1432 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 9, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.202168  4828 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.052937  4865 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.162149  4907 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.146414  4915 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.204309  4679 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.203091  1432 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 3 to 10, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.204535  4915 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.207027  4915 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.207006  1432 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:40.179441  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080037da20 after lost signal to thread 1634
W20260709 13:02:40.178869  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44495.6us
I20260709 13:02:40.127689  4483 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:40.184968  4576 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.185578  1535 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:40.155413  4707 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.188532  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.026906  4892 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:39.899775  4311 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.213862  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080030efc0 after lost signal to thread 1708
I20260709 13:02:40.188112  4198 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:40.226567  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080034f8e0 after lost signal to thread 2236
W20260709 13:02:40.227005  1464 debug-util.cc:398] Leaking SignalData structure 0x7b0800380520 after lost signal to thread 2237
I20260709 13:02:40.209679  4909 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.255615  4483 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:40.263691  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.176710  4908 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.256310  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.265722  1603 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:40.220125  4915 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.266820  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.251555  4581 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:40.275199  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 86808.3us
I20260709 13:02:40.285209  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.286098  1533 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:40.174075  4856 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:40.287833  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.278345  4581 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.276944  4783 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:40.296274  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 109318us
I20260709 13:02:40.296180  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.280369  4927 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.263757  4909 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.265479  4483 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:40.301110  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.257521  4919 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.310420  1432 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 2 to 10, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.298223  4581 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.315275  1535 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.279174  4311 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:40.283565  4908 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.320693  1531 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:40.320267  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1711) took 1094 ms. Trace:
I20260709 13:02:40.321424  4576 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.323472  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.325208  4892 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.328289  1681 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.329703  1680 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:40.300348  4871 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.337985  1534 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:40.326406  1683 rpcz_store.cc:276] 0709 13:02:39.225470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.577559 (+352089us) service_pool.cc:224] Handling call
0709 13:02:39.790368 (+212809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.835339 (+ 44971us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:40.260104 (+424765us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.315757 (+ 55653us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.316019 (+   262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.316094 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:40.316151 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.316219 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.316341 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24156,"prepare.queue_time_us":185719,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":2581,"spinlock_wait_cycles":19329408,"thread_start_us":387956,"threads_started":2}
I20260709 13:02:40.341356  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.342032  1528 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.342813  1610 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:40.343840  4915 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.342097  1531 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:40.340284  4856 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.357841  4908 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.360605  4576 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:40.344355  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.375586  1601 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:40.339881  4597 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:40.392872  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 123943us
I20260709 13:02:40.372433  4707 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.401028  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.344420  4915 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.410642  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.411772  4915 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:40.412045  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88636.9us
I20260709 13:02:40.414326  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.331612  4927 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.416954  4311 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:40.418010  4871 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:40.418443  4927 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:40.418525  4871 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.420179  1432 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.422219  1432 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 8, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 8 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.425971  4926 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:40.411820  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.429152  1601 raft_consensus.cc:2410] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:40.427138  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.430187  1608 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:40.460021  1528 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:40.467651  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.468429  1607 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.468490  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.469555  1601 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.471990  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.472381  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.473484  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.412156  4885 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.487128  1601 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.457006  4892 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.492950  1532 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:40.457913  4198 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.406265  4907 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:02:40.494652  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1710) took 1566 ms. Trace:
I20260709 13:02:40.502072  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.491891  1606 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:40.502969  1601 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.490065  1432 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 8 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.507869  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.517661  1534 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:40.519404  1680 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:40.516629  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.499439  1677 rpcz_store.cc:276] 0709 13:02:38.928207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.576080 (+647873us) service_pool.cc:224] Handling call
0709 13:02:39.576416 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.866395 (+289979us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:40.212330 (+345935us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.290882 (+ 78552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.290935 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:40.290985 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.419614 (+128629us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b1800257680. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419
0709 13:02:40.494378 (+ 74764us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:40.494448 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.494581 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36469,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":91,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6160,"spinlock_wait_cycles":598243072,"thread_start_us":339954,"threads_started":2,"wal-append.queue_time_us":89934}
I20260709 13:02:40.521252  1608 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:40.495031  4919 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.497640  4915 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.492118  4892 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:40.539089  4871 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.540678  4313 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.541160  4313 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:40.542188  4313 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.543664  4313 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.543339  1601 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:40.548753  1677 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:40.550230  4892 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.551450  1432 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.594919  1535 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:40.554188  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.595846  1603 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:40.555419  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.556449  4483 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:40.557461  4358 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.559222  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.560607  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.560912  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.561371  4876 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.561766  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:40.563602  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.564258  4888 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.568392  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.605247  2212 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:40.569119  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.570427  4581 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.600648  1527 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:40.612563  1534 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:40.613221  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.572458  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:40.572676  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:40.573275  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1709) took 1645 ms. Trace:
I20260709 13:02:40.574039  4893 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:40.561797  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 147562us
W20260709 13:02:40.580433  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46337.9us
I20260709 13:02:40.585440  1607 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:40.598105  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:40.539155  4924 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.003s
I20260709 13:02:40.599453  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.600734  1432 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 4 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:40.595415  4661 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.606599  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.606873  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.607409  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.625741  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.625898  1601 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:40.618110  1608 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.618310  1684 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:40.614532  1679 rpcz_store.cc:276] 0709 13:02:38.927893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.574956 (+647063us) service_pool.cc:224] Handling call
0709 13:02:39.575309 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.141515 (+566206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.141560 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.141612 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:40.141644 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.573039 (+431395us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400034b54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:40.573095 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.573218 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291777920}
I20260709 13:02:40.627835  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.628499  1574 leader_election.cc:400] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:02:40.625732  1678 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:40.620762  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.606078  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.629727  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.630311  1677 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.626024  1535 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:40.608915  1606 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:40.633852  1532 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:40.623594  1602 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.628818  1574 leader_election.cc:403] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:02:40.636600  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.637662  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.632843  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:40.638255  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.638831  1528 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:40.642207  1605 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:40.644335  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.650012  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.650054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.651692  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.654044  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.656291  1608 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:40.656409  1603 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:40.662389  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.663057  1607 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:40.664181  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.628818  4856 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:02:40.666657  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.666989  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:40.666155  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 94529.5us
I20260709 13:02:40.668350  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.643605  4613 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:02:40.678515  1526 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:40.618184  4358 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.653193  4707 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.685309  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.684059  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.634038  4797 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:40.685408  1432 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 9, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.631424  4661 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.669803  1606 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.686913  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.700052  1683 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:40.688066  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:40.688663  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.701503  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:40.689100  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56844.6us
I20260709 13:02:40.689285  1677 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:40.689819  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.690605  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.683620  1526 pending_rounds.cc:85] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 5
I20260709 13:02:40.693715  1602 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:40.703567  1526 pending_rounds.cc:107] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:40.704628  1526 raft_consensus.cc:2889] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.705047  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.705888  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.706606  4581 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.705938  1679 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:40.708006  4871 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:40.708248  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52504.7us
I20260709 13:02:40.705190  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1385) took 1776 ms. Trace:
I20260709 13:02:40.709126  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.709932  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.711231  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.710903  1679 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:40.714445  1529 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:40.706554  1607 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:40.717129  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.718240  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.718784  1607 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:02:40.719601  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.715276  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.723835  1603 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:40.713477  1678 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:40.725514  1607 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:40.708847  1682 rpcz_store.cc:276] 0709 13:02:38.928762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.577062 (+648300us) service_pool.cc:224] Handling call
0709 13:02:39.577423 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.596356 (+ 18933us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:39.809243 (+212887us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.263493 (+454250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.296897 (+ 33404us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.297045 (+   148us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:40.297080 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.297149 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.538548 (+241399us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:40.704918 (+166370us) raft_consensus.cc:1685] finished
0709 13:02:40.705023 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.705137 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17880,"prepare.queue_time_us":193690,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":4161,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":14168,"spinlock_wait_cycles":87222784,"thread_start_us":372499,"threads_started":1,"wal-append.queue_time_us":441331}
I20260709 13:02:40.724632  1602 raft_consensus.cc:2410] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:40.711802  1530 raft_consensus.cc:2376] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10. Re-sending same reply.
I20260709 13:02:40.712332  1499 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:40.734386  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.735648  1610 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:40.736429  1432 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 8 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.738611  4613 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.739239  1607 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:02:40.739645  1607 pending_rounds.cc:85] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 5
I20260709 13:02:40.739848  4797 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.742516  4797 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:40.742919  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.744724  4824 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.745304  4888 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.747237  4358 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.748615  4797 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:40.748914  4944 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:40.749090  4797 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:40.750028  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1662) took 1147 ms. Trace:
I20260709 13:02:40.750613  1605 rpcz_store.cc:276] 0709 13:02:39.602121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.605560 (+  3439us) service_pool.cc:224] Handling call
0709 13:02:40.749833 (+1144273us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b540003cfd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:40.749947 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814873984}
I20260709 13:02:40.752928  4358 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.753451  4358 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:40.754967  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.755626  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.696452  4608 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.691797  4707 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:40.756593  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.756942  4707 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.757266  1608 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.739885  1607 pending_rounds.cc:107] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:02:40.762023  1607 raft_consensus.cc:2889] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.738667  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:40.763146  1684 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:40.756075  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.755499  4358 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:40.766284  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 175222us
I20260709 13:02:40.768592  1604 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:40.634339  4876 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.760558  4916 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:40.778373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.748843  4909 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.784672  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.788829  1606 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:40.790598  1604 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:40.791472  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:40.791970  1603 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:40.792012  1601 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:40.788163  1432 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 3 to 6, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 6 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.775120  4888 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.798965  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:40.799731  1607 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:40.756085  4893 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:02:40.776671  4916 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:40.802547  1604 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:40.788276  4358 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.804834  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.787890  4824 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.810307  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 101285us
I20260709 13:02:40.811774  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.815153  1531 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:40.821576  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:40.823464  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.825722  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.829977  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.831671  1432 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 5 to 7, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.832842  4888 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.834049  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:40.818099  4931 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.819618  4311 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:40.836815  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.836272  4888 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.828011  4728 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.829120  4581 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.830468  4909 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:40.849776  1528 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:40.841706  1531 raft_consensus.cc:2376] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9. Re-sending same reply.
I20260709 13:02:40.819798  4824 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.836362  4919 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:40.818877  4358 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.870445  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.844748  4311 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.876955  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.843776  4888 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.880375  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.861824  4908 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:40.882373  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63166.5us
W20260709 13:02:40.883983  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 181541us
I20260709 13:02:40.884123  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.853528  4909 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.887414  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.888406  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.870321  4919 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.889358  1532 raft_consensus.cc:2376] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13. Re-sending same reply.
I20260709 13:02:40.890550  4597 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:40.896286  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.881544  4931 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:40.889672  4947 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:02:40.897724  4919 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.925094  4358 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:40.890185  4909 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.928174  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.929538  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.930975  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.884516  4921 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.883174  4311 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.903201  4597 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.903861  4931 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.919028  4907 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:40.919260  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.954564  1534 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:40.920310  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.920487  4892 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.886340  4783 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:40.865567  4916 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:40.890702  4581 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:40.995458  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 107107us
I20260709 13:02:40.996816  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:40.942602  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:40.962909  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:40.965835  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.942939  4921 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.971459  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.972998  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:40.977841  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.002771  1528 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:40.953733  4597 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.003923  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.957193  4931 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.009255  1532 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:40.957484  4907 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:41.006026  1601 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:41.001991  1526 raft_consensus.cc:2376] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13. Re-sending same reply.
I20260709 13:02:41.009021  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.005144  1602 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:41.020730  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:40.949471  4608 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:02:40.964313  4783 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:40.941581  4856 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:41.032778  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1708) took 2105 ms. Trace:
I20260709 13:02:41.026736  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:40.975306  1683 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:40.953087  4613 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:02:41.003724  4581 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:41.029548  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.054672  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.056075  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.007879  4916 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.045017  4824 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.026520  4576 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:41.049991  1528 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:41.006008  4921 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.037490  1681 rpcz_store.cc:276] 0709 13:02:38.927540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.935617 (+  8077us) service_pool.cc:224] Handling call
0709 13:02:39.436629 (+501012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.335553 (+898924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.029944 (+694391us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54003dfed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:41.032704 (+  2760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899804032}
W20260709 13:02:41.064985  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.013779  4876 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.023622  4907 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.047035  1604 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:41.068908  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.028187  4358 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:41.073153  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.035003  4783 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.072464  4576 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.072626  4313 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:41.072757  4953 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:41.098331  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.078517  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.080268  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:41.101220  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.087431  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:02:41.088937  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 146418us
I20260709 13:02:41.102892  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.059527  4581 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.107770  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.108644  1528 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:41.091787  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.110136  1602 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:41.082989  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.110713  1605 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.101303  1530 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:41.106454  1604 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:41.085532  4824 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.101263  1601 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.117825  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 97204.5us
I20260709 13:02:41.091284  4848 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.117990  1610 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:41.123435  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.097036  4576 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.128505  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:41.129956  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.130872  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:41.131062  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:41.093160  4313 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:41.140982  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.141469  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 159) took 1259 ms. Trace:
I20260709 13:02:41.143390  1528 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.150848  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.155422  1601 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:41.165421  1610 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:41.119123  4824 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:41.183525  4797 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.184357  4824 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.184810  4797 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.112736  4871 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:41.141865  1609 rpcz_store.cc:276] 0709 13:02:39.882594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.882859 (+   265us) service_pool.cc:224] Handling call
0709 13:02:40.131454 (+248595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:40.189239 (+ 57785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.189283 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:40.189959 (+   676us) log.cc:844] Serialized 52 byte log entry
0709 13:02:40.287628 (+ 97669us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:40.397413 (+109785us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.430546 (+ 33133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.430617 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.430657 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:40.430671 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.141311 (+710640us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b540003d4d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:41.141420 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31957,"prepare.queue_time_us":222472,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2066,"raft.queue_time_us":74646,"raft.run_cpu_time_us":531,"raft.run_wall_time_us":7254,"spinlock_wait_cycles":196749056,"thread_start_us":191462,"threads_started":2,"wal-append.queue_time_us":143773}
I20260709 13:02:41.174562  1605 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:41.179119  4313 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.104769  4707 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:41.194590  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:41.195109  4958 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:02:41.189554  4929 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:41.208424  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:41.208906  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.139828  4909 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.211913  1605 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:41.127377  4848 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.140717  4826 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 13:02:41.218973  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.221992  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:41.226018  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 77264.5us
W20260709 13:02:41.237313  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.253413  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.253538  1609 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:41.256209  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.256943  1605 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:41.268694  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.274293  1676 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.246282  4885 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.279227  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.280440  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:41.282673  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 133199us
I20260709 13:02:41.222996  4964 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:41.210541  4871 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.279886  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.296715  1526 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:41.310302  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.310943  1681 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:41.317058  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.325350  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.326417  1605 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:41.295629  4313 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:41.333516  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.298383  4964 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.329761  1528 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:41.344734  1605 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:41.351748  2210 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:41.354432  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:41.342106  4957 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:02:41.328466  4661 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.352850  1528 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:41.370608  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.371971  1605 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:02:41.347064  4964 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:41.380792  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.381510  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
W20260709 13:02:41.377547  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81195.6us
I20260709 13:02:41.382102  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.389791  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.394654  1605 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:41.330248  4971 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:02:41.397969  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.400708  4850 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:41.407313  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.407204  4581 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.354882  4931 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:41.408298  4970 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:02:41.412513  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63043.8us
I20260709 13:02:41.398957  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.422426  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.392938  4826 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.376748  4661 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:02:41.427456  4908 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.532s	user 0.004s	sys 0.007s
I20260709 13:02:41.428634  4848 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:41.432061  4974 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:41.431504  4907 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.432343  4921 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.434379  4581 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.436916  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.377254  4930 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:02:41.484889  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.508740  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 116708us
I20260709 13:02:41.509176  1681 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:41.466747  1530 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:41.499425  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79061.2us
I20260709 13:02:41.510705  1605 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:41.421049  4969 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.532407  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.532819  1529 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:41.534363  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 135474us
I20260709 13:02:41.557449  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.590464  1681 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.500974  4892 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 13:02:41.472795  4909 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.465428  4661 consensus_queue.cc:1243] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:41.531342  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:41.555692  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.597489  1684 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.465095  4826 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.518821  4930 consensus_queue.cc:1243] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:41.473421  4908 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:41.591106  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:41.566691  1574 connection.cc:256] RPC call timeout handler was delayed by -3.6056275219999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 13:02:41.566912  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.567471  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.568197  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.437539  4978 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:02:41.589759  1608 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:41.669965  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.653076  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.673702  1608 pending_rounds.cc:85] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 7
W20260709 13:02:41.674229  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.653419  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143023us
I20260709 13:02:41.674540  1608 pending_rounds.cc:107] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:41.674999  1608 raft_consensus.cc:2889] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.649257  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.669904  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.670392  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.588089  1604 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:41.587055  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.587504  1603 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:41.587541  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:41.570796  4597 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
I20260709 13:02:41.675897  1609 raft_consensus.cc:2376] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13. Re-sending same reply.
I20260709 13:02:41.683600  1610 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:41.680495  1607 raft_consensus.cc:2376] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10. Re-sending same reply.
W20260709 13:02:41.685981  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.562678  4907 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.690033  1675 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:41.649173  4888 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 13:02:41.693051  1677 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:41.695940  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.704279  1605 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:41.561193  4728 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.699s	user 0.006s	sys 0.005s
I20260709 13:02:41.694089  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.710589  1679 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:41.710776  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.568325  4797 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.568595  4859 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.661855  4974 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:02:41.569716  4972 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:02:41.696623  4876 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.697620  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.726079  1678 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:41.661612  4824 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.701423  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.701872  4892 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:41.702586  4960 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.684732  1602 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:02:41.728520  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.693317  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:41.567788  4856 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.557160  4968 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:41.709204  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 118162us
I20260709 13:02:41.653826  4971 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:41.647384  4921 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.714716  1574 leader_election.cc:400] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 4 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 4. Current term is 5.
I20260709 13:02:41.719388  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.689638  4581 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.723712  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.652757  4576 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.708495  4848 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:41.711970  4888 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.691738  4597 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.733305  4968 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:41.752658  4968 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.753986  4597 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.720515  4608 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.733911  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.754806  4608 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.756917  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.757125  4608 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.758155  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:41.735589  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.718390  4716 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.588578  4969 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.765234  4969 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:41.766027  4311 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.003s
I20260709 13:02:41.766461  4311 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.767464  1532 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:41.768150  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.770989  4943 log.cc:927] Time spent T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.553s	user 0.000s	sys 0.003s
W20260709 13:02:41.773524  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 64947.9us
I20260709 13:02:41.774259  4885 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:41.774888  4885 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.776230  4919 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.002s
I20260709 13:02:41.776626  4921 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:41.776819  4919 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.777206  4921 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:41.778179  4921 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.779099  4919 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.779747  4919 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:41.780174  4931 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.743779  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.738837  4856 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.748785  4848 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.750564  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.800652  1683 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:41.721196  4797 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.722860  4859 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.772445  4581 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.758319  4978 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:41.780439  1533 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:41.730949  4876 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:41.780864  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.830026  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.830610  1608 raft_consensus.cc:2376] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10. Re-sending same reply.
I20260709 13:02:41.758772  4971 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:41.782491  4824 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.731650  4960 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.839883  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.840798  1683 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:41.840832  1609 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:41.783327  1684 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:41.785389  4597 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.785492  4888 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.786027  1531 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:41.786646  4871 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:41.742061  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.864354  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.742923  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.865599  1607 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:41.774462  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:41.742624  4576 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.760190  1677 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:41.829325  4978 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.791517  1675 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:02:41.794508  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 100966us
I20260709 13:02:41.801641  1681 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:41.788638  4716 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:41.809155  4783 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.001s
I20260709 13:02:41.816507  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1552) took 1257 ms. Trace:
I20260709 13:02:41.818463  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:41.821908  4856 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.831529  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.874722  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.832530  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.768625  4311 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.837210  1602 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:41.834354  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.825016  4919 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:41.827783  4581 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:41.866940  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 173777us
I20260709 13:02:41.869103  1678 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:41.839147  4797 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.876245  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:41.879134  1610 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:41.878820  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.898193  1683 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.899688  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.901492  1607 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.903199  1606 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:41.905210  1534 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:41.873965  1527 rpcz_store.cc:276] 0709 13:02:40.559089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.625779 (+ 66690us) service_pool.cc:224] Handling call
0709 13:02:40.643508 (+ 17729us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:02:40.682536 (+ 39028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.682571 (+    35us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:02:40.695984 (+ 13413us) log.cc:844] Serialized 104 byte log entry
0709 13:02:41.236913 (+540929us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800202cc0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:41.294836 (+ 57923us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:41.329295 (+ 34459us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.515364 (+186069us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.576615 (+ 61251us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.577157 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.577353 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.776941 (+199588us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b1800202cc0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:41.816130 (+ 39189us) raft_consensus.cc:1685] finished
0709 13:02:41.816164 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.816418 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89516,"prepare.queue_time_us":51319,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":3265,"raft.queue_time_us":108645,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":18816,"spinlock_wait_cycles":66368512,"thread_start_us":147562,"threads_started":2,"wal-append.queue_time_us":633785}
I20260709 13:02:41.906631  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.870736  4978 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.834419  4964 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.912827  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.878813  4859 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.913522  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.876840  4597 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:41.899412  4581 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.915443  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:41.979274  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 204874us
I20260709 13:02:41.965916  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.961509  1607 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
W20260709 13:02:41.978308  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65670.6us
I20260709 13:02:41.899278  4613 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:41.962172  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:41.933706  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.979625  1602 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.981186  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.960136  1683 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:41.982898  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.968369  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:41.981986  1603 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 6.
I20260709 13:02:41.985531  4848 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:41.985760  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:41.986462  1603 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:41.987422  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.989279  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1577) took 1069 ms. Trace:
I20260709 13:02:41.989682  1532 rpcz_store.cc:276] 0709 13:02:40.936264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.022811 (+ 86547us) service_pool.cc:224] Handling call
0709 13:02:41.039994 (+ 17183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.767826 (+727832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.989063 (+221237us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400319f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:41.989223 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672572288}
I20260709 13:02:41.990798  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.991173  1603 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:41.982229  4613 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:41.951570  4826 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:41.993276  4613 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:41.993688  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.994495  1530 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:41.995802  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:41.947458  4992 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:41.952908  4960 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:41.955173  4964 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.000975  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.001514  4951 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:42.002027  4951 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:41.999687  1530 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:42.002959  4951 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:42.004417  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:42.005213  1530 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:42.006000  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.006739  1530 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.007488  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.008231  4707 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:42.009177  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.011492  1603 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:42.012223  4921 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:41.940322  4885 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.012902  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.014006  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.014211  4885 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.015781  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.016561  1528 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.017393  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.018440  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.019692  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.991902  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:41.969358  4876 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.022121  1530 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:42.001416  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.023335  1528 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:41.949820  4971 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.015066  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.033869  1603 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.034498  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:41.915542  4916 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.001s
I20260709 13:02:42.039656  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.041343  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.032691  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.030928  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
W20260709 13:02:42.036561  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.037060  1602 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:42.046027  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:41.877382  4783 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.035401  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.044276  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.047006  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.050769  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.037233  1607 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:41.961549  4968 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.057422  1609 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:42.110713  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.096858  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.059334  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.090557  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:42.113560  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68751us
I20260709 13:02:42.114405  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.113370  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1570) took 1195 ms. Trace:
I20260709 13:02:42.113087  1604 raft_consensus.cc:2376] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9. Re-sending same reply.
I20260709 13:02:42.116953  1528 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:42.113322  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:42.116978  1533 rpcz_store.cc:276] 0709 13:02:40.918052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.918238 (+   186us) service_pool.cc:224] Handling call
0709 13:02:40.918630 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.828443 (+909813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.113090 (+284647us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400319554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:42.113313 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981451520}
I20260709 13:02:42.118337  1603 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:42.095059  1535 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:41.952541  4919 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.057687  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.113957  1534 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:42.119300  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.046023  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.119549  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.126865  1533 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:42.038002  4908 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.127907  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.127467  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.122638  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.131522  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.071776  4916 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.132797  1610 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:42.058749  4960 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.050354  4951 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.069922  4597 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.104557  4871 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:42.132575  4824 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.098492  4848 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:42.119882  4311 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.144419  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.141584  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.132947  4707 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:42.089033  4716 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.120098  4975 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:02:42.143566  4859 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.149334  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:42.044003  4885 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:02:42.137070  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.151969  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.132153  4888 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.184065  1610 raft_consensus.cc:2410] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:42.141394  1603 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:42.153971  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:42.044240  4978 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.185508  1528 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:42.146592  4999 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.010s
I20260709 13:02:42.156178  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:42.145689  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99760.2us
I20260709 13:02:42.135306  4908 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.144886  4661 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.144284  4931 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:42.223534  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74300.6us
I20260709 13:02:42.224608  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:42.172932  4916 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.173280  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:42.174391  4998 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.211s	user 0.001s	sys 0.003s
I20260709 13:02:42.174919  4985 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.174913  4995 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.176435  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.177891  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.182870  1607 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.147229  4783 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.187237  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.253153  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.254191  1603 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:42.079977  4976 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:02:42.181921  4859 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.190801  4888 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.256367  4888 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:42.259335  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.197680  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.197885  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.260733  1610 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.200541  1605 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.141132  4358 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:42.143793  4826 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:42.219276  4824 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:42.268802  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:42.242650  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70021.1us
W20260709 13:02:42.243595  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1572) took 1304 ms (client timeout 1619 ms). Trace:
I20260709 13:02:42.270722  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:42.270328  1535 rpcz_store.cc:269] 0709 13:02:40.918690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.920020 (+  1330us) service_pool.cc:224] Handling call
0709 13:02:42.223175 (+1303155us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540035a7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:42.223307 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505695488}
I20260709 13:02:42.198462  4311 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.253167  1532 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.273013  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:42.200846  4964 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:02:42.276182  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:42.278417  1603 pending_rounds.cc:85] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 4
I20260709 13:02:42.281432  1528 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.283527  1603 pending_rounds.cc:107] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:02:42.283854  1603 raft_consensus.cc:2889] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:42.250169  4960 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.247344  4931 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:42.296089  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 100033us
I20260709 13:02:42.291620  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1568) took 1374 ms. Trace:
W20260709 13:02:42.289763  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 92174.1us
I20260709 13:02:42.293001  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.260464  4859 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.298746  1533 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:42.300957  1607 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 7.
I20260709 13:02:42.302851  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1696) took 1120 ms. Trace:
I20260709 13:02:42.303267  1601 rpcz_store.cc:276] 0709 13:02:41.182104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.567439 (+385335us) service_pool.cc:224] Handling call
0709 13:02:41.587321 (+ 19882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.835832 (+248511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.835868 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.870677 (+ 34809us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.972827 (+102150us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:41.972887 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.293667 (+320780us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001711d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:42.293697 (+    30us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.293732 (+    35us) raft_consensus.cc:1685] finished
0709 13:02:42.293740 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.302786 (+  9046us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7233,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14447,"spinlock_wait_cycles":547271808,"thread_start_us":62536,"threads_started":1,"wal-append.queue_time_us":83829}
I20260709 13:02:42.304072  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.296862  1529 rpcz_store.cc:276] 0709 13:02:40.917368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.927845 (+ 10477us) service_pool.cc:224] Handling call
0709 13:02:42.291471 (+1363626us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54000fad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:42.291572 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388109568}
I20260709 13:02:42.298209  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.274534  4848 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.317435  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.282316  4597 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.273460  4311 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.343015  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1565) took 1452 ms. Trace:
I20260709 13:02:42.353917  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.288861  4876 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.285213  4995 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:42.274904  4985 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:42.313107  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 179731us
I20260709 13:02:42.322713  1533 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:42.360384  1531 rpcz_store.cc:276] 0709 13:02:40.890990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.891132 (+   142us) service_pool.cc:224] Handling call
0709 13:02:40.892328 (+  1196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.863199 (+970871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.342654 (+479455us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400070dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:42.342921 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054888192}
I20260709 13:02:42.314997  1527 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:42.367966  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.352558  4969 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.282998  4824 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.380312  1531 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:02:42.381059  1533 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.382503  5012 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.389247  4978 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:42.341918  4971 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:42.362949  4968 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.359302  4916 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.315069  4313 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:42.400255  4876 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.400517  5002 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:02:42.401530  5006 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:02:42.362409  4871 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:42.311743  4921 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:42.414067  4995 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.414813  4783 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:42.415199  5007 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:42.406741  5012 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.417065  1530 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:02:42.418843  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66812.3us
I20260709 13:02:42.450133  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:42.420284  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48331us
I20260709 13:02:42.421638  1527 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:42.451617  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.425737  1609 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:42.423902  1531 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:42.418643  4313 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.477653  4313 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:42.459726  4707 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:42.460708  4826 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:42.461580  5013 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:42.462356  4871 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:42.484330  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.424237  4931 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.468024  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:42.439515  4661 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.499622  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48070.4us
I20260709 13:02:42.495795  1610 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:02:42.509938  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59870.6us
I20260709 13:02:42.510911  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.512410  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.442113  4783 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.367413  4908 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:42.515537  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 271336us
I20260709 13:02:42.487138  5012 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.508898  4707 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:02:42.520519  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:42.540482  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 224163us
I20260709 13:02:42.541337  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.542011  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.509088  4876 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.532791  4968 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.515017  4613 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.484983  4871 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.518041  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.505556  4597 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:42.486327  4978 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:02:42.542857  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.543668  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.548290  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.558969  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.559639  1683 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:42.551486  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.509097  4859 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.560935  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.562183  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.563315  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.564469  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.567726  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.567199  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.546236  4716 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.546303  4826 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.574999  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.548692  4797 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.567112  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.551314  4968 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:42.608528  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 65067.8us
I20260709 13:02:42.611253  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.566504  4909 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.620832  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.621515  1683 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:42.618185  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.575604  4716 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.579900  4885 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.625097  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.578843  4797 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.576499  4826 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.574339  4597 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.575805  4876 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.634064  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:42.623733  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67618.3us
I20260709 13:02:42.645915  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.665377  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.622452  4358 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:42.670750  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.663702  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:42.695739  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70745.8us
I20260709 13:02:42.697793  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.699424  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.703004  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.634339  5014 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.683429  4707 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:42.670933  4996 log.cc:927] Time spent T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.721s	user 0.006s	sys 0.000s
I20260709 13:02:42.718866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.670388  4826 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:42.705053  4581 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.003s
I20260709 13:02:42.636013  4716 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.701220  4358 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.720142  4885 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:42.721801  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 179039us
W20260709 13:02:42.728209  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 215868us
I20260709 13:02:42.645335  4985 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.637866  5018 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.670544  4797 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.635586  5019 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.734485  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.717994  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.671120  5008 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.734905  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:42.736510  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 218533us
I20260709 13:02:42.740512  1683 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:42.732884  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.756508  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:42.756809  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53905us
I20260709 13:02:42.758417  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.759765  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.734815  4968 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.766417  4859 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.767416  4859 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.767902  4859 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:42.734717  4358 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.768326  4859 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.721267  5015 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.734055  4971 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:42.730458  4978 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.756753  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.734479  5018 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:42.778365  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:42.732851  4876 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.771370  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.784598  1601 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:42.783497  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.784929  1683 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:42.785074  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.790498  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.791024  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.783706  4985 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.792479  1683 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:42.772379  4969 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.787263  4876 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.806416  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.785877  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:42.730726  4581 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.794358  4975 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:42.811076  1535 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:42.780172  4885 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:42.813660  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:42.797536  5020 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:42.782215  4888 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:42.823369  1601 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.755877  4313 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.826038  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 126) took 1779 ms. Trace:
I20260709 13:02:42.810458  4975 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:42.786607  5018 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:42.829753  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 166109us
W20260709 13:02:42.830906  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45086.7us
I20260709 13:02:42.831746  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.798764  4971 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:42.826493  1526 rpcz_store.cc:276] 0709 13:02:41.046668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.414845 (+368177us) service_pool.cc:224] Handling call
0709 13:02:41.415236 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.508493 (+ 93257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.508521 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.556181 (+ 47660us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.862704 (+306523us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:41.862741 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.862805 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.555004 (+692199us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:42.822357 (+267353us) raft_consensus.cc:1685] finished
0709 13:02:42.822389 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.825977 (+  3588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3461,"raft.queue_time_us":113039,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":53335,"spinlock_wait_cycles":14700416,"thread_start_us":180266,"threads_started":1,"wal-append.queue_time_us":311925}
I20260709 13:02:42.835765  5019 raft_consensus.cc:2764] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:02:42.838989  5017 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:42.813158  4876 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.835199  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:02:42.848958  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.850994  1609 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:42.807590  4968 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:42.856580  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65925.4us
I20260709 13:02:42.810899  5026 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.861666  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:42.826545  4985 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.865211  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 128) took 1084 ms. Trace:
I20260709 13:02:42.870458  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:42.890908  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.869933  1528 rpcz_store.cc:276] 0709 13:02:41.780648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.291253 (+510605us) service_pool.cc:224] Handling call
0709 13:02:42.291704 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.314907 (+ 23203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.314938 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.315598 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.558681 (+243083us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:42.558720 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.558782 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.864789 (+306007us) raft_consensus.cc:1685] finished
0709 13:02:42.864819 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.865006 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1993,"raft.queue_time_us":8403,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17371,"thread_start_us":190314,"threads_started":1,"wal-append.queue_time_us":372122}
I20260709 13:02:42.868254  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1351) took 1064 ms. Trace:
W20260709 13:02:42.944948  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 113336us
I20260709 13:02:42.946187  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:42.830226  4581 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.784260  4597 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.862287  4313 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:42.834868  4885 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:42.944772  1532 rpcz_store.cc:276] 0709 13:02:41.803541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.312459 (+508918us) service_pool.cc:224] Handling call
0709 13:02:42.361162 (+ 48703us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.361642 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.361690 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:42.532488 (+170798us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:42.533140 (+   652us) log.cc:844] Serialized 52 byte log entry
0709 13:02:42.722111 (+188971us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:42.849820 (+127709us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.862589 (+ 12769us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.862970 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.863282 (+   312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.867936 (+  4654us) raft_consensus.cc:1685] finished
0709 13:02:42.867957 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.868187 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160726,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":3172,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":31393,"spinlock_wait_cycles":3590528,"thread_start_us":301014,"threads_started":2,"wal-append.queue_time_us":247896}
W20260709 13:02:42.950335  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80647.5us
I20260709 13:02:42.952121  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:42.944507  4968 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.953409  5013 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.953081  5014 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.974026  1601 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
W20260709 13:02:42.975322  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 184887us
I20260709 13:02:42.955268  5026 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.978801  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.981033  4797 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:42.987668  4783 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:42.988898  5023 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:42.998035  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.983246  4716 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.002310  4824 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.002417  4716 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.004964  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.005218  5018 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.006946  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:42.867933  4978 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
W20260709 13:02:43.012611  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 227578us
I20260709 13:02:43.015846  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:42.988736  4797 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.014430  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.014144  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.970636  5019 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.970407  5008 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:43.019125  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67142.2us
W20260709 13:02:43.022071  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 186936us
I20260709 13:02:43.022384  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:42.876132  4888 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.025939  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.027626  4969 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.027899  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.017355  5026 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.029558  5026 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.029961  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.031349  4885 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.029553  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.032976  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.033891  1684 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.034281  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:42.995647  4358 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.009454  4581 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:43.014480  4313 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.044862  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:43.016845  4613 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.060552  4955 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.022893  5019 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.061575  4955 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:42.959905  4975 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.013797  4971 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.070991  5019 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.080410  4313 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.096457  5033 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.098536  4984 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:43.070207  4797 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.068154  4716 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:02:43.113055  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.106290  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 72460us
I20260709 13:02:43.063553  4581 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.107412  4707 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.131616  4707 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:43.105988  5033 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.110392  4716 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.119663  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1354) took 1315 ms. Trace:
I20260709 13:02:43.121202  4888 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:43.122556  5012 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.001s
I20260709 13:02:43.124724  5018 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:43.071345  4826 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.129082  4358 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.129922  4955 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.105371  5028 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:43.114133  4797 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.130798  4984 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.131995  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.136499  4892 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.136940  5012 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.137979  5026 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.132869  1535 rpcz_store.cc:276] 0709 13:02:41.804564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.272721 (+468157us) service_pool.cc:224] Handling call
0709 13:02:43.119430 (+846709us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54003d27d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:43.119558 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235188096}
I20260709 13:02:43.142333  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.132095  4707 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.132612  4716 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:43.145129  4581 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.143141  4783 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.158070  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.161509  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.185153  1681 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:43.185542  1602 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:43.167384  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.186650  1601 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:43.191123  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:43.169345  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.143164  4995 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.195015  1605 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:43.196836  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:43.172722  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.145428  4613 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.176862  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.132387  5033 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.143421  4313 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:43.184238  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.147192  5034 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.150090  4892 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.222491  4892 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.223560  4892 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.185799  4960 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:02:43.201333  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 162158us
I20260709 13:02:43.201561  4848 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:43.210006  5026 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.228865  5026 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.233750  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.235158  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.235576  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.236801  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:43.212255  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.241890  4975 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.242615  4985 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.243037  4985 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:43.243497  4985 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.244433  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.245945  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.170869  4358 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.248873  4358 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:43.252012  1601 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:43.254144  5045 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.254750  5045 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.208660  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.218283  4968 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:43.218652  4716 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.219712  4613 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.220896  4313 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.288997  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.229426  4797 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.235280  4848 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:43.154004  4859 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.202527  5008 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.201716  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:43.217377  1606 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.258407  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.185276  5018 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:02:43.194849  4581 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.264720  5045 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:43.266191  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.210116  4909 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.332830  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.267994  5009 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:43.334910  5012 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:43.335331  5009 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:43.335942  5009 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.294010  4716 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.194705  4921 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.269150  4826 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:43.270680  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.285987  1604 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:02:43.339291  1683 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.339495  1610 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.287189  1684 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:43.231513  4876 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.237006  4960 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.256935  5026 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.290997  1676 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:43.291628  5048 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.295475  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.291503  5028 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:02:43.296165  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.296655  4984 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.298065  5042 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:43.300539  4848 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.271667  5013 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:43.322520  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 293022us
I20260709 13:02:43.357910  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.332067  4909 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.345487  1675 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.288811  4888 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:02:43.316576  4968 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:43.344848  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.363322  1684 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:43.342232  4969 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.364454  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.355934  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:43.373852  1678 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.361838  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.376067  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.379365  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.379755  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.380613  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.344818  5039 raft_consensus.cc:2764] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:43.359736  4976 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.384164  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:43.395771  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.346827  4358 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:02:43.373693  4797 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:43.383487  4826 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.394693  5045 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.374310  5012 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.399879  5028 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:43.382855  5041 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.438630  1605 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:43.413081  4797 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.445952  1683 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:02:43.442775  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 152713us
I20260709 13:02:43.354121  5048 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:43.453378  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.454392  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 252742us
I20260709 13:02:43.447896  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.460940  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.459757  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.461879  1683 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:02:43.410490  5026 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:43.439620  5028 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.427979  4826 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:43.442623  5012 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.456246  4797 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:43.508675  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.508741  1676 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:43.406708  4976 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:43.487411  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.506455  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1744) took 1601 ms. Trace:
I20260709 13:02:43.519860  1606 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:43.529310  1603 rpcz_store.cc:276] 0709 13:02:41.904800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.277271 (+372471us) service_pool.cc:224] Handling call
0709 13:02:42.278078 (+   807us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.285547 (+  7469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.285578 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:42.299956 (+ 14378us) log.cc:844] Serialized 52 byte log entry
0709 13:02:42.558247 (+258291us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.579723 (+ 21476us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.416140 (+836417us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b18003ebc60. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:02:43.416350 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.481847 (+ 65497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.481930 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.506250 (+ 24320us) raft_consensus.cc:1685] finished
0709 13:02:43.506269 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.506403 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":805061,"prepare.queue_time_us":894939,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":490,"raft.queue_time_us":275742,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":13316,"spinlock_wait_cycles":6738176,"thread_start_us":260165,"threads_started":2,"wal-append.queue_time_us":401429}
I20260709 13:02:43.480813  5037 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.506022  4826 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.486153  5043 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:43.583690  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 199667us
I20260709 13:02:43.480728  5044 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.242s
I20260709 13:02:43.580605  5043 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.502395  5028 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.589905  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:43.591039  2210 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:43.505656  5045 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:43.593200  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 145377us
I20260709 13:02:43.492247  4613 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.486876  4313 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.486630  4909 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:43.619241  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131940us
I20260709 13:02:43.656917  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.658290  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.659173  5029 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:43.418370  4968 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.660125  4876 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.659909  5029 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.483054  5049 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.668718  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:43.630749  5033 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.632462  5044 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:43.633152  5027 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.637398  1676 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:43.637923  5042 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:43.692762  5044 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.699815  5042 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:43.700481  2210 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:43.701373  4876 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.700848  5044 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.703154  5044 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.575817  4707 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:43.643803  4613 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:43.652805  5012 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.653422  4976 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:43.655172  5048 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.592615  5041 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:43.543148  5034 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.440836  4848 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.722378  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.690971  1678 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:43.622430  5019 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.586906  5043 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.686064  4951 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.732411  1601 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [8.5-11.7]
I20260709 13:02:43.732517  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:43.700583  5042 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.416241  5008 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.713205  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1406) took 1159 ms. Trace:
I20260709 13:02:43.684566  5029 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.690855  1675 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:43.659767  4985 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.714881  4876 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.729967  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:43.731524  1605 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:43.718413  5058 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.723483  4824 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.738101  1677 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.738423  1682 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.735397  1684 rpcz_store.cc:276] 0709 13:02:42.553481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.411627 (+858146us) service_pool.cc:224] Handling call
0709 13:02:43.411983 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.412295 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:43.437526 (+ 25231us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.712841 (+275315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.712896 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.712940 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.713012 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.713137 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10706,"prepare.queue_time_us":25444,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":842,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7578,"thread_start_us":274938,"threads_started":1}
I20260709 13:02:43.757187  1677 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.758705  1684 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:43.758946  1682 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:43.739255  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.722285  5034 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.724550  1678 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:43.744735  1607 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:43.745497  5043 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.747628  1606 raft_consensus.cc:1217] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[9.5-11.6]   Dedup: 9.5->[11.6-11.6]
I20260709 13:02:43.749071  4826 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.749701  1609 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.780256  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:43.752725  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.737959  4707 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:43.753974  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.754813  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.776764  1679 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:43.759924  1684 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:43.778689  1606 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [9.5-11.6]
W20260709 13:02:43.782682  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.792987  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:43.786089  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:02:43.801481  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 49476.8us
I20260709 13:02:43.486174  5057 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.241s
I20260709 13:02:43.758953  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:43.798291  1604 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:43.753959  5048 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.742192  5037 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:43.812343  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58439.4us
I20260709 13:02:43.820251  1609 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:43.810458  1677 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.759330  5061 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:43.809706  4871 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.740321  4951 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:43.777307  4824 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.849851  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:43.810300  4976 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.824784  1677 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.881052  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:43.893560  2210 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:43.893929  1607 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.895228  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.895862  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.776652  4613 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:43.829442  4995 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:02:43.919826  4995 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.920593  4995 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.921826  4995 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.830511  5019 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:43.760248  5058 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.914958  4907 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:43.831863  4797 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.927093  1608 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:43.928355  4797 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.929214  4797 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.929868  4797 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.916445  5057 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.917361  1675 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:02:43.932423  5057 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:43.933754  5057 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.937582  4797 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.938738  4797 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:43.941715  4797 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:43.940145  4995 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.754933  4876 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.823987  5003 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.839445  4931 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:43.828549  4716 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:43.814189  4313 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:02:43.829500  4985 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.835474  4951 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:43.828181  5059 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.828342  5036 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:43.950492  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 159144us
I20260709 13:02:43.824600  5061 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:43.832803  5026 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:43.947480  4960 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:02:43.980360  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.777112  5039 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:02:43.952301  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 134312us
I20260709 13:02:43.954458  5003 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.953285  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 57489.1us
I20260709 13:02:43.822896  5048 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.958422  4931 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:43.942976  4909 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:43.954002  4797 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:43.978605  5045 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.947124  4581 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:43.814944  5009 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:43.981154  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.002972  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.980408  5026 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.975353  5061 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.946246  4613 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:43.985137  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:43.964223  1607 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:43.969952  4716 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.004251  1678 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.013662  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1403) took 1462 ms. Trace:
I20260709 13:02:43.913753  4976 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:44.015627  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.018482  1678 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:43.967265  5041 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:43.984588  4960 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.024415  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:44.024340  4960 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.024686  5071 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:44.025187  1607 raft_consensus.cc:2368] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:44.026057  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:44.026463  4960 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.987195  5003 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.015924  1609 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:02:44.013442  5072 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:44.029536  5041 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.010130  5033 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.031564  5049 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:44.031845  4797 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.034400  1683 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:44.014139  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:44.020519  5058 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:43.987360  4951 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:44.021672  4716 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.022120  4976 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.022835  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.026718  1607 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:44.005265  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:43.984484  5059 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.029964  5072 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.015957  1681 rpcz_store.cc:276] 0709 13:02:42.551001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.551135 (+   134us) service_pool.cc:224] Handling call
0709 13:02:44.012638 (+1461503us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000be0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:44.013610 (+   972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435028864}
I20260709 13:02:44.043021  1647 leader_election.cc:400] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:44.047489  1647 leader_election.cc:403] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.014156  4826 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.045630  1684 raft_consensus.cc:2410] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:44.050710  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:44.052655  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.054481  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:44.063566  1681 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.037734  5045 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:44.058543  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.999334  4909 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.062381  1684 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:44.081203  1684 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:44.023574  5034 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.072744  4613 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.075489  1682 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:44.046998  5008 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:44.090675  4909 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.098281  5009 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:44.101683  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.105513  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:44.107409  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.110766  5042 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.114454  1676 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:44.118400  5042 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.119139  4876 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.107786  5008 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:44.085466  1682 pending_rounds.cc:85] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 3
I20260709 13:02:44.151036  1682 pending_rounds.cc:107] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:44.151515  1682 raft_consensus.cc:2889] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.134528  5028 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.108937  4824 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.155596  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:44.144169  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.145390  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.160702  1677 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:02:44.161120  1677 pending_rounds.cc:85] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 5
I20260709 13:02:44.161533  1677 pending_rounds.cc:107] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:02:44.161794  1677 raft_consensus.cc:2889] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.164340  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.191473  1526 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:44.168483  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.192477  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:02:44.170792  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.171353  1530 raft_consensus.cc:1217] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Deduplicated request from leader. Original: 9.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:02:44.193356  1535 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:44.173928  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.047591  4931 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:44.154062  5074 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:02:44.162626  4613 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:44.152714  4876 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.198024  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1778) took 1042 ms. Trace:
I20260709 13:02:44.203336  1677 rpcz_store.cc:276] 0709 13:02:43.155361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.737639 (+582278us) service_pool.cc:224] Handling call
0709 13:02:43.737969 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.197787 (+459818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.197969 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:44.182070  5029 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.163178  4960 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.183961  5067 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.339s	user 0.005s	sys 0.000s
I20260709 13:02:44.186501  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1763) took 1408 ms. Trace:
I20260709 13:02:44.213088  1610 rpcz_store.cc:276] 0709 13:02:42.778382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.778548 (+   166us) service_pool.cc:224] Handling call
0709 13:02:42.778882 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.339885 (+561003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.186287 (+846402us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400249d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:44.186447 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288867072}
I20260709 13:02:44.185818  1601 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.215893  1535 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.190037  1531 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:44.157110  5039 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:44.196557  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.217772  1526 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.196954  1530 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:44.154958  5045 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:44.225263  1601 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.227571  1601 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:44.231935  1680 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:44.233748  1532 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.249408  1601 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 13:02:44.212918  4876 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.212726  4613 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.277799  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:44.256215  1531 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:44.279420  1532 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.256731  1526 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:44.258224  5029 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.261458  4876 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.264128  4859 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.264144  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.267117  4581 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.228843  5008 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.222759  4960 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.274044  5072 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.284469  1535 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:44.285310  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:44.254438  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 238384us
I20260709 13:02:44.287174  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.289516  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.290309  1526 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:44.285593  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.291229  1535 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:44.291384  1526 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.291555  1531 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:44.296030  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.296051  1535 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.297749  1526 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:44.267621  5026 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.319895  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.325583  1532 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.321609  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:44.320986  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:44.322415  4885 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.330075  4885 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.332408  4916 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:44.334460  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:44.289279  4951 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:44.344935  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.346444  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.347055  1535 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.352595  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.319366  4908 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:44.350965  4907 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:44.294519  4581 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.341491  4951 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.342674  4859 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:44.349388  5079 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:44.362355  4885 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.388788  1535 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:44.351334  4661 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:44.398481  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.373663  4951 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.340516  5045 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.410108  4859 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.364238  4908 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.410825  4859 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.412472  4908 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.414582  4859 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.381999  5003 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:44.394580  5079 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:44.428936  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1776) took 1451 ms. Trace:
I20260709 13:02:44.430524  1676 rpcz_store.cc:276] 0709 13:02:42.977278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.698916 (+721638us) service_pool.cc:224] Handling call
0709 13:02:43.699358 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.115010 (+415652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.428446 (+313436us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003cd2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:44.428703 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954019584}
I20260709 13:02:44.428001  1532 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:44.418135  4964 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.440410  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.438421  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.442245  1532 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 7.
I20260709 13:02:44.445143  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.446264  1532 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:44.446497  2211 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:44.448002  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.449971  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:44.438263  4613 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.419516  4976 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.444728  4964 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.466516  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:44.490723  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:44.491859  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:44.454051  1532 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.506855  1528 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.455127  4797 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:44.510223  5082 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:44.511009  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.511703  1610 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:44.512686  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:44.513134  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:44.513275  1610 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:44.496740  5078 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:44.525909  1610 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:44.495398  4859 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:44.532184  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.497110  4613 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:44.506260  5072 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:44.453820  4907 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:44.540617  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.491010  4960 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.531620  4581 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.493480  5079 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.550523  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.546860  1532 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:44.557581  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.557998  4976 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.536484  4613 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.560328  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.561017  1530 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 8: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:44.566666  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.537699  5072 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.576696  5072 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.561776  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.563851  4907 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.578680  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.579345  1601 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:44.569376  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.580471  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:44.581377  1605 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:44.582832  1605 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [8.5-11.6]
I20260709 13:02:44.587973  5003 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.591591  5072 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.593108  4964 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.593307  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.564811  4613 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.595855  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.605424  1530 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:44.560400  1610 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:44.602083  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:44.607534  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.608539  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.609887  1530 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.612941  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.613790  1532 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:44.615020  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.618667  5034 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.619853  4951 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:44.621121  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.625238  1532 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:44.626205  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.627588  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:44.628163  1532 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.634581  5048 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.635166  1532 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:44.637827  1608 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:44.639266  1608 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:44.644737  1608 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:44.631824  4613 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.666824  1601 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 8: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:44.686718  5064 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.861s	user 0.003s	sys 0.000s
I20260709 13:02:44.692993  4951 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.693946  5073 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:44.694572  5073 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:44.710386  1530 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:44.712751  5059 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.773360  1433 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 5 to 7, term changed from 8 to 10, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193), VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194), VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195), VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.807336  5072 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.800657  5034 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:44.817164  5034 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:44.819442  5034 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:44.820158  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1412) took 2264 ms. Trace:
I20260709 13:02:44.820591  1683 rpcz_store.cc:276] 0709 13:02:42.555309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.479548 (+924239us) service_pool.cc:224] Handling call
0709 13:02:43.528013 (+ 48465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.035099 (+507086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.819887 (+784788us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54002e90d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:44.820094 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163680512}
I20260709 13:02:44.825016  5073 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:44.826138  5073 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:44.819442  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.829164  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.829922  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.830526  5044 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.830847  5069 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.006s	user 0.000s	sys 0.004s
I20260709 13:02:44.831056  5044 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.833894  5044 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.835031  4613 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:44.839291  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.841938  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:44.842163  1681 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:44.842559  1681 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:44.799439  5059 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.846064  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:44.843263  1681 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.850740  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.855667  1681 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.855823  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.860378  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:44.863631  1681 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:02:44.870121  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1784) took 1713 ms (client timeout 1568 ms). Trace:
W20260709 13:02:44.870711  1679 rpcz_store.cc:269] 0709 13:02:43.156831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.234893 (+ 78062us) service_pool.cc:224] Handling call
0709 13:02:44.869810 (+1634917us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400140ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:44.870013 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192047360}
I20260709 13:02:44.874593  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:44.875535  1679 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.849068  5044 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.851918  5008 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.880540  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.889122  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.887984  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.891422  1682 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:44.894961  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.896091  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.897152  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:44.891093  5008 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:44.901335  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:44.901489  4707 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:02:44.902809  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.006830  5008 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.888579  5044 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.011268  5044 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:44.854456  5059 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.014274  5059 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:45.007773  5102 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:02:45.019951  1682 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:45.021610  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.023161  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.008460  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.026042  1681 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:45.027565  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.038995  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.018831  4707 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.065654  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.066818  1676 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:45.068130  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.068222  4707 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.070552  4707 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:45.072266  1683 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.072777  1683 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:45.076591  1683 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.077982  1683 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.069506  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.087560  1676 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:02:45.088568  1676 pending_rounds.cc:85] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 5
I20260709 13:02:45.089001  1676 pending_rounds.cc:107] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:02:45.041042  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.101500  1679 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:45.104789  1683 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:02:45.105687  1683 pending_rounds.cc:85] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 5
I20260709 13:02:45.109970  1683 pending_rounds.cc:107] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:02:45.110375  1683 raft_consensus.cc:2889] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.109359  1681 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:45.105301  1676 raft_consensus.cc:2889] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:45.140666  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 175) took 1305 ms (client timeout 1617 ms). Trace:
W20260709 13:02:45.141196  1609 rpcz_store.cc:269] 0709 13:02:43.835287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.880786 (+ 45499us) service_pool.cc:224] Handling call
0709 13:02:45.140480 (+1259694us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540024a254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:45.140600 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239025024}
I20260709 13:02:45.147621  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1591) took 1001 ms. Trace:
I20260709 13:02:45.160880  5037 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:45.162531  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.153813  4661 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.160923  1527 rpcz_store.cc:276] 0709 13:02:44.145962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.146442 (+   480us) service_pool.cc:224] Handling call
0709 13:02:44.169253 (+ 22811us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:44.169780 (+   527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.169821 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:44.170796 (+   975us) log.cc:844] Serialized 78 byte log entry
0709 13:02:44.349508 (+178712us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:44.392320 (+ 42812us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.709815 (+317495us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b1800338860. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:45.146914 (+437099us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b1800338860. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:02:45.147097 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.147312 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.147366 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:45.147381 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.147557 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16858,"prepare.queue_time_us":60554,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":765954,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":47503744,"thread_start_us":150853,"threads_started":2,"wal-append.queue_time_us":209599}
I20260709 13:02:45.163113  4661 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:45.164286  4661 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.165530  4661 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:45.166515  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.155586  5044 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:45.156149  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.156450  5012 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:45.156553  5008 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:45.168272  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 655162us
I20260709 13:02:45.169306  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.185861  1531 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.201620  5112 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:45.190397  4960 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.222096  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.199412  4976 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.208598  4964 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:45.228194  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.228665  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.228214  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.232072  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.233245  1530 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:45.232468  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.230515  5036 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.235538  4908 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.236006  5036 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.236177  4908 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.238106  5036 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.238898  5036 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.239298  4907 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.239833  4907 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.223404  4960 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.242533  4885 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.244024  1527 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:45.226555  4976 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.238324  4908 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.225523  4964 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.250335  4613 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:45.250602  4964 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.251186  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.253046  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.253885  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.254072  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.254830  4797 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.255414  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.255285  4797 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.256227  5034 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:45.256739  5034 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:45.248229  4960 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.244758  4885 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:45.248883  5065 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.417s	user 0.004s	sys 0.000s
I20260709 13:02:45.249054  4907 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.249948  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1735) took 1519 ms. Trace:
I20260709 13:02:45.250144  4976 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.251005  4613 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:45.257427  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 240406us
I20260709 13:02:45.282704  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.257633  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.283394  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.283800  1609 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:45.245282  4985 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.258664  1608 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:45.230832  5112 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.273823  1530 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:45.285668  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.286197  1530 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.279510  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.280668  1603 rpcz_store.cc:276] 0709 13:02:43.730360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.730485 (+   125us) service_pool.cc:224] Handling call
0709 13:02:43.730762 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.970411 (+239649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.970443 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.973411 (+  2968us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.281955 (+308544us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:44.281996 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.249556 (+967560us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540024b8d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:45.249612 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.249667 (+    55us) raft_consensus.cc:1685] finished
0709 13:02:45.249685 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.249890 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42601,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10525,"spinlock_wait_cycles":446232960,"thread_start_us":321583,"threads_started":2,"wal-append.queue_time_us":350235}
I20260709 13:02:45.289206  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:45.292464  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.297300  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.298497  1610 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:45.269224  5041 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:45.305248  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.270534  4859 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.308302  1530 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:45.239353  5036 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.314683  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.310487  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.276391  5045 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.318497  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.289022  5112 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:45.294375  4797 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.323933  5027 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.288496  4313 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:45.295318  5079 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:45.276655  5048 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:45.275602  4581 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:02:45.275969  5093 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:45.282464  4960 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:02:45.303112  4907 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:45.294201  4985 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:45.389791  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.420639  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.421792  4908 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:45.422396  4908 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:45.357484  5110 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:02:45.333814  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.423290  1533 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.424561  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1794) took 1418 ms. Trace:
I20260709 13:02:45.425097  1675 rpcz_store.cc:276] 0709 13:02:44.006233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.174688 (+168455us) service_pool.cc:224] Handling call
0709 13:02:44.179419 (+  4731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.200259 (+ 20840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.200290 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.152212 (+951922us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:45.152685 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.193258 (+ 40573us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:45.193317 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.193420 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.424213 (+230793us) raft_consensus.cc:1685] finished
0709 13:02:45.424238 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.424493 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17858,"raft.queue_time_us":20895,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11216,"spinlock_wait_cycles":11705600,"thread_start_us":40146,"threads_started":1,"wal-append.queue_time_us":40501}
I20260709 13:02:45.402491  5026 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.429678  5009 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.430373  5009 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.393697  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:44.887553   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:45.341177  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1774) took 2369 ms. Trace:
I20260709 13:02:45.432686  1680 rpcz_store.cc:276] 0709 13:02:42.971844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.680350 (+708506us) service_pool.cc:224] Handling call
0709 13:02:43.681181 (+   831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.232779 (+551598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.340816 (+1108037us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54003caad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:45.341096 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265798528}
I20260709 13:02:45.303042  4661 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:45.303483  5091 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:45.434190  5091 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:45.423389  4908 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.435261  5091 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.436224  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1594) took 1287 ms. Trace:
I20260709 13:02:45.433614  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.436928  5036 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.436690  1528 rpcz_store.cc:276] 0709 13:02:44.148684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.157355 (+  8671us) service_pool.cc:224] Handling call
0709 13:02:44.164015 (+  6660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.507317 (+343302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.435845 (+928528us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400319a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:45.436159 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787943680}
I20260709 13:02:45.437556  1433 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 6 to 9, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.438705  4613 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.439546  1433 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.441329  4964 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.406785  1530 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:45.442608  1532 raft_consensus.cc:2368] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:45.441926  1433 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.443490  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.444541  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.444645  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.445290  1530 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:45.445815  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.446092  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.446465  1532 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:45.446763  1530 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:45.446985  4931 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.323750  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:45.448777  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 125104us
I20260709 13:02:45.449085  4985 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.449641  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.450834  4919 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:45.451267  4919 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.451157  4661 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:45.451834  4919 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.452318  4960 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:45.455032  2175 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.617s (SENT) [suppressed 31 similar messages]
I20260709 13:02:45.432281  1527 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:45.446777  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1373) took 1103 ms. Trace:
I20260709 13:02:45.457142  1526 rpcz_store.cc:276] 0709 13:02:44.343716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.352274 (+  8558us) service_pool.cc:224] Handling call
0709 13:02:45.446472 (+1094198us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000a46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:45.446724 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627919232}
I20260709 13:02:45.451756  5118 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:02:45.320302  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.407300  5079 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:45.460084  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 139816us
I20260709 13:02:45.311527  5041 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.460799  5041 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.391991  1684 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.464329  5109 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:45.464709  1684 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.465454  4876 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:45.466792  5009 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:45.307140  5059 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.407910  4313 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:45.469667  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.470062  4313 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.385339  4824 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:45.470994  4824 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.471390  4824 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.417169  5048 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.472357  5048 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:45.473205  5048 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.474396  5048 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.349574  5034 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.332290  5045 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.355609  4707 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.479010  4707 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.479338  4919 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.435802  4908 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.460244  5079 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.471280  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.359061  4885 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.348717  5113 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.491421  1533 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:45.481140  4707 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:45.481693  5093 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:45.492789  1531 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:02:45.492885  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:45.496402  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.528887  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.529547  1683 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:45.530364  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.531090  1683 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:45.341943  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.414651  5061 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.329262  1677 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:45.496877  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.532871  1681 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:45.535192  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:45.520437  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 243534us
I20260709 13:02:45.480362  5045 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.529903  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:45.502476  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.538022  1684 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:02:45.538787  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.513394  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.505362  1532 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:45.540194  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:45.514366  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.526072  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:45.522430  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.541015  1675 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.541188  1682 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:45.536543  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.538921  1527 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:45.543741  1527 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:45.546134  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.546452  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:45.545193  1527 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:45.536728  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.548542  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.538542  1684 pending_rounds.cc:85] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 4
I20260709 13:02:45.550048  1684 pending_rounds.cc:107] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:02:45.551584  1684 raft_consensus.cc:2889] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:45.541294  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.550760  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.549961  1531 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:45.553536  1608 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:45.551630  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.552184  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.554418  1609 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:45.554493  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1791) took 1550 ms. Trace:
I20260709 13:02:45.554857  1684 rpcz_store.cc:276] 0709 13:02:44.004521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.061857 (+ 57336us) service_pool.cc:224] Handling call
0709 13:02:44.062263 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.162803 (+1100540us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4c003c2b80. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696345a20 00007f4696356a29 00007f469631c644 00007f4696343f2d 00007f4696343b93 00007f469807418b 00007f4698074cb5 00007f469806ff30 00007f46980717de 00007f469807bb49 00007f469807c416
0709 13:02:45.340461 (+177658us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540036e320. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff706f 00007f469806ff60 00007f46980717de 00007f469807bb49 00007f469807c416 00007f4698078d8f 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62
0709 13:02:45.553054 (+212593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.554438 (+  1384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67456256}
I20260709 13:02:45.508206  5036 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.557349  1532 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:45.558084  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:45.558398  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.559160  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.510464  5012 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.464753  5109 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:45.566708  1601 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:45.561563  1610 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:45.560941  1533 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:45.568650  1526 raft_consensus.cc:1217] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Deduplicated request from leader. Original: 9.4->[11.5-11.5]   Dedup: 11.5->[]
W20260709 13:02:45.568655  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 113646us
I20260709 13:02:45.569387  1526 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:02:45.571491  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.572269  1606 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:45.573511  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1607) took 1312 ms. Trace:
I20260709 13:02:45.573995  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.538547  4985 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:45.559959  4975 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:02:45.582669  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:45.592525  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.560551  5057 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:45.560600  4707 raft_consensus.cc:2764] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:45.602550  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.613790  1606 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:45.614723  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:45.615379  1606 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:45.560456  4613 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:45.559219  5073 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.571954  5009 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:45.571583  4885 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.616880  1606 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:45.616880  1675 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:45.582072  4916 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.598121  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1796) took 1141 ms. Trace:
I20260709 13:02:45.614856  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:45.719432  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:45.720098  1606 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:45.721128  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:45.722404  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:45.703461  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 120894us
W20260709 13:02:45.705678  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 450293us
I20260709 13:02:45.585542  5091 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.580855  5028 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.597450  5039 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:45.987005  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 328120us
I20260709 13:02:45.716750  1605 rpcz_store.cc:276] 0709 13:02:44.456303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.863357 (+407054us) service_pool.cc:224] Handling call
0709 13:02:44.867699 (+  4342us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:02:45.256105 (+388406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.256151 (+    46us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:02:45.257143 (+   992us) log.cc:844] Serialized 104 byte log entry
0709 13:02:45.526912 (+269769us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b540026afa0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4697ff06b8 00007f469807992b 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c
0709 13:02:45.526978 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:45.559704 (+ 32726us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.584573 (+ 24869us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.584820 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.584918 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.597786 (+ 12868us) raft_consensus.cc:1685] finished
0709 13:02:45.597812 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.598033 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":427543,"prepare.queue_time_us":61872,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":5934,"raft.queue_time_us":429312,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":43414,"spinlock_wait_cycles":482493312,"thread_start_us":163054,"threads_started":1,"wal-append.queue_time_us":182039}
W20260709 13:02:45.718559  5120 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:02:45.713871  5009 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.620685  4613 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.575929  5012 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.603778  5057 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:46.214250  5057 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.216207  5012 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:45.596988  5071 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:02:46.219195  5003 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.707744  4960 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:45.731040  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:46.220791  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:46.221836  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:45.702771  4661 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.715595  5073 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:46.222492  4661 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.222947  4661 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.223143  5073 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:45.623378  5008 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:02:45.537570  5113 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.718948  5111 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.136s
W20260709 13:02:46.234719  5027 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.830s	user 0.008s	sys 0.002s
W20260709 13:02:46.108819  2175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.052s	sys 0.172s
W20260709 13:02:46.097337  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 373725us
W20260709 13:02:46.014868  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 400044us
W20260709 13:02:46.096949  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 475691us
W20260709 13:02:46.210376  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.723762  5117 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:45.723875  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:45.576172  5036 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:45.785827  5116 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.467s
I20260709 13:02:46.243170  5123 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.275894  5123 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.278474  5123 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.279305  5036 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.227490  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:46.233444  5009 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:46.234805  5048 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.000s
I20260709 13:02:45.581934  5112 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.237128  4859 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.913s	user 0.012s	sys 0.000s
I20260709 13:02:46.240732  4661 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.241533  5028 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.234336  4931 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.000s
W20260709 13:02:46.243186  2175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.081s	sys 0.193s
W20260709 13:02:46.309103  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 738883us
I20260709 13:02:46.243803  5071 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:46.244549  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:46.209367  5121 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.411s	user 0.002s	sys 0.000s
I20260709 13:02:46.253687  5027 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.280289  5117 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.281651  2176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.020s
I20260709 13:02:46.225359  5057 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.282629  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:46.213698  4613 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.208427  5034 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:45.837360  4916 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:46.274077  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:46.212473  4919 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.285338  1605 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:02:46.274746  5136 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:02:46.301594  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 146) took 22784 ms (client timeout 15000 ms). Trace:
I20260709 13:02:45.798547  4707 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.456s
I20260709 13:02:45.785528  4885 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.314723  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:46.281771  5045 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.226837  5003 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:46.285023  5148 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.288007  5123 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:46.318507  2176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.008s	sys 0.020s
I20260709 13:02:46.318637  1535 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:02:46.318162  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73704.8us
I20260709 13:02:46.306118  4859 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.253106  4960 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:02:46.375876  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1587) took 2236 ms. Trace:
I20260709 13:02:46.376405  4909 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:46.376541  5028 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.322512  5009 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:46.377686  5009 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:46.349750  5045 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.345265  5144 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.379752  5144 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.380123  5144 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:46.343082  1432 rpcz_store.cc:269] 0709 13:02:23.459990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.460427 (+   437us) service_pool.cc:224] Handling call
0709 13:02:46.244573 (+22784146us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:41.252890 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:41.333047 (+ 80157us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:41.333096 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:02:41.333130 (+    34us) tablet.cc:662] Decoding operations
0709 13:02:41.418982 (+ 85852us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:41.432332 (+ 13350us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:41.432367 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:41.433586 (+  1219us) tablet.cc:701] Row locks acquired
0709 13:02:41.433633 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:02:41.433815 (+   182us) write_op.cc:270] Start()
0709 13:02:41.433969 (+   154us) write_op.cc:276] Timestamp: P: 1783602161433747 usec, L: 0
0709 13:02:41.433988 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:41.434769 (+   781us) log.cc:844] Serialized 5585 byte log entry
0709 13:02:41.988421 (+553652us) op_driver.cc:464] REPLICATION: finished
0709 13:02:42.146776 (+158355us) write_op.cc:301] APPLY: starting
0709 13:02:42.146893 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:42.147308 (+   415us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:42.147465 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:42.174382 (+ 26917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:42.174798 (+   416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:02:42.174872 (+    74us) write_op.cc:312] APPLY: finished
0709 13:02:42.175317 (+   445us) log.cc:844] Serialized 100 byte log entry
0709 13:02:42.178457 (+  3140us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.178610 (+   153us) write_op.cc:454] Released schema lock
0709 13:02:42.178737 (+   127us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:42.188460 (+  9723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.188491 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71137,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":144868,"apply.run_cpu_time_us":5117,"apply.run_wall_time_us":39383,"num_ops":14,"prepare.queue_time_us":151311,"prepare.run_cpu_time_us":34553,"prepare.run_wall_time_us":507995,"raft.queue_time_us":199185,"raft.run_cpu_time_us":8095,"raft.run_wall_time_us":116396,"replication_time_us":554270,"thread_start_us":542800,"threads_started":4,"wal-append.queue_time_us":296768,"wal-append.run_cpu_time_us":25829,"wal-append.run_wall_time_us":1447401}]]}
I20260709 13:02:46.317709  5111 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.381597  5111 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.343957  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69995.7us
I20260709 13:02:46.383634  1603 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:46.317128  5141 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.377552  5146 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.384758  5141 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.329221  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:46.349305  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:46.387480  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:46.376354  1529 rpcz_store.cc:276] 0709 13:02:44.139085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.155952 (+ 16867us) service_pool.cc:224] Handling call
0709 13:02:44.176888 (+ 20936us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.204456 (+ 27568us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:45.237425 (+1032969us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800403ea0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:02:45.280800 (+ 43375us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.527467 (+246667us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:45.556558 (+ 29091us) log.cc:844] Serialized 52 byte log entry
0709 13:02:45.556708 (+   150us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:45.556742 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.556814 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.375520 (+818706us) raft_consensus.cc:1685] finished
0709 13:02:46.375632 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.375789 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8524,"prepare.queue_time_us":115318,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2798,"raft.queue_time_us":22152,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":25883,"spinlock_wait_cycles":9472896,"thread_start_us":239821,"threads_started":2,"wal-append.queue_time_us":411419}
I20260709 13:02:46.353811  5148 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.356213  5003 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:46.356978  5041 consensus_meta.cc:287] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.004s
I20260709 13:02:46.360849  4964 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.361135  4661 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:45.574062  1534 rpcz_store.cc:276] 0709 13:02:44.261109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.289955 (+ 28846us) service_pool.cc:224] Handling call
0709 13:02:44.290236 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.290425 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:44.373626 (+ 83201us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.389051 (+1015425us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b1800202f00. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:45.573086 (+184035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.573172 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:45.573235 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.573320 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.573435 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12059,"prepare.queue_time_us":85917,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":12219,"spinlock_wait_cycles":39002496,"thread_start_us":251289,"threads_started":2}
W20260709 13:02:46.363422  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.410895  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.325309  4931 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:46.349439  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:46.375111  1610 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.415141  1601 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:46.317512  5142 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:02:46.349488  4824 consensus_meta.cc:287] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.005s
I20260709 13:02:46.380955  5009 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:46.332780  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:46.335474  5034 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.337085  5008 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.786788  5109 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.348152  4885 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.319221  5071 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:46.375277  4908 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.000s
W20260709 13:02:46.363031  5079 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.850s	user 0.002s	sys 0.006s
I20260709 13:02:46.344571  4916 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.411932  5041 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.424360  5143 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:46.348505  5138 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.427294  1610 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.437558  1601 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:46.454244  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 139576us
W20260709 13:02:46.442665  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109076us
I20260709 13:02:46.409443  5012 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:46.422260  4931 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:46.462718  5155 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.420809  5036 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:02:46.463061  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.434288  4885 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.469844  1647 leader_election.cc:400] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:46.470271  1647 leader_election.cc:403] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.464820  1528 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:46.420590  4907 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:46.474152  1604 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:46.475888  5048 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.476671  5048 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.479030  1610 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:46.431247  5044 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:02:46.484881  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 152166us
I20260709 13:02:46.427973  4824 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.487762  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:46.433640  5008 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.494915  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:46.466681  5027 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.501433  1683 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:46.503602  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.505353  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.480579  4707 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.506265  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.442866  5079 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.506798  1683 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:46.478415  5138 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.508222  1684 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:46.485956  4907 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:46.510442  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1376) took 2165 ms (client timeout 1725 ms). Trace:
I20260709 13:02:46.511341  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:46.512399  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127998us
I20260709 13:02:46.516132  1530 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:46.526547  1535 rpcz_store.cc:269] 0709 13:02:44.344712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.440169 (+ 95457us) service_pool.cc:224] Handling call
0709 13:02:46.510137 (+2069968us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:46.510342 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4315320192}
I20260709 13:02:46.510008  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.521965  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.528483  1676 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:02:46.523275  1608 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.530244  1608 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.527806  1677 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:02:46.532011  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.533054  1682 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:46.533265  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.533269  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.534016  1677 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.534467  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.535064  1679 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:46.537079  1608 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.545231  1677 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:46.546681  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.547902  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.506887  4964 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:46.552647  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:46.553239  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 829401us
I20260709 13:02:46.558221  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:46.554685  5111 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.555696  5141 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.556701  5057 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.562582  5141 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:46.563179  5141 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.478717  5155 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.566452  5155 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.566804  5137 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11.
I20260709 13:02:46.567196  5155 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:46.557384  1601 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:46.559479  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:46.569155  5150 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:46.569612  5150 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.570225  5150 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.574457  4824 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.574996  5113 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.575626  5113 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.579484  5150 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:46.582973  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:46.583033  1610 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:46.585949  5008 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.589524  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1802) took 1335 ms. Trace:
I20260709 13:02:46.590545  4916 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.599279  5048 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.601336  5079 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.559897  4931 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.506451  5027 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.602917  5142 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:46.605680  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1813) took 1046 ms. Trace:
I20260709 13:02:46.671294  1603 rpcz_store.cc:276] 0709 13:02:45.558804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.558924 (+   120us) service_pool.cc:224] Handling call
0709 13:02:46.605438 (+1046514us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:46.605602 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891351808}
I20260709 13:02:46.673025  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:46.673977  1603 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:02:46.606748  1605 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:46.563802  5154 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.555699  5148 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.563515  5117 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.563658  5141 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.624567  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:46.708319  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 83836.2us
I20260709 13:02:46.611006  1602 rpcz_store.cc:276] 0709 13:02:45.253575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.258059 (+  4484us) service_pool.cc:224] Handling call
0709 13:02:45.282502 (+ 24443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.317075 (+ 34573us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:45.324181 (+  7106us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.558690 (+234509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.558768 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:45.558838 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.984186 (+425348us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18003eb900. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:46.589187 (+605001us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54003be2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:46.589252 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.589446 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12632,"prepare.queue_time_us":9038,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":1302,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10379,"spinlock_wait_cycles":121238016,"thread_start_us":231564,"threads_started":1,"wal-append.queue_time_us":258380}
I20260709 13:02:46.627923  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.628155  5150 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.628948  1682 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:46.629850  1675 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:46.631196  5131 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.846s	user 0.003s	sys 0.000s
I20260709 13:02:46.575778  5092 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:46.636338  5034 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.525198  4707 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.644838  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.652858  5041 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:46.728885  5091 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.964s	user 0.012s	sys 0.000s
I20260709 13:02:46.729468  5027 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.729750  5091 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.720466  5092 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:46.557003  4964 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:46.547848  4907 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.707911  5142 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.734719  4907 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.706501  4613 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.615615  5158 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.670085  1608 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:46.736536  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1774) took 1086 ms. Trace:
I20260709 13:02:46.737004  1608 rpcz_store.cc:276] 0709 13:02:45.649829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.536703 (+886874us) service_pool.cc:224] Handling call
0709 13:02:46.536970 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.736291 (+199321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.736482 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.739023  1608 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:46.705935  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1777) took 1049 ms. Trace:
I20260709 13:02:46.711390  1680 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:46.714124  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.742555  1603 rpcz_store.cc:276] 0709 13:02:45.656092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.704857 (+1048765us) service_pool.cc:224] Handling call
0709 13:02:46.705277 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.705497 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.705535 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.705592 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.705636 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.705709 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.705862 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.719013  5079 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:46.756091  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.000s	sys 0.010s
I20260709 13:02:46.595654  5144 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:46.723592  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 183343us
W20260709 13:02:46.711696  5061 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.162s	user 0.013s	sys 0.000s
I20260709 13:02:46.725244  1676 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:46.728456  4707 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.711961  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:46.774585  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62742.4us
I20260709 13:02:46.532760  5138 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.744604  1602 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.779007  4313 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:46.747583  4613 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.748344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.779917  1675 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.780073  5138 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:46.782164  4885 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.731128  5092 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.783540  5092 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.762344  5079 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.784457  5079 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.784919  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.786213  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.786406  5071 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:46.786881  1676 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:46.787640  5059 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.788389  5059 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.782157  5124 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:46.791154  5059 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.792639  1607 raft_consensus.cc:2410] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:02:46.793665  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1782) took 2898 ms (client timeout 3314 ms). Trace:
W20260709 13:02:46.794028  1607 rpcz_store.cc:269] 0709 13:02:43.895224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.082499 (+187275us) service_pool.cc:224] Handling call
0709 13:02:46.793468 (+2710969us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b5400086954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:46.793588 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6176284032}
I20260709 13:02:46.731369  4964 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.796857  4964 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:46.756500  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.000s	sys 0.010s
I20260709 13:02:46.754781  1680 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:46.769049  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:46.770506  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 282847us
I20260709 13:02:46.778187  5041 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.779326  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1779) took 1121 ms. Trace:
I20260709 13:02:46.812117  1602 rpcz_store.cc:276] 0709 13:02:45.658039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.736782 (+1078743us) service_pool.cc:224] Handling call
0709 13:02:46.744387 (+  7605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.779083 (+ 34696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.779275 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.712443  5137 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.755954  5158 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.787729  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.798930  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.787577  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1757) took 1154 ms. Trace:
W20260709 13:02:46.802404  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 244253us
I20260709 13:02:46.810673  1675 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12.
W20260709 13:02:46.760517  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 289387us
I20260709 13:02:46.812813  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1817) took 1223 ms. Trace:
I20260709 13:02:46.816562  1606 rpcz_store.cc:276] 0709 13:02:45.633286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.221530 (+588244us) service_pool.cc:224] Handling call
0709 13:02:46.787405 (+565875us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400248e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:46.787515 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198215040}
I20260709 13:02:46.817215  1609 rpcz_store.cc:276] 0709 13:02:45.589307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.596149 (+  6842us) service_pool.cc:224] Handling call
0709 13:02:45.710299 (+114150us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:02:45.710478 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.710665 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:46.009840 (+299175us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.812438 (+802598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.812499 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:46.812539 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.812608 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.812729 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13870,"prepare.queue_time_us":275866,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":11431680,"thread_start_us":1087186,"threads_started":2,"wal-append.queue_time_us":767062}
I20260709 13:02:46.817387  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:46.813601  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.820554  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:46.825285  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:46.817039  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:46.871116  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:46.880478  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63503.8us
I20260709 13:02:46.881321  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.881908  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.882783  1680 raft_consensus.cc:2410] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:46.882696  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 113783us
I20260709 13:02:46.814102  5059 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:46.883751  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1771) took 1234 ms. Trace:
I20260709 13:02:46.885999  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:46.885180  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:46.885499  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:46.886612  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69280.9us
W20260709 13:02:46.884008  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 83026.6us
I20260709 13:02:46.888988  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:46.823202  5041 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:46.835189  5153 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:46.892927  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.897431  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:46.894156  1676 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:46.900811  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:46.903434  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:46.886953  1604 rpcz_store.cc:276] 0709 13:02:45.648974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.484174 (+835200us) service_pool.cc:224] Handling call
0709 13:02:46.521992 (+ 37818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.522198 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:46.557184 (+ 34986us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.882427 (+325243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.882561 (+   134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:46.882691 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.882928 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.883697 (+   769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3851,"prepare.queue_time_us":37509,"raft.queue_time_us":5424,"spinlock_wait_cycles":83583872,"thread_start_us":316749,"threads_started":1}
I20260709 13:02:46.902442  1676 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.883373  4613 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.907222  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:46.884356  5091 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.819432  5137 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:47.007586  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 100446us
I20260709 13:02:46.893438  5179 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.903614  5117 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.916975  5142 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:46.950024  5091 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.906118  5166 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.892258  4707 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:02:46.891952  5059 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:46.949738  5153 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:47.051942  5028 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:47.053045  5169 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:02:47.034704  1535 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:46.941413  5171 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:47.033144  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.054179  5170 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:02:47.030212  4908 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.073297  5008 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:46.942592  5157 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:02:47.038015  4613 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.035915  5179 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:47.116142  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 174440us
W20260709 13:02:47.117079  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 231141us
W20260709 13:02:47.117868  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 220520us
I20260709 13:02:47.047437  5036 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.055773  5091 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.154987  5158 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:47.155453  5125 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.218s	user 0.003s	sys 0.007s
I20260709 13:02:47.075004  5171 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.108759  5048 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:47.159394  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66779.4us
I20260709 13:02:47.165330  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.166018  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:47.050501  5117 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:47.213691  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47704.3us
I20260709 13:02:47.214704  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:47.173206  5137 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:47.071882  5028 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:47.111342  4908 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.160873  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:47.208956  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1776) took 1558 ms. Trace:
I20260709 13:02:47.232820  1610 rpcz_store.cc:276] 0709 13:02:45.650585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.608815 (+958230us) service_pool.cc:224] Handling call
0709 13:02:46.609164 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.609419 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:46.884066 (+274647us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.208485 (+324419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.208558 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:47.208618 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.208717 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.208882 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2028,"prepare.queue_time_us":445035,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":97,"thread_start_us":597436,"threads_started":2,"wal-append.queue_time_us":339971}
I20260709 13:02:47.111068  4313 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:47.219092  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53908.9us
I20260709 13:02:47.152215  5113 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:02:47.162482  5111 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:47.225648  5034 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.163475  5179 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.236543  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:47.221386  5159 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:47.157202  5057 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:47.219489  5072 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:47.070499  5041 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.244381  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.245501  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.212484  5027 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.213028  5171 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.183059  4968 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:02:47.199182  5036 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.231101  4707 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:47.219467  5079 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.296609  1678 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:47.219604  5048 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.237882  4908 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.301388  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1760) took 1667 ms. Trace:
I20260709 13:02:47.300230  1676 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:47.296151  5159 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.305596  1605 rpcz_store.cc:276] 0709 13:02:45.634167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.388381 (+754214us) service_pool.cc:224] Handling call
0709 13:02:46.606312 (+217931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.678772 (+ 72460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.301230 (+622458us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400249350. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:47.301336 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500272384}
I20260709 13:02:47.306696  1676 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:02:47.285917  5178 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:47.261464  4661 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.244995  4313 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.278012  5045 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.328119  4968 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:47.307227  5111 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:47.312618  5015 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.336584  5059 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.309095  5159 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.330236  5048 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.340545  5079 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.341858  1682 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:47.342222  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.349248  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:47.351181  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:47.243924  5028 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.355016  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:47.340655  5168 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:02:47.359726  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:47.372274  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 134823us
W20260709 13:02:47.330639  5185 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:02:47.289204  5012 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:02:47.330237  5173 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:02:47.245018  5142 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.288271  5008 consensus_queue.cc:1243] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:47.298717  5034 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:02:47.381278  1609 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.297870  5161 raft_consensus.cc:2764] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:47.328207  5160 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:47.383658  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:47.429134  1607 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.384327  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.386562  1602 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:47.358218  4968 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:47.388159  1608 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.434028  1603 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:47.435010  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:47.302718  5072 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.436172  5203 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:47.436661  5203 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:47.437057  5203 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.438014  5072 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.309738  5138 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.445006  1608 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:02:47.375505  5190 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:47.354615  5036 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.379804  4661 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.239075  5153 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:47.329838  5139 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 13:02:47.397079  5012 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:47.397243  5183 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:02:47.398655  4313 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.327903  5195 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 13:02:47.398903  5092 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.001s
I20260709 13:02:47.328202  5122 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
W20260709 13:02:47.400364  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1618) took 1988 ms (client timeout 1826 ms). Trace:
W20260709 13:02:47.468468  1528 rpcz_store.cc:269] 0709 13:02:45.411478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.437812 (+ 26334us) service_pool.cc:224] Handling call
0709 13:02:47.400163 (+1962351us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:47.400287 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091363072}
I20260709 13:02:47.402307  5028 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.405862  5117 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.389963  4960 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:47.415729  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 254911us
I20260709 13:02:47.440598  4908 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.446548  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:47.447304  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.484201  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.449090  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:47.485690  5133 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 1.487s	user 0.028s	sys 0.021s
W20260709 13:02:47.486418  5141 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.003s
I20260709 13:02:47.486851  5036 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:47.486792  5141 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.487442  5036 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:47.449061  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:47.488786  5036 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.489428  5141 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.490105  1606 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.458864  5012 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:47.457897  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.462150  1607 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:47.502362  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.432726  5160 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:47.428697  5142 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:47.379592  5015 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.471204  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.472517  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:47.506016  1678 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.474961  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.506682  1675 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:47.475339  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.477623  4313 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.478673  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.509433  4313 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.479908  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:47.511062  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:47.388931  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.489974  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:47.484951  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:47.512090  1602 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.493532  1608 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.493536  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.455070  1609 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:02:47.512105  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 123423us
I20260709 13:02:47.498534  1606 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:47.513224  1682 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:02:47.446844  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 198062us
I20260709 13:02:47.513648  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.513983  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:47.503288  1680 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:47.516484  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:47.520313  4313 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.456307  5079 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:47.456947  4661 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:47.531832  1604 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:47.522962  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1616) took 2112 ms. Trace:
W20260709 13:02:47.526384  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.527951  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:47.528216  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.532238  1530 rpcz_store.cc:276] 0709 13:02:45.410820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.447434 (+ 36614us) service_pool.cc:224] Handling call
0709 13:02:45.447693 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.527380 (+1079687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.522730 (+995350us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540020a654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:47.522905 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456487168}
I20260709 13:02:47.528288  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.556267  1574 leader_election.cc:400] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:47.556725  1574 leader_election.cc:403] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.503991  5141 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.547435  1602 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:47.558593  4968 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:47.559455  4964 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.003s
I20260709 13:02:47.501291  5072 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:47.559993  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.618428  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:47.538695  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:47.566911  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 55921.8us
W20260709 13:02:47.619465  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80895.5us
I20260709 13:02:47.584725  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:47.567885  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53974.2us
I20260709 13:02:47.532932  5117 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.560055  5015 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.560786  4908 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.610234  5141 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:47.536837  5138 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.601609  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.536881  5027 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:47.531522  5034 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.622076  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.537660  5039 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:47.560372  5048 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.563979  5045 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:47.625243  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:47.611424  5003 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:02:47.492879  4960 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.508781  5203 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.603293  5123 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
W20260709 13:02:47.801817  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.561977  5186 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:47.618533  5116 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:47.736083  5045 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.560300  5059 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:02:47.616856  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:47.639019  5071 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
W20260709 13:02:47.728222  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103021us
I20260709 13:02:47.729138  5204 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.729426  5124 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.827188  5207 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.732750  5184 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:47.731643  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.827968  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:47.827229  5204 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.829368  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.736305  1603 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:47.726476  5091 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
I20260709 13:02:47.830654  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.736539  1608 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:47.831780  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.806942  1678 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:47.633909  4613 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:02:47.832798  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.726642  5027 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:47.678081  5141 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.686089  5061 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.791977  5039 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:47.636457  5195 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.175s
I20260709 13:02:47.621913  5160 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.909952  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1819) took 1394 ms. Trace:
I20260709 13:02:47.685515  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.911195  1602 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:47.791862  5003 consensus_queue.cc:1243] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:47.678428  5138 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.677547  5037 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
W20260709 13:02:47.820914  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 198867us
I20260709 13:02:47.634444  5072 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.824062  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:47.679461  5117 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.827392  5124 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:47.833819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:47.910121  5179 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:02:47.829394  5206 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:47.837550  5200 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:02:47.809294  5186 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.851046  5204 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.839027  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:47.953171  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 114262us
I20260709 13:02:47.935290  5138 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.812780  5045 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.834475  1610 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:47.873826  5184 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:47.827962  5207 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.660187  5142 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.814062  5116 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.815609  5059 consensus_queue.cc:1243] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:47.836881  5091 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.882295  5144 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:47.892226  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 255271us
I20260709 13:02:47.561553  5012 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:47.901350  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.910472  1683 rpcz_store.cc:276] 0709 13:02:46.515973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.516107 (+   134us) service_pool.cc:224] Handling call
0709 13:02:46.516404 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.516808 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.516833 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.517271 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:02:47.409075 (+891804us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003bb7e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:47.556231 (+147156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:47.745462 (+189231us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.888926 (+143464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.889037 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.889105 (+    68us) raft_consensus.cc:1685] finished
0709 13:02:47.909700 (+ 20595us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.909877 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68572,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":21257,"raft.queue_time_us":193332,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8500,"spinlock_wait_cycles":27294592,"thread_start_us":413914,"threads_started":3,"wal-append.queue_time_us":1233844}
I20260709 13:02:47.914170  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.839781  5123 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:47.850163  5027 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.931167  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.934083  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:47.602300  5199 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.887387  5061 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.801981  5159 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:47.940202  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:47.938984  5124 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.851074  5198 raft_consensus.cc:2764] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:47.965873  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:48.215497  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.215984  1608 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:48.047963  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1770) took 2399 ms. Trace:
W20260709 13:02:48.064327  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.216894  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:48.141994  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:48.218115  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:47.963958  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:48.042856  1498 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.038s	sys 0.066s
I20260709 13:02:48.216557  1601 rpcz_store.cc:276] 0709 13:02:45.648704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.447750 (+799046us) service_pool.cc:224] Handling call
0709 13:02:46.480917 (+ 33167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.568213 (+ 87296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.047524 (+1479311us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b540003cfd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:48.047804 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175308672}
W20260709 13:02:48.219614  1498 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.045s	sys 0.072s
W20260709 13:02:48.220079  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 831260us
I20260709 13:02:48.056802  4313 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:48.220773  4313 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:48.222230  1530 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.954689  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:48.222067  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 288078us
W20260709 13:02:48.017526  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 494667us
I20260709 13:02:48.223870  1528 pending_rounds.cc:85] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:02:48.228713  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:48.241238  1528 pending_rounds.cc:107] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:48.240859  1683 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:48.228394  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 273760us
I20260709 13:02:48.241560  1528 raft_consensus.cc:2889] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.944806  5160 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.224866  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:47.968353  5026 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.057046  5117 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.953018  5186 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.250155  4313 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.251418  4313 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:48.062436  5171 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.001s
I20260709 13:02:48.273669  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:48.285339  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:47.957758  5048 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.959681  5112 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.064862  5203 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:48.273466  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48679.1us
I20260709 13:02:48.018428  5206 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:48.182703  4859 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:48.288546  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:48.303547  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.304596  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:48.240631  5071 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:48.246227  5163 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.945345  5179 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:48.376995  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88522.7us
I20260709 13:02:48.378418  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:48.054955  5072 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:47.953522  4960 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.222011  5061 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.306185  1530 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:48.295965  5092 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:48.245301  5217 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:02:48.224807  5122 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:02:48.109453  5141 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.238044  5218 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.135s
I20260709 13:02:48.286362  5117 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.242799  5219 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:48.407792  1532 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:47.972731  5193 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.397s
I20260709 13:02:48.248883  5199 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:48.250226  5037 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:48.396756  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.306459  4908 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.306878  5166 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.393913  5203 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:48.338114  5036 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.455440  5036 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.458078  5036 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.395937  5092 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.458917  5092 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.287576  5171 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.462280  5171 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:48.304761  5073 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:02:48.466341  1679 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:02:48.246160  5154 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 13:02:48.405265  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.469401  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.470901  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.407101  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.473116  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.474527  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.475483  1526 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:48.409070  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.376109  5163 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:48.411305  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:48.476450  5163 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.305012  4613 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:02:48.423765  5219 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.424842  5207 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:48.476480  1535 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:48.407495  5218 consensus_queue.cc:1243] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:48.429924  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.483189  1533 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:48.394940  4960 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:48.402112  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.486418  1534 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:48.451059  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:48.453722  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 187825us
I20260709 13:02:48.487941  1531 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:48.488180  5225 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:48.489583  5116 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.496604  1680 raft_consensus.cc:2368] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13.
I20260709 13:02:48.425951  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.501456  1529 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:48.373719  4859 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.478946  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.480262  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:48.506599  1526 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.451012  5037 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.407676  5117 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:48.485140  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.404215  5206 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.452535  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.503051  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:48.488196  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:48.525360  1534 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:48.528102  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:48.503400  5166 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:48.534117  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.522835  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.532658  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.535020  1534 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:48.538787  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.477860  4908 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.524226  5037 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.524849  5117 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.542076  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.543967  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.544766  1533 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:48.483671  5146 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:02:48.532316  5161 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.550868  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.551642  1530 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:48.553078  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.555932  1534 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:48.426092  5184 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.570019  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.555692  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.399088  5015 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:48.545501  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.614567  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:48.615547  1527 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:48.617533  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 286874us
W20260709 13:02:48.518095  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 124778us
I20260709 13:02:48.620558  1531 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:48.527069  5199 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.628087  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.631182  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.632195  1531 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:48.640091  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.644487  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:48.595731  5161 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:48.645447  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.662582  1530 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:48.697664  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.549041  5228 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:02:48.627578  5231 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.694983  5133 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:48.699679  5003 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.701601  5141 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.789897  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:48.719105  5179 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:48.613607  5015 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.807772  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:48.813987  1529 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:02:48.788455  5238 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:48.819522  5177 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.789s	user 0.010s	sys 0.002s
I20260709 13:02:48.797410  4885 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:48.826857  5138 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.007s
W20260709 13:02:48.830191  5027 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 13:02:48.797353  5003 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:48.846930  1529 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:48.835055  5186 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.002s
I20260709 13:02:48.817906  5179 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:48.662056  5166 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.827625  4859 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.846879  5138 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.825749  5218 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:48.864475  5109 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.807281  5161 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.882472  5003 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.884116  5012 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.718406  5231 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.858768  5219 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.850029  5027 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.856954  5179 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.842507  5238 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.855144  5186 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.918812  5163 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:48.922219  5124 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.004s
I20260709 13:02:48.922878  5124 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.927266  5124 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.932600  5027 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.933955  5231 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:48.932595  5045 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.692s	user 0.014s	sys 0.029s
I20260709 13:02:48.942852  5045 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.944428  5167 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.945752  5061 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.010s
I20260709 13:02:48.931555  5186 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.945220  5167 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.947518  5061 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.949626  5061 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:48.951108  5092 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:48.952824  5117 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:48.957621  5160 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.705s	user 0.014s	sys 0.006s
W20260709 13:02:49.001740  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.077708  5117 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.077970  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1456) took 2470 ms. Trace:
I20260709 13:02:48.837232  1528 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:49.081207  5116 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.082230  5116 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.083526  1530 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:48.949210  5037 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.084652  1529 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 12. Ops: []
I20260709 13:02:48.954774  5092 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.073957  1533 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:49.074371  5015 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.078850  5117 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.104545  5117 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.107077  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:49.107607  5117 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.109860  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:49.110728  1608 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:49.093906  1526 consensus_meta.cc:287] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.586s	user 0.019s	sys 0.012s
I20260709 13:02:49.112921  1526 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:49.101570  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:49.113577  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.117235  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:49.119270  1610 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:49.120837  5218 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.124359  5218 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:49.124958  5218 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.124629  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1786) took 1496 ms. Trace:
I20260709 13:02:49.125572  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1840) took 1647 ms. Trace:
I20260709 13:02:49.125061  1601 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.126084  1679 rpcz_store.cc:276] 0709 13:02:47.477788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.509796 (+ 32008us) service_pool.cc:224] Handling call
0709 13:02:47.510093 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.467137 (+957044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.125006 (+657869us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54002ad5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:49.125397 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198324608}
I20260709 13:02:49.121675  1675 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.129192  1675 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.130878  1675 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.133298  1675 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.136530  1681 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:49.125841  1610 rpcz_store.cc:276] 0709 13:02:47.627845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.115363 (+1487518us) service_pool.cc:224] Handling call
0709 13:02:49.115919 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.124263 (+  8344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.124528 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.141040  5109 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.142519  5109 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:49.142599  5250 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:49.143047  5109 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.143990  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.145242  1683 raft_consensus.cc:2410] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:49.144968  5109 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.146858  5109 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.078480  1677 rpcz_store.cc:276] 0709 13:02:46.607479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.607590 (+   111us) service_pool.cc:224] Handling call
0709 13:02:46.607931 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.608283 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.608310 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.632568 (+ 24258us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.772258 (+139690us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.772318 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.772420 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.487135 (+714715us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b48000e0358. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:02:48.806506 (+1319371us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b2400255338. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcb09d 00007f4697bfd10e 00007f4697c1488c 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221
0709 13:02:49.077267 (+270761us) raft_consensus.cc:1685] finished
0709 13:02:49.077344 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.077716 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1366815,"raft.queue_time_us":423,"raft.run_cpu_time_us":16310,"raft.run_wall_time_us":2246037,"spinlock_wait_cycles":121866880,"thread_start_us":67950,"threads_started":1,"wal-append.queue_time_us":263563}
I20260709 13:02:49.154922  5045 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.156020  5008 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.158448  5008 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.160610  5008 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.162232  5008 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.162592  1675 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:02:49.163564  5158 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:02:49.156458  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.165198  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.168118  5250 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:49.154047  1608 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:49.174566  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.176164  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.176595  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:49.177129  1683 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:49.178177  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.179466  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.179590  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.180455  1678 raft_consensus.cc:2368] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:02:49.172096  5250 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.181564  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1838) took 1704 ms. Trace:
I20260709 13:02:49.188393  5154 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:49.188923  5154 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.189283  5012 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:49.189792  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.190121  5012 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:49.190596  5154 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.192974  5012 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:49.193066  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.193572  5092 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:49.194226  5192 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:49.181953  1675 rpcz_store.cc:276] 0709 13:02:47.477378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.507304 (+ 29926us) service_pool.cc:224] Handling call
0709 13:02:47.507610 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.121387 (+1613777us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54003c8d20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff0dc0 00007f469807b1c0 00007f469807c231 00007f4698078d8f 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c
0709 13:02:49.163156 (+ 41769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.181504 (+ 18348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49061248}
I20260709 13:02:49.190614  1683 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:49.198110  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.209262  1601 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:49.210561  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.213112  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.214232  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.199513  5192 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.218796  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.221359  1675 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.211308  5092 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:49.227908  1678 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:49.223937  5092 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:49.233506  5057 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:49.256683  5057 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.257144  5092 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.258258  5057 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.257694  1677 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.235112  5192 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.242993  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:49.244949  5172 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.245405  5116 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.246776  5250 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.249167  1601 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:49.252626  5218 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.255097  5179 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:49.234222  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.261111  1607 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:02:49.262836  5256 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:02:49.299109  1608 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:49.263276  4661 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:49.265733  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1817) took 2755 ms (client timeout 1536 ms). Trace:
W20260709 13:02:49.300665  1681 rpcz_store.cc:269] 0709 13:02:46.510690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.511100 (+   410us) service_pool.cc:224] Handling call
0709 13:02:49.265496 (+2754396us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b54000bf4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:49.265614 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5738343296}
I20260709 13:02:49.266348  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:49.302260  5218 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.303200  5048 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:49.303905  5048 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.259204  5092 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.266366  1678 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:49.295795  1675 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:49.305213  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1799) took 1664 ms. Trace:
I20260709 13:02:49.306730  1601 rpcz_store.cc:276] 0709 13:02:47.632584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.221174 (+1588590us) service_pool.cc:224] Handling call
0709 13:02:49.248762 (+ 27588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.296612 (+ 47850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.296872 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.305661  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1798) took 1668 ms. Trace:
I20260709 13:02:49.308720  1608 rpcz_store.cc:276] 0709 13:02:47.631969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.200331 (+1568362us) service_pool.cc:224] Handling call
0709 13:02:49.278929 (+ 78598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.299718 (+ 20789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.300000 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.309885  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1800) took 1674 ms. Trace:
I20260709 13:02:49.297286  5154 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.310401  1607 rpcz_store.cc:276] 0709 13:02:47.632900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.260215 (+1627315us) service_pool.cc:224] Handling call
0709 13:02:49.260642 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.305317 (+ 44675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.306751 (+  1434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.317595  5116 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.325544  5116 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:49.326052  5116 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.326690  5048 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:49.288836  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46202.7us
W20260709 13:02:49.342696  5026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.014s	sys 0.023s
W20260709 13:02:49.346055  5026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.014s	sys 0.023s
I20260709 13:02:49.346385  5026 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:49.346549  5255 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:49.348338  1601 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:02:49.349220  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1801) took 1716 ms. Trace:
I20260709 13:02:49.349668  1601 rpcz_store.cc:276] 0709 13:02:47.633191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.307887 (+1674696us) service_pool.cc:224] Handling call
0709 13:02:49.316559 (+  8672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.348861 (+ 32302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.349153 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.350240  5218 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.350972  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.351758  1601 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:49.351557  5218 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:49.352497  1501 leader_election.cc:400] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:02:49.357220  1501 leader_election.cc:403] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.352527  5192 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.360160  1608 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.361029  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1802) took 1727 ms. Trace:
I20260709 13:02:49.364087  1608 rpcz_store.cc:276] 0709 13:02:47.633484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.324470 (+1690986us) service_pool.cc:224] Handling call
0709 13:02:49.344718 (+ 20248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.360655 (+ 15937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.360964 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.377219  4313 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.377974  4313 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.347734  5026 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.386627  5218 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:49.387059  4859 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.387311  5218 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.384443  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.387526  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:49.406283  5172 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.412371  1679 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.412410  5027 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.413748  5041 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:49.413518  5027 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.414392  5041 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:49.403821  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.415987  5027 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.416041  4313 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.416224  4859 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.428200  4859 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.416901  5061 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.428539  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1795) took 1797 ms. Trace:
I20260709 13:02:49.428930  5061 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.428892  1610 rpcz_store.cc:276] 0709 13:02:47.631004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.138787 (+1507783us) service_pool.cc:224] Handling call
0709 13:02:49.139265 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.139756 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:49.249036 (+109280us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.428169 (+179133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.428237 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:49.428286 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.428354 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.428467 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227009,"prepare.queue_time_us":109987,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":118357,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":60068,"threads_started":1,"wal-append.queue_time_us":125830}
I20260709 13:02:49.431358  5061 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.431447  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.432301  5160 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.432848  1610 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:49.432911  5160 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.436223  5159 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.436321  5160 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.419130  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:49.438007  1601 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.419636  5117 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.442015  5041 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:49.445950  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.448653  5218 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.450316  5218 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.452669  1676 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:49.453368  5172 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:02:49.456681  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:49.436873  5261 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:49.524893  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.526172  1610 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:49.531515  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.528021  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 183) took 1695 ms. Trace:
I20260709 13:02:49.533964  1610 rpcz_store.cc:276] 0709 13:02:47.833077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.526871 (+1693794us) service_pool.cc:224] Handling call
0709 13:02:49.527273 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.527640 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.527669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.527734 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.527768 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.527840 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.527942 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.530612  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 184) took 1697 ms. Trace:
I20260709 13:02:49.541050  1605 rpcz_store.cc:276] 0709 13:02:47.833355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.529239 (+1695884us) service_pool.cc:224] Handling call
0709 13:02:49.529755 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.530021 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.530057 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.530149 (+    92us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:49.530204 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.530273 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.530414 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.561053  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:49.565007  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1843) took 2086 ms. Trace:
I20260709 13:02:49.566056  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1834) took 2174 ms. Trace:
I20260709 13:02:49.528363  5217 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:49.584717  4908 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.588442  5217 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.589315  5217 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.592492  5217 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.573637  1603 rpcz_store.cc:276] 0709 13:02:47.391857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.619099 (+227242us) service_pool.cc:224] Handling call
0709 13:02:47.643127 (+ 24028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.837077 (+193950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.565576 (+1728499us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400003054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:49.565894 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213736832}
I20260709 13:02:49.617707  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.619212  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.623199  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.624399  1684 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:49.625526  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.626277  1684 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
W20260709 13:02:49.628280  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.629201  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.632256  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.565442  1604 rpcz_store.cc:276] 0709 13:02:47.478802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.244020 (+765218us) service_pool.cc:224] Handling call
0709 13:02:48.245633 (+  1613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.245923 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:48.520778 (+274855us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.564294 (+1043516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.564396 (+   102us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.564530 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.564603 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.564767 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":759296,"prepare.queue_time_us":1001891,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":744663,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":293,"thread_start_us":502114,"threads_started":3,"wal-append.queue_time_us":194273}
W20260709 13:02:49.648105  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.646991  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.642835  1607 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.657014  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.633881  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.659749  1534 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:49.661630  1601 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:49.654935  5223 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:49.663062  5223 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.643226  5270 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.656502  5245 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:49.664497  5245 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.664361  5223 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.665709  5245 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.666453  5223 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.667166  5245 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.668311  1678 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.669890  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.671862  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:49.676483  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.609961  5091 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.677321  1603 raft_consensus.cc:2368] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:02:49.683874  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.684834  1684 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:49.689070  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.690786  1601 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:49.692093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.694242  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:49.699875  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.703658  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.587558  5039 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.709002  5039 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.664608  5270 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:49.711125  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.712772  4313 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.713367  5048 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.713595  5079 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:49.713982  5048 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.714320  5079 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.716528  5269 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.717053  1576 leader_election.cc:400] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13.
I20260709 13:02:49.717399  1576 leader_election.cc:403] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.717257  5269 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.713406  4313 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.724953  5061 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13.
I20260709 13:02:49.646021  5116 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.713024  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.732434  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.737119  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.739620  1607 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:49.740347  1684 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:49.740885  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 186) took 1902 ms. Trace:
I20260709 13:02:49.741448  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.741379  1607 rpcz_store.cc:276] 0709 13:02:47.838393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.642264 (+1803871us) service_pool.cc:224] Handling call
0709 13:02:49.642672 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.740527 (+ 97855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.740811 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.752882  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.713109  5270 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.759164  4313 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.711933  5266 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.765781  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.741593  4859 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.769979  1601 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:49.760799  1604 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:49.755446  5045 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.764513  5122 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:49.777035  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.774386  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.779985  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:49.779400  1678 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:49.779814  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.765133  5154 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:49.785964  1684 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:49.784570  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.789655  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:49.790756  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:49.791414  5034 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.791842  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1841) took 2209 ms. Trace:
I20260709 13:02:49.804919  1676 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:49.799408  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.792811  1604 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:49.795401  5157 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:49.795648  5079 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.777066  5122 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.796382  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 185) took 1962 ms. Trace:
I20260709 13:02:49.839910  1610 rpcz_store.cc:276] 0709 13:02:47.833577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.673017 (+1839440us) service_pool.cc:224] Handling call
0709 13:02:49.760382 (+ 87365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.780100 (+ 19718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.780132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.784543 (+  4411us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:49.796090 (+ 11547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.796166 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.796305 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.785029  5048 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.796911  5154 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.781250  4859 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:49.798552  5266 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.801191  5116 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.802213  1601 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:49.836542  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1804) took 1551 ms. Trace:
I20260709 13:02:49.777199  5045 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.843959  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.856145  1684 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.859826  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.860369  5192 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.860848  5192 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:49.861030  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.861470  5192 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.861785  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.862995  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.863780  1526 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:49.864205  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 94143.2us
I20260709 13:02:49.835515  5157 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:49.865765  5157 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.867273  5157 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:49.868122  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88392.2us
I20260709 13:02:49.868949  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.869860  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:49.870215  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.871206  1610 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:49.871323  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:49.871910  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1808) took 1242 ms. Trace:
I20260709 13:02:49.872244  1610 rpcz_store.cc:276] 0709 13:02:48.629581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.853690 (+1224109us) service_pool.cc:224] Handling call
0709 13:02:49.870851 (+ 17161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.871625 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.871833 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.873591  5122 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.874255  1610 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:49.875834  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1422) took 1465 ms. Trace:
I20260709 13:02:49.876271  1533 rpcz_store.cc:276] 0709 13:02:48.410274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.645772 (+235498us) service_pool.cc:224] Handling call
0709 13:02:48.694693 (+ 48921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.103487 (+408794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.875515 (+772028us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:49.875735 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711532288}
I20260709 13:02:49.877630  1607 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.877740  5266 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.879156  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1840) took 2421 ms. Trace:
I20260709 13:02:49.879415  1607 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:49.881557  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.882301  5045 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.803732  1602 rpcz_store.cc:276] 0709 13:02:47.463356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.222932 (+759576us) service_pool.cc:224] Handling call
0709 13:02:48.232765 (+  9833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.233044 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:48.623676 (+390632us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.541866 (+918190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.562708 (+ 20842us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.607485 (+ 44777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.615874 (+  8389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.672918 (+ 57044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":599015,"prepare.queue_time_us":1014539,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":620911,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":260,"thread_start_us":631178,"threads_started":3,"wal-append.queue_time_us":169587,"wal-append.run_cpu_time_us":1657,"wal-append.run_wall_time_us":1001559}
I20260709 13:02:49.885735  1602 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.885807  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:49.854117  1604 rpcz_store.cc:276] 0709 13:02:48.285418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.779815 (+1494397us) service_pool.cc:224] Handling call
0709 13:02:49.792529 (+ 12714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.836101 (+ 43572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.836465 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.888996  4313 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:49.889060  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.887348  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.891180  1680 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:49.871413  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.892403  1678 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:49.877760  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:49.893455  1532 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.897248  1684 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:49.901803  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.902868  1684 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:49.928634  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57387.7us
I20260709 13:02:49.931391  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.936705  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:49.869886  5154 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.879617  1609 rpcz_store.cc:276] 0709 13:02:47.457178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.218876 (+761698us) service_pool.cc:224] Handling call
0709 13:02:48.223276 (+  4400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.223468 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:48.382044 (+158576us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.561495 (+1179451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.577703 (+ 16208us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:49.680276 (+102573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.728336 (+ 48060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.878844 (+150508us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5400086450. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:49.878965 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1357332,"prepare.queue_time_us":166609,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":596224,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"spinlock_wait_cycles":9554688,"thread_start_us":701512,"threads_started":3,"wal-append.queue_time_us":500630}
I20260709 13:02:49.954312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.955446  1678 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:49.957888  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.958802  1680 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.959753  1610 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.921254  5122 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:49.972626  5059 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:49.973150  5072 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:49.973917  5072 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.976114  5223 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:49.976568  5223 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.976917  5223 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.978353  5037 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.980150  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:49.981040  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:49.981703  1682 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.981788  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:49.983350  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:49.984163  5229 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.984935  5154 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.984781  5229 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.985358  1535 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.985680  5154 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.986941  1535 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: [5.4-9.6]
I20260709 13:02:49.987342  5229 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:49.990816  5072 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:49.991765  5218 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.992337  5218 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:49.992864  5218 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.996243  1535 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:49.997927  1535 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:49.998221  1682 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:49.998023  5192 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:49.999147  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.999867  1682 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:50.002094  1534 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:50.002635  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:49.961319  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.023105  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.024015  1684 raft_consensus.cc:2368] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
W20260709 13:02:50.025595  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50048.6us
I20260709 13:02:50.028882  1534 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:50.024335  1677 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:49.895800  5034 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.021899  5116 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.023977  4613 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.054124  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:50.055246  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.057701  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.059541  1532 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:50.061440  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:50.065420  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1428) took 1639 ms. Trace:
I20260709 13:02:50.065874  1530 rpcz_store.cc:276] 0709 13:02:48.425917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.677863 (+251946us) service_pool.cc:224] Handling call
0709 13:02:48.707278 (+ 29415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.084004 (+376726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.065101 (+981097us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54004411d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:50.065346 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679132416}
W20260709 13:02:50.068194  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.073256  1676 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:50.073673  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:50.078284  5071 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:50.078953  5071 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:50.079833  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.080299  4907 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:02:50.081905  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98686.1us
I20260709 13:02:50.082389  5167 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:50.083081  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:50.084679  5162 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.086122  4907 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:50.086563  4907 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:50.090891  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.043877  5123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.757s	user 0.012s	sys 0.013s
W20260709 13:02:50.103045  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 266859us
I20260709 13:02:50.104176  5271 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.104628  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:50.056988  5192 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:50.093819  5123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.812s	user 0.013s	sys 0.013s
I20260709 13:02:50.095979  5167 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:50.115944  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.116240  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:50.060570  5116 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.105022  5271 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.108994  5091 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:50.147943  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.148998  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.181859  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.110114  5123 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:02:50.199680  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 359600us
I20260709 13:02:50.129352  5091 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.119532  5092 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:02:50.199195  4931 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:50.248564  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:50.114450  4613 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.249871  5091 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.287488  5192 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.290275  5203 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:50.278028  4907 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.283991  5223 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.198496  5071 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:50.302369  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.316154  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 145121us
W20260709 13:02:50.320096  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 257123us
I20260709 13:02:50.339359  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.426580  1609 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:50.379091  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.379876  1684 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:50.402545  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 303418us
I20260709 13:02:50.340229  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1835) took 2945 ms. Trace:
I20260709 13:02:50.352165  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:02:50.308537  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.016s	sys 0.024s
W20260709 13:02:50.462733  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.016s	sys 0.025s
W20260709 13:02:50.462783  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 110517us
I20260709 13:02:50.405251  1680 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:02:50.471577  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.472800  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:50.476317  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 355164us
I20260709 13:02:50.473611  1680 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:50.477356  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.481980  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:50.294513  5270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.026s
I20260709 13:02:50.482707  1683 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:50.337190  4907 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.353529  5172 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:50.337714  5142 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:50.525076  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49140.9us
I20260709 13:02:50.490029  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:50.322305  4613 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.356613  5203 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:50.398739  5071 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:50.475577  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.509s (SENT) [suppressed 3 similar messages]
I20260709 13:02:50.303238  4931 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:50.550947  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.303210  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.024s	sys 0.077s
I20260709 13:02:50.345423  5265 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.190s
I20260709 13:02:50.536226  1576 leader_election.cc:400] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:50.321802  5271 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.466817  5280 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.324842  5034 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.320993  5238 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:50.531257  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62757.9us
I20260709 13:02:50.548385  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.584576  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:50.585175  5269 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.585289  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.585942  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:50.586267  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:50.586572  1605 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:50.461560  1606 rpcz_store.cc:276] 0709 13:02:47.394270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.218392 (+824122us) service_pool.cc:224] Handling call
0709 13:02:48.220254 (+  1862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.220516 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:48.222618 (+  2102us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.245259 (+1022641us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800059740. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:02:49.245641 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.302740 (+ 57099us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800059740. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:49.422275 (+119535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.422372 (+    97us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.422467 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.422558 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.339855 (+917297us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b540003cad0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:50.339993 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324143,"prepare.queue_time_us":937822,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":104,"raft.queue_time_us":205737,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":30329,"spinlock_wait_cycles":48311680,"thread_start_us":88974,"threads_started":1,"wal-append.queue_time_us":263507,"wal-append.run_cpu_time_us":2854,"wal-append.run_wall_time_us":1761196}
W20260709 13:02:50.550647  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75095.7us
I20260709 13:02:50.587646  5239 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:02:50.589780  4859 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:50.590772  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.591586  1607 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:50.586581  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.592815  1607 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:50.598176  4859 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:50.598878  4859 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.600310  5144 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.601845  4859 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.587525  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.555799  1576 leader_election.cc:403] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:50.541697  1676 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
W20260709 13:02:50.294469  5015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.028s
W20260709 13:02:50.555941  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65648us
W20260709 13:02:50.514796  5270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.026s
W20260709 13:02:50.542676  5218 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.003s
W20260709 13:02:50.569012  5284 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
W20260709 13:02:50.570063  5286 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:50.572633  5163 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:50.572744  5223 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:50.572788  4931 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.573684  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:50.675993  1601 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:50.575824  5138 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:50.582870  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:50.681239  1604 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:50.587617  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:50.588259  5192 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.525494  5142 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:50.491092  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:50.689141  1682 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:50.525264  5172 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:50.537668  5116 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:50.643756  1605 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:50.646076  2211 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:02:50.677990  5157 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.002s
W20260709 13:02:50.648897  5287 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260709 13:02:50.650278  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 114225us
I20260709 13:02:50.694440  1676 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:50.694351  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:50.650800  5280 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:50.602370  5144 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:50.660823  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:50.352437  5123 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.697472  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1651) took 1240 ms. Trace:
W20260709 13:02:50.664513  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.647989  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.024s	sys 0.086s
I20260709 13:02:50.666175  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:50.658440  5015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.003s	sys 0.028s
I20260709 13:02:50.687117  1601 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:50.609846  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.661877  5239 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:50.700971  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.707191  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46444.6us
I20260709 13:02:50.708666  1681 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:50.710897  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:50.688354  5223 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.720335  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1482) took 1529 ms. Trace:
I20260709 13:02:50.721131  1675 rpcz_store.cc:276] 0709 13:02:49.191150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.336488 (+145338us) service_pool.cc:224] Handling call
0709 13:02:49.336933 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.372503 (+ 35570us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:49.388464 (+ 15961us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.719676 (+1331212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.719755 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.719857 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.720002 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.720224 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18162,"prepare.queue_time_us":24479,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"thread_start_us":1272712,"threads_started":1,"wal-append.queue_time_us":568013}
I20260709 13:02:50.671460  5218 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.729318  5122 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:50.730104  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.016s	sys 0.011s
W20260709 13:02:50.730760  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143231us
W20260709 13:02:50.732492  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.016s	sys 0.012s
I20260709 13:02:50.703460  5265 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:50.735282  1677 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.003s
I20260709 13:02:50.741886  1677 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:50.737673  1604 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.713842  5092 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.697980  1529 rpcz_store.cc:276] 0709 13:02:49.456931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.457350 (+   419us) service_pool.cc:224] Handling call
0709 13:02:49.457670 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.528629 (+ 70959us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:49.898626 (+369997us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.696916 (+798290us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.697134 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.697176 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.697237 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.697300 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.697406 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12402,"prepare.queue_time_us":349897,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":30115,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6219,"thread_start_us":1083760,"threads_started":3,"wal-append.queue_time_us":724613}
I20260709 13:02:50.748775  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.714222  5192 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:50.761181  1683 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.742484  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:50.746752  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1877) took 1133 ms. Trace:
W20260709 13:02:50.767513  2175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.028s	sys 0.046s
W20260709 13:02:50.768262  2175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.028s	sys 0.046s
W20260709 13:02:50.768636  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 110385us
I20260709 13:02:50.733968  5144 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:50.705528  4859 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:50.741551  5265 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.763427  1679 rpcz_store.cc:276] 0709 13:02:49.704917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.708798 (+  3881us) service_pool.cc:224] Handling call
0709 13:02:49.736553 (+ 27755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.757681 (+ 21128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.757726 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.765910 (+  8184us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.092951 (+327041us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:50.092992 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.093064 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.746508 (+653444us) raft_consensus.cc:1685] finished
0709 13:02:50.746530 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.746691 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12132,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4433,"thread_start_us":305968,"threads_started":1,"wal-append.queue_time_us":616705}
I20260709 13:02:50.723038  5239 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:50.773878  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:50.841353  5295 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:50.841426  5144 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.841533  5157 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.901875  1678 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.843791  5142 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:50.846647  5294 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
I20260709 13:02:50.846328  5172 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:50.848237  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 106252us
W20260709 13:02:50.850471  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.851390  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:50.851675  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.918215  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.918814  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.852241  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.919581  1605 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.852985  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:50.920460  1607 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:50.691874  5203 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:50.856246  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 151076us
I20260709 13:02:50.856801  5280 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.860841  5192 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:50.862021  5122 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:50.868844  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1432) took 2412 ms. Trace:
W20260709 13:02:50.876792  5289 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:02:50.881073  5299 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:02:50.882846  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1805) took 2597 ms. Trace:
I20260709 13:02:50.847659  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:50.905892  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1495) took 1034 ms. Trace:
W20260709 13:02:50.909869  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49539.7us
I20260709 13:02:50.915239  1601 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:50.921479  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70156.5us
I20260709 13:02:50.896787  5265 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.924558  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:51.027392  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102930us
I20260709 13:02:51.028100  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:50.927743  5218 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:50.928258  5280 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:50.923983  5057 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.942776  5307 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.944299  5259 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.679s	user 0.010s	sys 0.004s
I20260709 13:02:50.943924  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:50.942860  1609 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:50.944770  1605 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:50.945374  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1811) took 1289 ms. Trace:
W20260709 13:02:50.960281  5291 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.308s	user 0.000s	sys 0.003s
I20260709 13:02:50.970108  5239 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:51.037288  4859 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.916370  5157 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.046267  4859 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.046681  4859 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.994604  5172 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:50.995172  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.995519  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:50.996466  5142 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.081588  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:50.967721  5091 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.657s	user 0.002s	sys 0.006s
I20260709 13:02:51.020428  1681 rpcz_store.cc:276] 0709 13:02:49.871113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.893612 (+ 22499us) service_pool.cc:224] Handling call
0709 13:02:50.905629 (+1012017us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54003cb9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:50.905796 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585814400}
I20260709 13:02:51.030198  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:51.025565  5304 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:02:51.018555  1603 rpcz_store.cc:276] 0709 13:02:48.285788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.783438 (+1497650us) service_pool.cc:224] Handling call
0709 13:02:49.786977 (+  3539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.787577 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.787617 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.788366 (+   749us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.025543 (+237177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.025582 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.025654 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.882601 (+856947us) raft_consensus.cc:1685] finished
0709 13:02:50.882626 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.882776 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":235,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":236692,"threads_started":1,"wal-append.queue_time_us":581537}
I20260709 13:02:51.032265  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:51.032323  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.998054  5122 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.090157  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1887) took 1292 ms. Trace:
I20260709 13:02:51.090582  1684 rpcz_store.cc:276] 0709 13:02:49.798072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.087849 (+289777us) service_pool.cc:224] Handling call
0709 13:02:50.099885 (+ 12036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.428339 (+328454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.089880 (+661541us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54003dfed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:51.090090 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632705920}
I20260709 13:02:51.033424  5057 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.097733  5057 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:51.039618  1602 rpcz_store.cc:276] 0709 13:02:49.655449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.886864 (+231415us) service_pool.cc:224] Handling call
0709 13:02:49.887199 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.956864 (+ 69665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.956894 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.984354 (+ 27460us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.387111 (+402757us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.389603 (+  2492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.389690 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.945094 (+555404us) raft_consensus.cc:1685] finished
0709 13:02:50.945117 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.945296 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50240,"raft.queue_time_us":69368,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6143,"thread_start_us":402335,"threads_started":1,"wal-append.queue_time_us":704518}
I20260709 13:02:50.932302  1531 rpcz_store.cc:276] 0709 13:02:48.455885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.698907 (+243022us) service_pool.cc:224] Handling call
0709 13:02:48.711013 (+ 12106us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:48.716656 (+  5643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.746111 (+ 29455us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:49.983006 (+1236895us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:49.983858 (+   852us) log.cc:844] Serialized 78 byte log entry
0709 13:02:50.460952 (+477094us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:50.461002 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.490783 (+ 29781us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.868356 (+377573us) raft_consensus.cc:1685] finished
0709 13:02:50.868375 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.868649 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5116,"raft.queue_time_us":32845,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":7217920,"thread_start_us":436761,"threads_started":1,"wal-append.queue_time_us":782132}
W20260709 13:02:51.101053  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 68846.2us
I20260709 13:02:51.041075  5307 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.032840  5138 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:51.084437  2210 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:02:51.033680  5071 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:51.077443  5034 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.115038  5218 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:51.121026  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.122607  5167 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:51.123492  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:51.128255  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 184456us
I20260709 13:02:51.124259  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.124579  5307 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.115074  5165 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:51.112740  5269 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:51.128415  1602 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:51.129156  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1803) took 3403 ms. Trace:
I20260709 13:02:51.142226  1604 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:51.142727  1601 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:51.112920  5071 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.135543  1603 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:51.146432  1608 rpcz_store.cc:276] 0709 13:02:47.725965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.516928 (+1790963us) service_pool.cc:224] Handling call
0709 13:02:49.575073 (+ 58145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.699952 (+124879us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:49.762029 (+ 62077us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.198139 (+436110us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.281140 (+ 83001us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.281328 (+   188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:50.281375 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.281469 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.863688 (+582219us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:51.117062 (+253374us) raft_consensus.cc:1685] finished
0709 13:02:51.128889 (+ 11827us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.129060 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1903,"prepare.queue_time_us":31370,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":5783,"raft.queue_time_us":23373,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":58373,"spinlock_wait_cycles":8989184,"thread_start_us":396128,"threads_started":1,"wal-append.queue_time_us":876149}
I20260709 13:02:51.125396  5057 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:51.153810  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:51.154868  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 307278us
I20260709 13:02:51.085508  5239 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:02:51.105571  5091 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.181147  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 253557us
W20260709 13:02:51.167695  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.023s
I20260709 13:02:51.149204  5071 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:51.196297  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.016s	sys 0.023s
I20260709 13:02:51.149930  5269 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.197829  1528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.018s	sys 0.022s
I20260709 13:02:51.198005  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:51.201354  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:51.203116  1528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.019s	sys 0.022s
W20260709 13:02:51.198581  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 53) took 12150 ms (client timeout 15000 ms). Trace:
I20260709 13:02:51.145100  5167 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:51.226096  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.234455  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:51.206916  5269 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.216266  5122 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.117198  5280 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.209497  5057 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:51.293095  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95168.5us
W20260709 13:02:51.302582  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.231562  5138 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.349858  5138 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:51.350397  5138 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.261924  5223 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.360531  5223 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.364283  5223 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:51.366466  5138 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:51.324113  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.024s	sys 0.024s
W20260709 13:02:51.372455  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.024s	sys 0.024s
I20260709 13:02:51.287827  5165 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.373312  5165 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:51.373765  5165 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.285569  5003 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:51.342126  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:51.343806  5306 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:51.343627  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.381379  5091 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.381510  5138 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:51.386512  5165 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.389137  5165 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.285511  5092 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:51.393121  5092 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.397066  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.344000  5301 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.590s	user 0.013s	sys 0.000s
W20260709 13:02:51.345726  5308 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:51.347227  5057 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.348853  5122 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:51.348891  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:51.371138  4859 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.421931  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.422837  1603 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:02:51.410559  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.236136  5157 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:51.429116  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.297236  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1653) took 1747 ms. Trace:
W20260709 13:02:51.249416  1433 rpcz_store.cc:269] 0709 13:02:38.956118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.956363 (+   245us) service_pool.cc:224] Handling call
0709 13:02:51.106577 (+12150214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:45.484126 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:45.484776 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:45.484821 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:02:45.484845 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:45.485657 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:45.485746 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:45.485780 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:02:45.486371 (+   591us) tablet.cc:701] Row locks acquired
0709 13:02:45.486387 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:45.486535 (+   148us) write_op.cc:270] Start()
0709 13:02:45.486640 (+   105us) write_op.cc:276] Timestamp: P: 1783602165486486 usec, L: 0
0709 13:02:45.486656 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:02:45.487438 (+   782us) log.cc:844] Serialized 2131 byte log entry
0709 13:02:47.484623 (+1997185us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:47.953896 (+469273us) op_driver.cc:464] REPLICATION: finished
0709 13:02:48.199196 (+245300us) write_op.cc:301] APPLY: starting
0709 13:02:48.222471 (+ 23275us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:48.286785 (+ 64314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:48.298265 (+ 11480us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.505161 (+206896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.534202 (+ 29041us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:02:48.538260 (+  4058us) write_op.cc:312] APPLY: finished
0709 13:02:48.570024 (+ 31764us) log.cc:844] Serialized 46 byte log entry
0709 13:02:48.612522 (+ 42498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.622820 (+ 10298us) write_op.cc:454] Released schema lock
0709 13:02:48.624626 (+  1806us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:48.711656 (+ 87030us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.715314 (+  3658us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3003906,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":202960,"apply.run_cpu_time_us":4634,"apply.run_wall_time_us":515783,"num_ops":5,"prepare.queue_time_us":38106,"prepare.run_cpu_time_us":43079,"prepare.run_wall_time_us":230305,"raft.queue_time_us":372068,"raft.run_cpu_time_us":7005,"raft.run_wall_time_us":312089,"replication_time_us":2443961,"spinlock_wait_cycles":334573440,"thread_start_us":437008,"threads_started":4,"wal-append.queue_time_us":368435,"wal-append.run_cpu_time_us":86625,"wal-append.run_wall_time_us":3883712}]]}
I20260709 13:02:51.452232  1602 raft_consensus.cc:2368] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12.
W20260709 13:02:51.453173  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 104415us
W20260709 13:02:51.425974  5072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.015s
I20260709 13:02:51.457330  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.432354  5165 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.445401  5138 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:51.455124  5144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.050s	sys 0.065s
I20260709 13:02:51.442113  1528 rpcz_store.cc:276] 0709 13:02:49.549759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.549923 (+   164us) service_pool.cc:224] Handling call
0709 13:02:49.564361 (+ 14438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:49.565025 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.565056 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:49.565631 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.463513 (+897882us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:50.542428 (+ 78915us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.599320 (+ 56892us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180027f880. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:02:51.250461 (+651141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.250534 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.250571 (+    37us) raft_consensus.cc:1685] finished
0709 13:02:51.279936 (+ 29365us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.297149 (+ 17213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13769,"prepare.queue_time_us":82693,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":116768,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":1830,"spinlock_wait_cycles":10812800,"thread_start_us":1548287,"threads_started":2,"wal-append.queue_time_us":741144}
W20260709 13:02:51.503589  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.465104  5072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.011s	sys 0.015s
W20260709 13:02:51.412739  5270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.012s	sys 0.025s
W20260709 13:02:51.473126  5123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.013s
I20260709 13:02:51.454077  5311 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.535279  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.541733  1603 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.470793  5307 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.536463  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:51.504146  5144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.050s	sys 0.068s
I20260709 13:02:51.541550  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:51.474083  5303 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.547991  1679 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.539423  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.550369  1608 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.500680  5163 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:51.533463  5270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.013s	sys 0.025s
I20260709 13:02:51.553113  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:51.560092  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.477782  5310 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.571552  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.565842  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.566489  1604 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.562568  1681 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:02:51.537824  5123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.002s	sys 0.013s
W20260709 13:02:51.538604  5015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.014s	sys 0.009s
W20260709 13:02:51.547500  4931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.017s	sys 0.039s
I20260709 13:02:51.544176  5162 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.543829  5116 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.571951  5203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.010s	sys 0.026s
W20260709 13:02:51.610594  4931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.017s	sys 0.039s
W20260709 13:02:51.626924  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.608001  5015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.009s
W20260709 13:02:51.627003  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97131.4us
I20260709 13:02:51.605896  5144 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:51.650848  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1657) took 2021 ms. Trace:
W20260709 13:02:51.622318  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 421056us
I20260709 13:02:51.630051  1676 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
W20260709 13:02:51.629724  5203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.010s	sys 0.027s
I20260709 13:02:51.661646  1676 pending_rounds.cc:85] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 7
I20260709 13:02:51.644621  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.651473  1533 rpcz_store.cc:276] 0709 13:02:49.629690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.962280 (+332590us) service_pool.cc:224] Handling call
0709 13:02:50.021577 (+ 59297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.044779 (+ 23202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:50.072623 (+ 27844us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.406707 (+334084us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.460962 (+ 54255us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.461144 (+   182us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:50.461182 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.461265 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.343704 (+882439us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b24001589a8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcb09d 00007f4697bfd10e 00007f4697c1488c 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221
0709 13:02:51.641334 (+297630us) raft_consensus.cc:1685] finished
0709 13:02:51.650580 (+  9246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.650782 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23839,"prepare.queue_time_us":20519,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":89,"raft.queue_time_us":6675,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":45494,"spinlock_wait_cycles":9977728,"thread_start_us":333095,"threads_started":1,"wal-append.queue_time_us":629336}
I20260709 13:02:51.559316  5307 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.686264  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.687127  1609 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:51.688117  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.688261  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.688644  5307 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.688998  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.689671  1605 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:51.690948  1607 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.677829  4859 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.660413  5167 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:51.606125  5303 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.684301  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:51.669883  1676 pending_rounds.cc:107] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:51.684612  1601 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.685578  1602 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:51.713518  1676 raft_consensus.cc:2889] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:51.685374  5163 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:51.616837  5310 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.701285  1608 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:02:51.720381  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.044s	sys 0.062s
W20260709 13:02:51.720764  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.044s	sys 0.062s
W20260709 13:02:51.721050  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 613789us
I20260709 13:02:51.721246  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:51.726897  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.727703  1602 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.730362  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.651507  5116 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.732689  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.733264  1605 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:51.734362  5116 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.729002  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:51.712411  5192 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:51.729664  5138 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.722525  5144 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:51.737195  5192 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:51.738258  5144 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.645534  5091 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:02:51.740751  5091 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:51.741133  5091 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:51.741214  5165 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.742048  5091 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.743163  5303 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.722652  5163 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.750976  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:51.627118  5311 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.758827  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:51.764925  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80727.4us
I20260709 13:02:51.767601  5165 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.768190  5165 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.768633  5165 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.771292  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:51.696280  5162 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.772403  5238 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:51.773082  5238 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:51.773953  5162 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.774245  5238 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.743243  5091 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.737210  5138 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.754065  5192 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:51.791306  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 564930us
I20260709 13:02:51.793596  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.723096  5167 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:02:51.794330  1601 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:02:51.799741  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 193318us
W20260709 13:02:51.805120  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.789654  5138 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.788380  5218 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:51.829270  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:51.831846  1679 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:51.792016  5325 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:51.834167  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:51.778964  5072 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:51.794015  5270 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:51.850543  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.840054  5323 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.854038  1610 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.834475  5218 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.873258  5071 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 13:02:51.855074  4859 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:51.871668  5092 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.868714  5323 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.889526  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 94069.8us
I20260709 13:02:51.870863  5218 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.882388  5280 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.876163  5192 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.852943  5270 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.910374  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.916814  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:51.851125  5325 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.926100  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96938.3us
W20260709 13:02:51.926725  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 336609us
I20260709 13:02:51.883543  5269 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.896760  5092 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:51.937285  1609 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:51.946660  1602 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:51.947413  1610 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:51.891666  5071 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.927206  1498 connection.cc:256] RPC call timeout handler was delayed by -2.7048191039999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 13:02:51.928529  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:51.965932  1498 connection.cc:256] RPC call timeout handler was delayed by -2.6463191039999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:02:51.966506  1498 connection.cc:256] RPC call timeout handler was delayed by -2.6103191039999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:02:51.966581  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62328.4us
W20260709 13:02:51.967676  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.930083  5310 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:51.947749  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.931579  5325 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:51.893857  4859 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:51.968914  1498 connection.cc:256] RPC call timeout handler was delayed by -2.3922306759999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:02:51.969340  1498 connection.cc:256] RPC call timeout handler was delayed by -2.1954191039999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.253s for a response
I20260709 13:02:51.970109  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:51.928398  5072 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:51.973420  1498 connection.cc:256] RPC call timeout handler was delayed by -1.390245144000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:02:51.973925  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3794451439999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:02:51.974054  5265 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.003s
W20260709 13:02:51.974298  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3520010749999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:02:51.974735  1498 connection.cc:256] RPC call timeout handler was delayed by -1.3146451439999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:02:51.974881  5320 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:51.976198  5310 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:51.976504  5092 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:51.977062  5092 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:51.977664  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2873208629999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 13:02:51.977540  5092 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.978097  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2642451439999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:02:51.978523  1498 connection.cc:256] RPC call timeout handler was delayed by -1.2156451440000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:02:51.978932  1498 connection.cc:256] RPC call timeout handler was delayed by -1.1144010749999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:02:51.979408  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0896451439999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:02:51.976765  5310 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:51.979810  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0788451440000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:02:51.983590  1498 connection.cc:256] RPC call timeout handler was delayed by -1.0523010750000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:02:51.983987  1498 connection.cc:256] RPC call timeout handler was delayed by -1.033401074999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:02:51.985750  1602 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:51.992750  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 64296.4us
I20260709 13:02:51.993460  1603 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:51.993633  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:51.986749  5167 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:51.981384  5142 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.000s
I20260709 13:02:51.973984  5123 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:51.979851  5092 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.000811  5238 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.994791  5325 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.024806  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.974635  5265 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.007812  5310 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.002702  5123 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:52.015784  5218 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:52.038139  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.038090  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.040293  1606 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
W20260709 13:02:52.045101  5338 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:52.026187  5325 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.061175  5325 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.061410  5123 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.062923  5123 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.063457  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:52.050249  5238 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.064268  1608 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:52.064905  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.066468  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.024626  5280 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:02:52.068284  5315 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:52.068363  5280 consensus_queue.cc:1243] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:52.069006  5315 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:52.068619  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.070248  5315 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.070739  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.071293  5270 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.029450  5072 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:52.064781  5163 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.069043  5091 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:52.079738  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61849.6us
I20260709 13:02:52.069059  5280 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:52.075595  5238 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.087551  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.095079  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1827) took 1445 ms. Trace:
W20260709 13:02:52.093281  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.095854  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.095507  1606 rpcz_store.cc:276] 0709 13:02:50.645067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.645206 (+   139us) service_pool.cc:224] Handling call
0709 13:02:52.088661 (+1443455us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003110d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:52.090781 (+  2120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060340480}
I20260709 13:02:52.082556  5339 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.097892  5329 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:52.098497  5329 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.096360  5071 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.111287  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.115985  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.114416  5328 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:52.119148  5339 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:52.119673  5328 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.074218  5122 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:02:52.122246  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.091418  5280 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:52.108711  5165 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.094353  5091 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:52.119830  5339 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.141283  5091 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.142760  5339 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.143682  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.110793  5157 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.156104  1684 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:52.092269  5239 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:02:52.136221  5350 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.139575  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.125028  5144 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.135038  5057 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:52.157663  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.158474  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.158983  5329 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.140194  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.166567  1677 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:52.174297  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.174417  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.178304  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.179436  1682 raft_consensus.cc:2393] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:52.181571  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.182704  1678 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:02:52.183422  1683 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:52.184614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:52.185829  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.186075  1675 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:52.187070  5265 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.187225  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.191835  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:52.192677  1533 raft_consensus.cc:606] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.192974  1677 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:52.195343  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:52.195566  5138 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.175964  5218 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.197454  5057 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.161579  5157 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.223438  5165 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.223037  5057 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:52.264624  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 155444us
W20260709 13:02:52.262629  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3452630359999489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:02:52.279064  1574 connection.cc:256] RPC call timeout handler was delayed by -1.3227630359999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 13:02:52.279667  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2912630359999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:02:52.280274  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2543630359999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:02:52.280766  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2309630359999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:02:52.281152  1574 connection.cc:256] RPC call timeout handler was delayed by -1.2066630359999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:02:52.281528  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1913630359999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:02:52.281991  1574 connection.cc:256] RPC call timeout handler was delayed by -1.1571630359999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:02:52.165555  5350 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.288714  1680 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:52.289621  5138 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.290180  5350 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.277885  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.297914  5167 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.298115  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.301362  5344 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.273546  5163 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.301995  5344 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:52.306061  5344 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:52.309675  5358 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.310302  5358 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.310698  5358 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:52.312107  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.324108  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:52.328665  1647 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:52.329135  1647 leader_election.cc:403] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.330021  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.330757  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:52.331370  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.331590  1533 raft_consensus.cc:606] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.332176  1533 raft_consensus.cc:614] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:52.333247  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.334528  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:52.335745  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.337360  1677 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:52.319504  5091 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.353209  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:52.179843  5328 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:52.356305  5332 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:52.366173  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.366526  5316 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.366850  2210 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:52.367095  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:52.367654  1533 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:52.368472  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68653.3us
I20260709 13:02:52.351244  5310 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.369230  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.364359  1676 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:52.376009  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:52.389871  1602 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:52.393204  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:52.393980  1602 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.399221  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:52.371917  5239 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.399951  1607 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.401139  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:52.423491  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 307521us
I20260709 13:02:52.382692  5310 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.380828  5142 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.373000  5316 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:52.430105  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.437644  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:52.444168  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82478.7us
I20260709 13:02:52.417663  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:52.429765  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:52.446097  1610 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.430843  5092 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.456907  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:52.459647  1601 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:52.435534  5310 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:52.448908  5357 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:52.407970  4931 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:52.433943  5165 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:52.497443  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:52.498930  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62198.4us
I20260709 13:02:52.425716  5072 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:52.458900  5315 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:52.449882  5332 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.448694  5057 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:52.546195  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80932.2us
W20260709 13:02:52.546983  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 146804us
W20260709 13:02:52.498761  5334 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:52.503679  5157 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:52.552778  5311 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:52.576656  5123 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.006s
I20260709 13:02:52.546885  5072 consensus_queue.cc:1243] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:52.557574  5315 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.577525  5315 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.578783  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.580624  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.554605  1607 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:52.555442  5165 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:52.548341  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88523.9us
I20260709 13:02:52.561611  5192 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.562026  5316 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.586637  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:52.587067  5192 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.587478  1606 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 7.
I20260709 13:02:52.586511  1605 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:52.565847  1610 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:52.569223  4859 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:52.460897  5092 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.587544  5192 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.592751  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.547474  1602 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:52.591413  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.599148  5351 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:52.599344  5144 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:52.595955  5003 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:02:52.600517  5144 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:52.585682  5303 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:52.600940  5144 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:52.596472  5311 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:52.601768  5144 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.603137  5144 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.568004  5057 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:52.603925  5057 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.607517  5325 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:52.608091  5325 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.609082  5325 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.610212  5325 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.598135  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.594182  5323 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:52.584332  5269 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:52.629804  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.584851  5165 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:52.626559  5091 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.640542  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:02:52.640837  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45919.7us
I20260709 13:02:52.641227  1678 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.641361  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:52.645124  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.645954  1680 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:52.649170  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:52.648823  5165 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.649802  1533 raft_consensus.cc:606] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.650175  1533 raft_consensus.cc:614] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:52.650455  5223 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:52.652583  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:52.652676  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.653256  1676 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.654155  1498 leader_election.cc:400] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:02:52.655192  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:52.639604  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.656296  5072 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.656690  5072 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.656731  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.657179  5072 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.632309  5351 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.659247  5351 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.660297  5239 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:52.661120  5239 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.661592  5239 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.662451  5239 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.649382  5339 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:52.666985  1679 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.594080  5092 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:52.675103  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55741.1us
I20260709 13:02:52.677476  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.651763  5223 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:52.689673  1684 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:52.696408  1680 pending_rounds.cc:85] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 6
I20260709 13:02:52.696826  1680 pending_rounds.cc:107] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:52.697402  1680 raft_consensus.cc:2889] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:52.692306  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 97284us
I20260709 13:02:52.703172  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.709632  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.718261  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.695715  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:52.718972  1679 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:52.719252  1682 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:52.723482  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.650265  5165 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:52.727442  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46713.4us
I20260709 13:02:52.688313  5091 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:52.687932  5138 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:52.732293  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:52.688519  5223 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:52.679267  5339 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:52.713475  4931 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:52.745649  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 68887.7us
I20260709 13:02:52.663800  5358 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.765038  1681 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:52.724825  5354 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.767335  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:52.689837  5332 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:02:52.725155  5123 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.767783  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.733816  5157 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.797801  1678 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:02:52.801348  1676 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:52.756356  5339 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.803138  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.742321  5351 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.727411  5269 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:02:52.804899  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:02:52.768163  4931 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.805609  1682 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
W20260709 13:02:52.791654  5338 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:52.837801  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:52.783715  5354 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.785701  5142 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.846637  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.785524  5091 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:52.739289  5316 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:02:52.849035  1648 connection.cc:256] RPC call timeout handler was delayed by -1.6124132059999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:02:52.848907  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:52.756723  5310 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.858067  1533 raft_consensus.cc:606] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:52.871172  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.784874  5345 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:02:52.882355  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.850158  4859 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:52.888582  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50939.7us
I20260709 13:02:52.929998  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:52.860839  5362 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:52.916306  5344 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:52.846133  5351 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.916388  5142 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.913367  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:52.856097  5223 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.918009  5091 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.801069  5123 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.771564  5280 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.930992  1682 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:52.808799  5157 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:52.929105  4859 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.953879  1675 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:52.904680  4931 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.903470  5354 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.925051  5328 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.979935  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50081.8us
I20260709 13:02:53.009541  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:52.990370  5371 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:02:53.004874  1678 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:53.013448  1602 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:53.024678  1678 pending_rounds.cc:85] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 4
I20260709 13:02:53.024962  1678 pending_rounds.cc:107] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:53.013684  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:53.025200  1678 raft_consensus.cc:2889] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.025578  1609 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:53.016010  1601 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:52.974378  5345 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:53.020753  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.973757  5374 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.974289  5379 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.974094  5344 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:53.023864  1684 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:02:53.026758  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.975878  5138 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:53.001170  4859 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.034525  1607 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:53.048969  1605 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:02:53.089463  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59522.7us
W20260709 13:02:53.052234  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 138865us
W20260709 13:02:53.108538  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 301389us
I20260709 13:02:53.005542  5270 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:53.010965  5223 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:53.110230  5372 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:02:53.070142  5386 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.066119  5329 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.030722  5269 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:53.092963  5358 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.073755  5162 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.104019  5280 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:53.119777  5325 consensus_meta.cc:287] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.007s
I20260709 13:02:53.028160  5328 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.119706  5379 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.119226  5387 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.118994  5142 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.156342  1683 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:53.068253  5192 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.163447  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:53.138746  5057 consensus_meta.cc:287] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.001s
W20260709 13:02:53.166355  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 100015us
I20260709 13:02:53.069960  5315 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.119360  5332 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:53.124382  5270 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.159750  5350 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:53.198844  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.164561  5269 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:53.200037  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.200522  5350 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.201254  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.201943  1682 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:53.202690  5350 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.202971  5374 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:53.203354  5374 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:53.166570  5333 raft_consensus.cc:993] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:02:53.196799  2211 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:53.204802  1601 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:53.204186  5374 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.151840  5162 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.143569  5389 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:53.214771  1529 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:53.190022  5381 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.208611  2211 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:53.165434  5310 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.138652  5386 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.169973  5057 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.230064  5192 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.230952  5351 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.231735  5057 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:53.232084  5385 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:02:53.222784  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.230089  5328 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.228689  5123 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.210222  5344 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.163743  5387 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.240365  5269 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:53.241067  5092 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.005s
I20260709 13:02:53.190306  5138 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:53.422909  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.394412  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.463936  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.219485  5332 raft_consensus.cc:1081] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:02:53.466893  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:53.468917  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:53.282804  5165 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
W20260709 13:02:53.455309  5339 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.006s
W20260709 13:02:53.470909  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.456704  5374 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.295239  5379 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.242566  5386 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.440807  2211 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:53.293817  5162 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.448015  5157 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.464526  5123 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.483996  5072 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.000s
I20260709 13:02:53.496430  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.465376  5092 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.506008  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:53.510121  2211 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.470238  5316 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:53.509466  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 310301us
I20260709 13:02:53.512956  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.513895  1527 raft_consensus.cc:2410] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:53.513126  5072 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.518383  4859 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.518934  5072 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.513614  5123 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.521342  5123 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.477183  5315 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.528196  1528 raft_consensus.cc:2368] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:02:53.234902  5381 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.475405  5339 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.563709  1682 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:53.565145  5339 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:53.525691  5365 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.795s	user 0.004s	sys 0.009s
I20260709 13:02:53.572311  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:53.528877  5332 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:53.525642  5092 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:53.580096  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.583755  5381 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.589550  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:53.590129  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.590554  1529 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.579078  5332 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:53.579233  5144 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.976s	user 0.014s	sys 0.000s
I20260709 13:02:53.619611  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.624792  1534 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:53.627876  1531 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
W20260709 13:02:53.629695  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57471.6us
I20260709 13:02:53.630825  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:53.598807  5270 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.632786  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.634999  1534 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:53.620353  5332 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.642537  1498 leader_election.cc:400] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12.
I20260709 13:02:53.642874  1498 leader_election.cc:403] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.643710  1677 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:53.629220  5142 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.638739  5144 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.650337  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.650897  1534 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.655364  1529 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:53.640069  4859 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.662873  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:53.663810  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.656956  5091 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.684087  5395 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.694422  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.664273  5354 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 13:02:53.701493  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:53.702757  5142 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:53.702757  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:53.687935  4931 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.003s
I20260709 13:02:53.707022  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.664610  1529 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:53.703855  5144 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:53.725719  1675 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:53.696965  5122 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:53.732719  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.730569  1678 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:53.737905  1675 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.727120  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:53.740753  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.741554  1676 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:53.673172  1534 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:53.746634  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.747426  1678 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:53.697639  5344 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:53.754791  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.750286  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.757421  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:53.742415  5280 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 13:02:53.743383  5092 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.724747  5395 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.730715  5354 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:53.774505  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.782974  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.775646  5162 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:53.783773  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.760502  5142 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.754730  5397 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:53.774396  1675 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:53.789820  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.797008  5397 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.799575  5397 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.799998  5091 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12.
I20260709 13:02:53.742039  4931 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.745754  5122 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.792909  5323 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:53.817586  5323 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:53.809268  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.821292  5395 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.772701  5270 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.823179  5270 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.823729  5270 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.824564  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1526) took 1183 ms. Trace:
I20260709 13:02:53.825017  1683 rpcz_store.cc:276] 0709 13:02:52.640966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.641092 (+   126us) service_pool.cc:224] Handling call
0709 13:02:53.824275 (+1183183us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54000bf4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:53.824468 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58517376}
I20260709 13:02:53.796341  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.826176  1530 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:53.757213  5123 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:02:53.830684  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.833426  5386 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:53.833326  5323 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.834690  5323 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.835788  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.837271  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.838121  1675 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:53.784484  5393 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:53.841041  5387 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:53.808375  5142 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.842499  5142 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.844172  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:53.844929  5122 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:53.778980  5144 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:53.780714  5280 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.850039  5280 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:53.852522  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:53.784968  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 126270us
W20260709 13:02:53.856630  1574 leader_election.cc:336] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.504s (SENT)
I20260709 13:02:53.859586  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.861090  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.862181  2211 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:53.862917  1683 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:53.865322  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.865813  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.867236  1529 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:53.839923  5316 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:53.870464  1535 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:53.871517  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.880009  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.885711  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:53.886610  1529 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.891160  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.892376  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 174) took 1751 ms. Trace:
I20260709 13:02:53.892948  1681 rpcz_store.cc:276] 0709 13:02:52.140501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.144467 (+  3966us) service_pool.cc:224] Handling call
0709 13:02:52.144801 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.765502 (+620701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.890578 (+1125076us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54002d4bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:53.892293 (+  1715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425923968}
W20260709 13:02:53.869246  5285 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:02:53.864662  5310 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.872432  5395 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:53.930341  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:53.934866  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78271.5us
I20260709 13:02:53.869249  5376 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:53.938328  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1917) took 1237 ms. Trace:
I20260709 13:02:53.939147  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.953814  1683 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:53.938606  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.953590  1677 rpcz_store.cc:276] 0709 13:02:52.701312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.701654 (+   342us) service_pool.cc:224] Handling call
0709 13:02:52.727762 (+ 26108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.648193 (+920431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.938015 (+289822us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54000be0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:53.938233 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105902976}
W20260709 13:02:53.955363  1574 leader_election.cc:336] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.509s (SENT)
I20260709 13:02:53.889313  5123 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:53.957994  1530 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:53.958078  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.962985  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:53.872877  5316 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:53.949651  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.960378  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:53.978514  1682 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:53.916895  5354 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:53.962131  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.966140  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:53.890669  5238 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:02:53.971385  1683 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:53.962208  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:53.984368  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:53.984506  1677 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:53.972579  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:02:53.985390  2211 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.962373  5391 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:02:53.937306  5310 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.920290  5397 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:53.930534  5393 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.001740  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:54.004402  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.005031  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:02:54.005121  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49813.7us
I20260709 13:02:53.987344  1529 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:53.957254  5395 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:53.953598  5315 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:02:53.950403  4859 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:54.006313  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.004182  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.048804  1528 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:53.988373  5223 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.000s
I20260709 13:02:54.001865  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:54.006246  1574 leader_election.cc:336] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.569s (SENT)
I20260709 13:02:53.981211  5123 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:53.992414  5057 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:54.036116  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 320822us
I20260709 13:02:53.962694  5376 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:54.002604  5345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.019s	sys 0.012s
I20260709 13:02:54.002573  5310 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:54.010133  5329 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.002s
I20260709 13:02:53.994154  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:02:54.003598  5354 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:54.008878  5395 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.061728  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:54.070111  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.013387  4859 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.037956  5397 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:54.092109  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.014490  5381 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:54.081786  1683 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.099218  1683 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:54.075917  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69676.7us
W20260709 13:02:54.070827  5374 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.000s
I20260709 13:02:54.001417  5379 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:54.014859  5339 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:02:54.138176  1574 leader_election.cc:336] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.608s (SENT)
I20260709 13:02:54.138664  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:54.081887  5345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.020s	sys 0.012s
I20260709 13:02:54.143221  5345 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:54.069053  5057 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.144279  5057 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.144373  5345 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.009001  5393 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.147858  5269 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:54.148404  5269 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.137624  1526 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:54.071027  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.150203  1529 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.090406  4859 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:54.094564  5390 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:54.141346  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:54.161707  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.141762  5142 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:54.142771  1574 leader_election.cc:336] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.669s (SENT)
W20260709 13:02:54.150866  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 156864us
I20260709 13:02:54.097079  5351 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.163182  1683 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.153174  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.093720  5329 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.163045  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.166906  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.188864  1609 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.189049  1607 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.168424  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.169713  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.170954  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.171438  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.190469  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.191239  1610 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:54.171622  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.174373  1608 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:54.192497  1602 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.175792  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.193199  1604 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:54.176973  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.194020  1603 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:54.073680  5328 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:54.196616  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.197573  1601 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:54.150643  4931 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.152110  5344 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.205300  1532 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.207335  1683 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.209221  1602 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:54.209594  1678 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.212558  1529 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.213514  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.214232  1529 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.215298  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.216295  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.217429  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.043716  5316 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.219534  1678 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:54.219684  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.221362  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.222553  1603 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:54.223435  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.183270  5393 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.225673  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.154381  5354 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.244282  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.244982  1607 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.196556  5328 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.249493  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:54.266206  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1924) took 1098 ms. Trace:
I20260709 13:02:54.266623  1679 rpcz_store.cc:276] 0709 13:02:53.168239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.227072 (+ 58833us) service_pool.cc:224] Handling call
0709 13:02:53.460946 (+233874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.465644 (+  4698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.465673 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.471228 (+  5555us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.957720 (+486492us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b180007e0a0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:02:54.073455 (+115735us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:54.073512 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.073619 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.265871 (+192252us) raft_consensus.cc:1685] finished
0709 13:02:54.265897 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.266132 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4979,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2023,"spinlock_wait_cycles":3332864,"thread_start_us":115449,"threads_started":1,"wal-append.queue_time_us":731690}
I20260709 13:02:54.268623  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.269690  1607 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:54.197934  5351 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.283335  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.284207  1529 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:54.281690  1609 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:54.251883  5316 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.289711  1607 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:54.333055  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.333700  1607 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:54.334524  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.335055  1607 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.291646  5351 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:54.336179  5323 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.501s	user 0.015s	sys 0.000s
I20260709 13:02:54.218500  5123 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:54.308812  5410 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:54.309266  5269 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.315297  5057 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.317991  5354 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.319083  5376 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.320235  5344 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.270694  5339 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.248499  5397 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:54.289702  5411 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:54.322299  5310 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:54.324985  5332 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
W20260709 13:02:54.326512  5270 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 13:02:54.280857  5381 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:54.336505  1607 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:54.297739  5395 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.332146  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.335635  4859 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.377697  5387 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.372944  5339 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.397902  1609 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:54.400990  1500 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57254 dropped due to backpressure: service queue is full with 50 items
I20260709 13:02:54.398788  5387 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:54.410163  5339 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.392087  5381 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:54.414242  5381 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:54.433476  5401 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.613s	user 0.009s	sys 0.008s
I20260709 13:02:54.438458  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.439172  1602 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.404233  1500 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57254 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1484)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482)
I20260709 13:02:54.397629  5270 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.386889  5332 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.465137  1530 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:54.467814  5427 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:54.468250  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1674) took 1341 ms. Trace:
I20260709 13:02:54.468709  1535 rpcz_store.cc:276] 0709 13:02:53.128226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.139157 (+ 10931us) service_pool.cc:224] Handling call
0709 13:02:53.139529 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.873048 (+733519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.467941 (+594893us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:54.468180 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680374656}
W20260709 13:02:54.469707  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.470232  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.470909  5386 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:54.471078  1535 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.471439  5386 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:54.488699  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.498586  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.499603  1529 raft_consensus.cc:2368] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
W20260709 13:02:54.503337  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 360577us
W20260709 13:02:54.503774  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.009s
W20260709 13:02:54.505729  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.009s
I20260709 13:02:54.506101  1606 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:54.504153  1574 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.682s (SENT)
I20260709 13:02:54.507953  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.510133  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.511338  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.512077  1528 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.512948  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.513653  1528 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:54.507105  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 547137us
I20260709 13:02:54.494158  4859 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:54.518146  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.522727  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:54.523692  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:54.527451  1609 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.500161  5395 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.528947  1675 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:54.529065  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.532109  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.533886  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 10) took 1753 ms. Trace:
I20260709 13:02:54.534444  1533 rpcz_store.cc:276] 0709 13:02:52.772202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.772356 (+   154us) service_pool.cc:224] Handling call
0709 13:02:54.400973 (+1628617us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540044d020. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff6520 00007f4698073652 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6
0709 13:02:54.525033 (+124060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718906624}
I20260709 13:02:54.544919  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:02:54.545771  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.547335  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.548462  1682 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:54.549611  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:54.550395  1679 raft_consensus.cc:2410] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:54.553186  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.553809  1680 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.552085  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:54.538884  5270 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.496518  5386 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.546293  5192 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:54.585171  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.550316  5358 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.553898  5092 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:54.605875  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53892.6us
I20260709 13:02:54.544394  5389 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:02:54.616473  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76147.5us
I20260709 13:02:54.528541  1498 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57268 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482)
I20260709 13:02:54.602453  5358 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.604740  5395 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.602829  5192 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.607492  1431 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 10, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.744719  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.641426  1680 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:54.748831  1675 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.660573  1534 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:54.701383  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.670753  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:54.627012  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.753106  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 91214.2us
I20260709 13:02:54.756942  5344 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.757530  5344 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:54.714968  5280 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.758397  5344 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:54.758960  5328 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.759837  5339 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.760367  5339 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.761088  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.761993  1527 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:54.762456  5339 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:54.762512  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 258374us
I20260709 13:02:54.762852  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.764535  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.766031  5192 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:02:54.763191  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.766386  5432 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:02:54.775291  1574 leader_election.cc:336] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.736s (SENT)
I20260709 13:02:54.775965  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.752324  1535 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:54.616333  5426 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:54.729868  5434 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:54.796726  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.797541  1680 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:54.797501  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.798517  1526 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:54.803115   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:54.804936   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:54.806967  5332 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.781378  1431 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:54.697664  5428 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:02:54.809461  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:54.781771  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.784099  5358 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.784778  5142 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:54.785084  5397 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.787730  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:54.789685  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.825397  1533 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
W20260709 13:02:54.790580  1574 leader_election.cc:336] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.792s (SENT)
I20260709 13:02:54.826615  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.672175  5429 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:02:54.621840  5381 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.837832  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.839318  1675 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:54.842294  1533 raft_consensus.cc:2368] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:02:54.829607  5269 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:54.846130  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:54.849179  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.617903  5092 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:54.853161  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:54.854043  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63493.6us
I20260709 13:02:54.853807  5092 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.854403  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:54.854763  1574 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.817s (SENT)
I20260709 13:02:54.687463  5389 consensus_queue.cc:1243] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:54.808945  1431 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 7 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:54.855207  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:54.856426  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.853s (SENT)
I20260709 13:02:54.856372  1431 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:54.857399  1574 leader_election.cc:336] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.879s (SENT)
I20260709 13:02:54.857798  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.858587  5265 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.858140  1431 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:54.858886  1574 leader_election.cc:336] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.892s (SENT)
I20260709 13:02:54.859211  5265 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:54.830018  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.831045  1678 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:54.821410  5426 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.852488  5269 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:54.855129  1530 raft_consensus.cc:2368] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 14.
W20260709 13:02:54.859872  1574 leader_election.cc:336] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.938s (SENT)
I20260709 13:02:54.874908  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.859959  1431 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 11, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.787230  1498 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:57254 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1500)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1490)
W20260709 13:02:54.877205  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.892762  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.897559  1528 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:54.898203  5303 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:54.877872  5332 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:54.905447  5381 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:54.906670  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.907894  5431 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:54.892827  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.845393  5165 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.908668  1535 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:54.896824  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.925150  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.925575  1532 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:54.861164  5072 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.923702  1533 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:54.927597  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.926025  1526 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.922219  1431 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:54.929873  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.930716  1532 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.877036  5426 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.928392  1528 raft_consensus.cc:2376] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10. Re-sending same reply.
I20260709 13:02:54.918859  5303 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:54.936663  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76801.4us
W20260709 13:02:54.939447  1574 leader_election.cc:336] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.955s (SENT)
I20260709 13:02:54.941877  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:54.942137  1574 leader_election.cc:336] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.523s (SENT)
I20260709 13:02:54.942716  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.942981  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.941890  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:54.943984  1574 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.536s (SENT)
I20260709 13:02:54.944496  1530 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.945340  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.946935  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.948724  1535 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:54.945984  1526 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:54.952196  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.946297  1431 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.954813  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.956900  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.957731  1608 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:54.945060  1574 leader_election.cc:336] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.561s (SENT)
I20260709 13:02:54.958606  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:54.955679  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:54.962020  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.962193  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.925277  5332 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:54.969671  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:54.970319  1607 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.965169  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:54.971789  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.973503  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.965694  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.966279  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:54.967381  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.975574  1604 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:54.929731  5269 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:54.939069  5072 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:54.974964  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:54.951319  5323 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.980321  1603 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:54.963138  1431 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 10, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.979737  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:54.994513  1530 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:54.975606  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:54.996719  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:54.998221  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.000814  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.001906  5138 raft_consensus.cc:2764] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:02:54.976351  5429 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.002754  5358 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.242s
I20260709 13:02:55.244630  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.234319  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.250097  1526 raft_consensus.cc:2368] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:02:55.237016  1498 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:57268 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1461)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1732)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1490)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1726)
I20260709 13:02:55.230618  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1936) took 1311 ms. Trace:
W20260709 13:02:55.244194  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 299137us
I20260709 13:02:55.058233  1608 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:55.017997  5157 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:55.038882  1675 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:55.042536  5339 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.017481  5406 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:55.135993  1607 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:02:55.194378  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 146139us
I20260709 13:02:55.010097  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.058086  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:55.104640  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.258843  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.032886  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1690) took 1273 ms. Trace:
I20260709 13:02:55.250051  1529 raft_consensus.cc:2376] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13. Re-sending same reply.
I20260709 13:02:55.035143  5138 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.112905  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:55.251534  1574 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.596s (SENT)
I20260709 13:02:55.018173  1431 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 13, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.251309  1677 rpcz_store.cc:276] 0709 13:02:53.919789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.985470 (+ 65681us) service_pool.cc:224] Handling call
0709 13:02:54.005381 (+ 19911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.757119 (+751738us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b1800393040. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698071bfb 00007f469807c64b
0709 13:02:54.757257 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:54.757285 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.757766 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.961893 (+204127us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:54.961931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.963458 (+  1527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.044534 (+ 81076us) raft_consensus.cc:1685] finished
0709 13:02:55.044553 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.230523 (+185970us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4704,"raft.queue_time_us":45654,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9020,"spinlock_wait_cycles":84204800,"thread_start_us":281212,"threads_started":2,"wal-append.queue_time_us":285036}
I20260709 13:02:55.262636  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:55.259586  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.260488  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.218122  1533 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:55.259529  1534 rpcz_store.cc:276] 0709 13:02:53.759296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.759456 (+   160us) service_pool.cc:224] Handling call
0709 13:02:53.760324 (+   868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.749902 (+989578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.032631 (+282729us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400440554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:55.032823 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069876096}
I20260709 13:02:54.978636  5381 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:55.264099  1574 leader_election.cc:336] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.617s (SENT)
I20260709 13:02:55.264784  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.234910  5386 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.235430  5192 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.034694  5395 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.176147  5323 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.263028  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 253038us
W20260709 13:02:55.268013  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.637s (SENT)
I20260709 13:02:55.268833  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.269553  5381 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.265039  5397 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.274405  5426 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:55.275233  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.278280  1676 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.279892  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:55.280290  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.293239  1530 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:55.280613  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:55.017688  5303 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.026959  4931 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.281833  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.282801  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.296833  1534 raft_consensus.cc:2368] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:02:55.265719  1529 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.286494  1431 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 11, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.289069  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1461) took 1248 ms. Trace:
I20260709 13:02:55.289155  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.298393  1682 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:55.298924  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1451) took 1325 ms. Trace:
I20260709 13:02:55.289849  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.299321  1529 rpcz_store.cc:276] 0709 13:02:53.973881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.260241 (+1286360us) service_pool.cc:224] Handling call
0709 13:02:55.298870 (+ 38629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.302235  5426 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:55.265957  5339 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.314831  5339 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:55.266904  5157 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:55.304281  4931 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.315981  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.318352  4931 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:55.318823  5332 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:55.319149  1533 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:55.288602  5192 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.319779  1529 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.321493  5310 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:55.291869  5381 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.321815  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:55.281693  5239 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.327142  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:55.327361  5239 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:55.316367  5157 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.307734  5387 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.308503  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.348495  1534 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 5.
I20260709 13:02:55.297938  1526 rpcz_store.cc:276] 0709 13:02:54.040797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.255058 (+1214261us) service_pool.cc:224] Handling call
0709 13:02:55.289010 (+ 33952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.309283  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.350773  1530 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.307610  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.291603  5323 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:55.321684  5192 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:55.306149  1431 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.367149  1431 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:55.330853  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62860.4us
W20260709 13:02:55.368789  1574 leader_election.cc:336] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.663s (SENT)
I20260709 13:02:55.323222  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.369824  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1714) took 1059 ms. Trace:
I20260709 13:02:55.341809  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.370260  1529 rpcz_store.cc:276] 0709 13:02:54.310821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.322329 (+1011508us) service_pool.cc:224] Handling call
0709 13:02:55.369766 (+ 47437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.342789  1528 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:55.373065  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.343884  1500 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:57268 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1490)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1726)
I20260709 13:02:55.323662  1680 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:55.355201  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.356158  5332 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:55.352272  5057 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:55.359205  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:55.266546  5138 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.378392  1574 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.690s (SENT)
I20260709 13:02:55.365549  5303 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.026552  5072 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.352538  5397 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.335943  5239 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.378342  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.378777  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.379246  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.380306  1528 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:55.390970  1529 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:55.380352  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.376628  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.391405  1529 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:02:55.382244  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.381695  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.393025  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1459) took 1404 ms. Trace:
I20260709 13:02:55.393373  1533 rpcz_store.cc:276] 0709 13:02:53.988805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.379602 (+1390797us) service_pool.cc:224] Handling call
0709 13:02:55.392973 (+ 13371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.393903  1535 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.381583  1431 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 11, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.340761  5310 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.387463  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.390802  1526 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:55.388886  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.266027  5406 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.392525  1529 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.397140  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.397089  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.395586  1530 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:55.398952  1529 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.399185  1533 raft_consensus.cc:2376] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14. Re-sending same reply.
I20260709 13:02:55.400533  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:55.400779  1574 leader_election.cc:336] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.702s (SENT)
W20260709 13:02:55.401918  1574 leader_election.cc:336] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.707s (SENT)
I20260709 13:02:55.402544  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.402347  1431 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 10, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.383786  5138 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.397796  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.385914  5192 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:55.412323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.413371  1526 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.410240  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.421392  1677 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:55.394021  5142 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.424433  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.423048  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.425808  1534 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:55.426204  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:55.426731  1574 leader_election.cc:336] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.745s (SENT)
I20260709 13:02:55.426980  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.423652  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.427145  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.423763  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.428681  1533 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.430691  1431 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 2 to 7, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 7 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:55.432005  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.431308  1680 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:55.425120  5142 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:55.435225  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:55.433728  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.410655  5339 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.407444  5429 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.437261  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.444391  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.445127  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1486) took 1096 ms. Trace:
I20260709 13:02:55.445422  1528 rpcz_store.cc:276] 0709 13:02:54.349446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.444137 (+1094691us) service_pool.cc:224] Handling call
0709 13:02:55.445075 (+   938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.446220  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.447077  1528 raft_consensus.cc:2368] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:02:55.440258  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.411404  5192 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:55.448238  1533 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.415076  5397 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:55.449239  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.450006  1533 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.450743  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.451504  1533 raft_consensus.cc:2410] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:55.391410  5426 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:55.415288  5057 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:02:55.457425  5057 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:55.457897  5057 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:55.458285  5057 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.458927  5406 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:55.422257  5123 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:55.427723  5328 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.460343  5328 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.423252  5395 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.460753  5328 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.462492  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1471) took 1176 ms. Trace:
I20260709 13:02:55.462898  1527 rpcz_store.cc:276] 0709 13:02:54.286642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.763908 (+477266us) service_pool.cc:224] Handling call
0709 13:02:55.462302 (+698394us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540003e654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:55.462436 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460510976}
I20260709 13:02:55.463963  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.465080  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.465636  1527 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.466475  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.467492  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.440645  5280 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.447510  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.441553  5142 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.425170  5387 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.467975  5323 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:55.469904  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.469681  1531 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
W20260709 13:02:55.475208  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1465) took 1250 ms (client timeout 1645 ms). Trace:
I20260709 13:02:55.448305  5192 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.440021  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:55.475754  1531 rpcz_store.cc:269] 0709 13:02:54.224348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.488308 (+263960us) service_pool.cc:224] Handling call
0709 13:02:55.474953 (+986645us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54000708d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:55.475121 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234001664}
I20260709 13:02:55.477428  1530 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.477723  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.478261  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.479533  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.485129  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.484922  1431 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 7 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.487258  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.489179  5358 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.489888  5358 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.491428  5429 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:55.491710  5431 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:55.494519  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.495312  1534 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:55.495707  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1487) took 1142 ms. Trace:
I20260709 13:02:55.496053  1534 rpcz_store.cc:276] 0709 13:02:54.354088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.494262 (+1140174us) service_pool.cc:224] Handling call
0709 13:02:55.495649 (+  1387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.496953  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.470549  5142 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.502460  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:55.489171  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.508589  1533 pending_rounds.cc:85] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 5
I20260709 13:02:55.509032  1533 pending_rounds.cc:107] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:55.509382  1533 raft_consensus.cc:2889] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.486697  1431 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 9, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.516197  1534 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:55.517000  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1452) took 1542 ms. Trace:
I20260709 13:02:55.517488  1534 rpcz_store.cc:276] 0709 13:02:53.974191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.497829 (+1523638us) service_pool.cc:224] Handling call
0709 13:02:55.498089 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.516736 (+ 18647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.516944 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.519963  1535 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:55.524648  1535 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:02:55.525292  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:55.525450  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1456) took 1550 ms. Trace:
I20260709 13:02:55.525993  1535 rpcz_store.cc:276] 0709 13:02:53.975409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.523810 (+1548401us) service_pool.cc:224] Handling call
0709 13:02:55.524304 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.525141 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.525381 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.478271  1531 raft_consensus.cc:2376] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12. Re-sending same reply.
I20260709 13:02:55.511173  1527 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:55.529851  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.531488  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:55.522441  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95722.1us
I20260709 13:02:55.535283  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:55.538589  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.538954  1610 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:55.539415  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:55.534363  1574 leader_election.cc:336] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.766s (SENT)
I20260709 13:02:55.540479  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.540496  1607 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:02:55.540650  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.541610  5429 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:55.543284  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.978s (SENT) [suppressed 69 similar messages]
I20260709 13:02:55.543788  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.533136  1534 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:55.544737  1608 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:55.544987  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1701) took 1467 ms. Trace:
I20260709 13:02:55.545516  1534 rpcz_store.cc:276] 0709 13:02:54.077896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.532334 (+1454438us) service_pool.cc:224] Handling call
0709 13:02:55.532701 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.544596 (+ 11895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.544905 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.546718  1527 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.547524  1529 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:55.553130  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.555142  1529 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.554523  1534 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:55.559698  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1462) took 1478 ms. Trace:
I20260709 13:02:55.560209  1534 rpcz_store.cc:276] 0709 13:02:54.081553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.553780 (+1472227us) service_pool.cc:224] Handling call
0709 13:02:55.554131 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.559347 (+  5216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.559627 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.564893  1535 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:55.565711  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1457) took 1590 ms. Trace:
I20260709 13:02:55.566062  1535 rpcz_store.cc:276] 0709 13:02:53.975717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.527077 (+1551360us) service_pool.cc:224] Handling call
0709 13:02:55.550063 (+ 22986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.565421 (+ 15358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.565651 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.567340  1534 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:02:55.567812  1534 pending_rounds.cc:85] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:02:55.568244  1534 pending_rounds.cc:107] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:02:55.568614  1534 raft_consensus.cc:2889] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.569695  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1703) took 1429 ms. Trace:
I20260709 13:02:55.570132  1534 rpcz_store.cc:276] 0709 13:02:54.140536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.561043 (+1420507us) service_pool.cc:224] Handling call
0709 13:02:55.561365 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.569357 (+  7992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.569625 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.572096  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1704) took 1412 ms. Trace:
I20260709 13:02:55.576112  1534 rpcz_store.cc:276] 0709 13:02:54.159360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.571097 (+1411737us) service_pool.cc:224] Handling call
0709 13:02:55.571452 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.571676 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.571714 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.571774 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.571824 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.571883 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.572026 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.577524  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:55.580861  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.584757  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:55.586318  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 176151us
I20260709 13:02:55.587141  1431 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.590806  1535 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:55.592730  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.593063  1607 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:55.594167  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.595304  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.597787  1604 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.609074  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.622109  5239 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.632155  1532 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:55.641610  1527 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
W20260709 13:02:55.784927  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.750991  1606 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 12. Ops: [10.8-10.8]
I20260709 13:02:55.691526  1602 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:55.793108  1609 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:55.695669  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.795688  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.791131  1535 pending_rounds.cc:85] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 5
I20260709 13:02:55.796432  1535 pending_rounds.cc:107] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:55.796801  1535 raft_consensus.cc:2889] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.791514  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.798096  1527 raft_consensus.cc:2368] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:55.792385  1608 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:55.699971  1529 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.690950  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.789949  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.803067  1534 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:55.803731  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1707) took 1495 ms. Trace:
I20260709 13:02:55.804131  1529 rpcz_store.cc:276] 0709 13:02:54.308547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.800843 (+1492296us) service_pool.cc:224] Handling call
0709 13:02:55.801268 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.803423 (+  2155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.803449 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.803490 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:55.803525 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.803576 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.803670 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.794214  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:55.805799  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1710) took 1496 ms. Trace:
I20260709 13:02:55.806243  1529 rpcz_store.cc:276] 0709 13:02:54.309593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.804997 (+1495404us) service_pool.cc:224] Handling call
0709 13:02:55.805269 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.805417 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.805446 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.805498 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:55.805534 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.805603 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.805736 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.807603  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1463) took 1654 ms. Trace:
I20260709 13:02:55.808000  1529 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:55.823134  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1718) took 1511 ms. Trace:
W20260709 13:02:55.813700  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.810606  1431 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 12, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.808154  1535 rpcz_store.cc:276] 0709 13:02:54.153128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.566823 (+1413695us) service_pool.cc:224] Handling call
0709 13:02:55.590474 (+ 23651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.797401 (+206927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.807536 (+ 10135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.823611  1529 rpcz_store.cc:276] 0709 13:02:54.340571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.807348 (+1466777us) service_pool.cc:224] Handling call
0709 13:02:55.807682 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.822850 (+ 15168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.823059 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:55.831248  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.832684  1534 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:55.833540  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1708) took 1524 ms. Trace:
I20260709 13:02:55.833967  1534 rpcz_store.cc:276] 0709 13:02:54.308981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.804394 (+1495413us) service_pool.cc:224] Handling call
0709 13:02:55.832247 (+ 27853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.833206 (+   959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.833464 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.771163  5269 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.837128  1682 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.837963  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:55.838562  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.840464  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1705) took 1632 ms. Trace:
I20260709 13:02:55.790511  5339 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:55.843286  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.845515  1610 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:55.850554  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:55.841243  1529 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 13. Ops: [11.5-11.5]
I20260709 13:02:55.853510  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1489) took 1202 ms. Trace:
I20260709 13:02:55.853829  1529 rpcz_store.cc:276] 0709 13:02:54.651500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.829391 (+1177891us) service_pool.cc:224] Handling call
0709 13:02:55.829828 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.853269 (+ 23441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.853459 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.846050  1530 rpcz_store.cc:276] 0709 13:02:54.207802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.809488 (+1601686us) service_pool.cc:224] Handling call
0709 13:02:55.839967 (+ 30479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.840163 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.840192 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.840238 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:55.840269 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.840321 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.840414 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.855057  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:55.855726  1532 raft_consensus.cc:2376] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12. Re-sending same reply.
I20260709 13:02:55.846742  1431 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 3 to 8, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.854761  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:55.857980  1609 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.858816  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.858489  1431 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.861441  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:55.862799  1529 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:55.863416  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:55.840771  5447 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:55.864342  1529 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:02:55.865198  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 321931us
I20260709 13:02:55.865890  1529 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:55.860138  1535 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:55.867340  1529 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:55.867859  1529 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:55.867993  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1482) took 1528 ms. Trace:
W20260709 13:02:55.864786  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54371.7us
I20260709 13:02:55.871027  1431 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.872869  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:55.868618  1535 rpcz_store.cc:276] 0709 13:02:54.339295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.827571 (+1488276us) service_pool.cc:224] Handling call
0709 13:02:55.852966 (+ 25395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.867653 (+ 14687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.867926 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.877637  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:02:55.879779  1574 leader_election.cc:336] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.879s (SENT)
I20260709 13:02:55.880795  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:55.892521  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:55.893296  1574 leader_election.cc:336] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.004s (SENT)
W20260709 13:02:55.894192  1574 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.008s (SENT)
I20260709 13:02:55.894829  1534 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:55.895180  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.895650  1604 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.896013  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1490) took 1228 ms. Trace:
I20260709 13:02:55.896463  1534 rpcz_store.cc:276] 0709 13:02:54.667741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.834964 (+1167223us) service_pool.cc:224] Handling call
0709 13:02:55.894319 (+ 59355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.895765 (+  1446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.895961 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.898279  1532 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.870611  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:55.902678  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.901033  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:55.904457  1530 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:55.901893  5426 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:55.901995  1574 leader_election.cc:336] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.502s (SENT)
W20260709 13:02:55.906956  1574 leader_election.cc:336] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.187s (SENT)
I20260709 13:02:55.905390  1535 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:55.909056  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:55.907960  1574 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.222s (SENT)
I20260709 13:02:55.909912  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:55.913034  1574 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.329s (SENT)
I20260709 13:02:55.915449  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.922227  2211 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:55.809888  5461 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:02:55.901818  5381 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 13:02:55.926954  1601 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.869114  5395 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.892599  5265 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.930475  1431 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.980002  1431 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:02:55.943111  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.898289  5463 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:55.852150  5269 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.941017   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.951655  5358 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:55.936666  5426 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:56.026129  1601 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:02:55.956278  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58056.2us
I20260709 13:02:55.956840  5328 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:55.958359  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.024611  1431 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 11, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.942576  5192 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.961702  1529 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:55.951426  5239 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:55.901691  5332 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.935472  1604 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:55.969960  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:56.045658  1610 raft_consensus.cc:2410] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:55.974097  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.039801  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.046394  1534 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:02:55.925712  1574 leader_election.cc:336] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.474s (SENT)
I20260709 13:02:56.046599  1535 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:56.046808  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:56.048413  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 122739us
W20260709 13:02:56.048990  1574 leader_election.cc:336] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 2.517s (SENT)
I20260709 13:02:55.978421  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:55.988991  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1706) took 1708 ms. Trace:
I20260709 13:02:55.923465  5431 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.008734  1677 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.946688  1682 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:55.951375  5381 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.030905  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:55.995889  5138 consensus_meta.cc:287] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:02:56.135202  1683 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:56.038671  1529 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.041714  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:56.052251  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:56.051167  1527 rpcz_store.cc:276] 0709 13:02:54.280578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.798806 (+1518228us) service_pool.cc:224] Handling call
0709 13:02:55.799190 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.799434 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:55.810936 (+ 11502us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.988541 (+177605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.988607 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.988675 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.988762 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.988918 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":1348,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":177031,"threads_started":1,"wal-append.queue_time_us":171694}
W20260709 13:02:56.033286  5387 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.008s
I20260709 13:02:55.997057  5463 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.996191  5461 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:56.125152  1603 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:56.125385  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72255.6us
I20260709 13:02:56.008071  5466 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.126658  1431 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 12, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:55.937240  5456 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:02:56.128868  1528 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:56.193950  1431 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:02:56.129165  1609 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.139511  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.197279  1529 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:56.197711  1529 pending_rounds.cc:85] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:02:56.197772  1527 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:56.143816  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.144307  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:55.981592  5395 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.203632  1601 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:56.154748  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.204715  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60500.3us
I20260709 13:02:56.148473  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:56.179211  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 308715us
I20260709 13:02:55.922258  5339 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.190330  1526 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:56.198035  1529 pending_rounds.cc:107] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:56.215756  1529 raft_consensus.cc:2889] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:56.198577  1535 raft_consensus.cc:2376] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14. Re-sending same reply.
I20260709 13:02:56.200110  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.200799  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:56.217957  1527 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:55.996834  5265 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.205596  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:56.210558  1609 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:56.218849  1608 raft_consensus.cc:2410] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:56.205524  1530 raft_consensus.cc:2376] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12. Re-sending same reply.
I20260709 13:02:56.214349  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:56.226858  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:56.143028  5406 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:56.230681  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:56.148090  5463 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.129077  5426 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.236717  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.213876  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:56.238864  1534 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:56.194393  5461 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:56.240150  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:56.260452  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.146176  5138 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:56.272598  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.223867  5397 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:56.294674  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.249502  5431 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.249697  5239 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.409276  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:56.386831  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.236253  5344 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:56.396996  5468 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:02:56.392359  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:56.369854  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.338500  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:56.239203  5462 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:02:56.411487  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.240125  5406 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.216221  5466 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.339178  5072 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.452661  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:56.420336  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 380137us
I20260709 13:02:56.450542  1528 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:02:56.464884  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.466200  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.414026  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 176860us
I20260709 13:02:56.481637  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.551831  1527 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:56.553177  1526 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:56.556622  1530 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:56.558763  1608 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:02:56.561077  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 326813us
W20260709 13:02:56.650076  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.633368  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:56.671626  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 431529us
I20260709 13:02:56.673550  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:56.677373  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.685806  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52441.4us
I20260709 13:02:56.687502  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:56.557763  5344 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:56.699388  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 246802us
W20260709 13:02:56.700433  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.701365  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.478996  5397 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.566944  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:56.706063  1648 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.501s (SENT)
W20260709 13:02:56.719762  1648 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.511s (SENT)
I20260709 13:02:56.706795  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.717931  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1577) took 1221 ms. Trace:
I20260709 13:02:56.706063  1526 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:56.721379  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:56.721393  1603 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:56.725224  1683 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:56.716980  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:56.731421  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:56.721625  1648 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.526s (SENT)
I20260709 13:02:56.735249  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.412173  5239 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:56.741328  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.741937  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:56.742410  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:56.743024  1530 raft_consensus.cc:2368] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:56.741411  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.744247  1526 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:56.479493  5092 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:56.763512  1648 leader_election.cc:336] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.574s (SENT)
I20260709 13:02:56.764122  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.747249  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:56.722365  1680 rpcz_store.cc:276] 0709 13:02:55.496969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.497157 (+   188us) service_pool.cc:224] Handling call
0709 13:02:55.515004 (+ 17847us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.515473 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.515513 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.516261 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 13:02:55.840418 (+324157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:55.840453 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.840517 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.717706 (+877189us) raft_consensus.cc:1685] finished
0709 13:02:56.717725 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.717867 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94717,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":36973,"thread_start_us":240646,"threads_started":1,"wal-append.queue_time_us":358185}
W20260709 13:02:56.721006  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.003s	sys 0.007s
W20260709 13:02:56.772284  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.003s	sys 0.007s
I20260709 13:02:56.780283  1534 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:56.568483  5358 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.716647  5397 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:56.718855  5344 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.705104  5487 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.790108  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.718101  5478 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.546434  5477 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.301s
I20260709 13:02:56.744475  5239 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.802639  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:56.803580  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.745639  5481 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.777922  5471 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.813257  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.819406  1532 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:56.819564  1530 raft_consensus.cc:2376] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13. Re-sending same reply.
I20260709 13:02:56.762558  5484 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:56.810662  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 111917us
I20260709 13:02:56.816804  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.787065  5456 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.823436  1678 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:56.760644  5310 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:56.800747  5397 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.798926  5480 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:56.810906  5449 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.833810  1527 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 8.
I20260709 13:02:56.833549  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:56.800803  5269 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:56.836746  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131745us
I20260709 13:02:56.690385  5461 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.798236  5328 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.810633  5487 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:56.847115  5487 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.844858  5265 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.848567  5449 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:56.850952  5449 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.840430  1684 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:56.842433  1532 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13.
I20260709 13:02:56.854739  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:56.842722  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79228.9us
I20260709 13:02:56.817888  5323 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:56.845558  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.851848  5478 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:56.804782  5479 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:02:56.838904  5395 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.841024  5192 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.883919  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1453) took 2909 ms. Trace:
W20260709 13:02:56.862392  5475 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:02:56.888523  5395 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.862423  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.889096  5395 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.889632  1530 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:02:56.863907  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:56.839775  5482 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:56.891237  5395 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.865487  5138 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.840495  5483 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:56.872107  5476 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:02:56.892171  5483 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:56.892416  5316 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.804448  5358 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.885033  5485 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:56.893991  5485 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.894958  5358 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.839443  5480 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.876130  5386 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.878566  5381 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.881095  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:56.881505  5057 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.423s	user 0.011s	sys 0.000s
I20260709 13:02:56.896368  1680 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:56.896595  5057 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.897807  1682 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:56.899533  5470 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:02:56.883397  5406 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.827087  5332 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:56.900517  5439 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.900710  5332 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:56.901188  5332 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:56.901600  5485 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.902038  5332 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.903254  5332 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.904330  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1581) took 1379 ms. Trace:
I20260709 13:02:56.904582  5344 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.904748  1675 rpcz_store.cc:276] 0709 13:02:55.524835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.525006 (+   171us) service_pool.cc:224] Handling call
0709 13:02:55.589440 (+ 64434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.791804 (+202364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.791836 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.821138 (+ 29302us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.179869 (+358731us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:56.179909 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.179985 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.904101 (+724116us) raft_consensus.cc:1685] finished
0709 13:02:56.904123 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.904269 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59646,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"thread_start_us":502205,"threads_started":2,"wal-append.queue_time_us":616846}
I20260709 13:02:56.906735  5344 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:56.874046  5478 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:56.908280  5494 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:56.908952  5494 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:56.891330  5487 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.893138  5483 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.910461  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.911242  5487 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.911624  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.911958  5310 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.912802  5310 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:56.912941  4931 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:56.913285  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.884418  1533 rpcz_store.cc:276] 0709 13:02:53.974511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.507917 (+1533406us) service_pool.cc:224] Handling call
0709 13:02:55.508332 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.518776 (+ 10444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.518807 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.519492 (+   685us) log.cc:844] Serialized 52 byte log entry
0709 13:02:55.837241 (+317749us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:56.125583 (+288342us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.451924 (+326341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.452004 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.865704 (+413700us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b18003bcd40. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:02:56.873445 (+  7741us) raft_consensus.cc:1685] finished
0709 13:02:56.875781 (+  2336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.883855 (+  8074us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10567,"prepare.queue_time_us":55116,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":19322,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":48720,"spinlock_wait_cycles":52902784,"thread_start_us":856241,"threads_started":3,"wal-append.queue_time_us":406400}
I20260709 13:02:56.883801  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:56.895696  5480 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.882539  5466 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.899634  5057 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:56.908013  5478 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.913403  4931 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:56.893005  5323 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:56.885022  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1696) took 2895 ms. Trace:
I20260709 13:02:56.914695  1527 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13.
W20260709 13:02:56.884826  1648 leader_election.cc:336] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.582s (SENT)
W20260709 13:02:56.963981  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79183.3us
W20260709 13:02:56.964593  1648 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.591s (SENT)
I20260709 13:02:56.955365  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:56.959468  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.965794  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.967316  5477 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.967756  5323 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.968708  5478 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.973759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:57.011837  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.013540  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.016825  1648 leader_election.cc:336] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.586s (SENT)
W20260709 13:02:57.018226  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62984.1us
I20260709 13:02:57.019354  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.017527  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.961380  1531 rpcz_store.cc:276] 0709 13:02:53.989765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.528549 (+1538784us) service_pool.cc:224] Handling call
0709 13:02:55.588538 (+ 59989us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.611782 (+ 23244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.611814 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.682348 (+ 70534us) log.cc:844] Serialized 52 byte log entry
0709 13:02:56.772793 (+1090445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:56.803644 (+ 30851us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.829594 (+ 25950us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.884477 (+ 54883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.884665 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.884745 (+    80us) raft_consensus.cc:1685] finished
0709 13:02:56.884768 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.884947 (+   179us) inbound_call.cc:177] Queueing success response
0709 13:02:56.906871 (+ 21924us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b180004f300. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
Metrics: {"mutex_wait_us":54456,"prepare.queue_time_us":32074,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4826,"raft.queue_time_us":67928,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":8987,"spinlock_wait_cycles":36059392,"thread_start_us":1021832,"threads_started":1,"wal-append.queue_time_us":1074514}
W20260709 13:02:57.030530  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 299185us
I20260709 13:02:57.001816  5479 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:57.041352  1648 leader_election.cc:336] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.610s (SENT)
W20260709 13:02:57.042673  1648 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.620s (SENT)
W20260709 13:02:57.044344  1648 leader_election.cc:336] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.633s (SENT)
W20260709 13:02:57.045521  1648 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.647s (SENT)
W20260709 13:02:57.046615  1648 leader_election.cc:336] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.756s (SENT)
I20260709 13:02:57.047144  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:56.971510  5239 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.048928  5092 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.049633  5092 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.050541  5239 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:57.051589  5092 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.052241  5092 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.967896  5477 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.053193  4931 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.054903  5477 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:57.055742  5463 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.000s
I20260709 13:02:57.056365  5463 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:56.960770  5386 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:57.060750  5386 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:57.061247  5386 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:57.062244  5386 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.063691  5386 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.023797  5316 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.064414  5397 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.065433  5344 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.066283  5439 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.025803  5123 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.971731  5494 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:02:57.073236  1648 leader_election.cc:336] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.882s (SENT)
I20260709 13:02:57.069165  5485 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:02:57.225179  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.225736  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.228421  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.229174  1683 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:02:57.074529  5339 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.076116  5239 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:57.193871  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 506455us
W20260709 13:02:57.233801  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 160585us
W20260709 13:02:57.216914  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 139633us
I20260709 13:02:57.078238  5406 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 13:02:57.208596  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.233233  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.215965  5316 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:57.224326  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.236574  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:57.215566  5463 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:57.281432  1682 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:57.242061  5429 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.276012  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.282112  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.302112  5480 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.305081  5387 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.280977  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 59679.5us
W20260709 13:02:57.314247  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81152.4us
I20260709 13:02:57.221688  5494 consensus_queue.cc:1243] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:57.315070  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.338119  1675 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:57.237535  5482 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.318512  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.340901  1681 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:57.226550  5123 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.221686  5344 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.237818  5426 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:57.329469  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 310213us
I20260709 13:02:57.331302  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.299010  5397 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.342999  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.241740  5477 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:02:57.346138  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.347834  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.347985  1683 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:57.341149  5387 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.283092  5316 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.342414  5310 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.346966  5482 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.323002  5461 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:57.356510  5463 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:57.330405  5439 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:57.360271  5453 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:02:57.365008  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.365460  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.366245  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.391865  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:57.367610  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:02:57.399653  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.373198  1601 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:57.321614  5498 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:57.343967  5495 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.382856  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:57.384928  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 148510us
I20260709 13:02:57.409354  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:57.410130  1680 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:02:57.380739  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.387621  5092 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:57.406808  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:57.448685  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.450325  1604 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:57.451069  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.336591  5429 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.375221  5157 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:57.373121  5426 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.376989  5239 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:57.385501  5487 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:02:57.404896  5388 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.384922  5456 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:02:57.385335  5310 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.465801  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.448426  5478 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:57.406574  5463 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:57.455628  5509 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.493528  1601 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:57.498865  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 98881.5us
I20260709 13:02:57.411448  5165 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:02:57.503535  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.503784  1604 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
W20260709 13:02:57.509939  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 128328us
I20260709 13:02:57.487861  5269 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:57.511610  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.518493  1603 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.516734  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.495065  5192 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.463281  5431 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:02:57.520917  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.411298  5439 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.536571  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.538893  1604 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.496512  5478 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.519654  1531 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.467409  5092 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.448477  5495 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.489095  5323 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:57.545676  5344 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.517628  5510 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.444224  5498 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:57.579213  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 198548us
I20260709 13:02:57.547814  5478 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.587141  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.588776  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.590219  1603 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:57.496860  5484 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:02:57.582290  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.599500  1533 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:57.582468  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.582937  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.583238  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:57.583529  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:57.584616  1527 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:57.590248  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.577968  5192 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:57.526508  5280 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:02:57.592581  1601 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:57.592849  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.581243  1604 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:57.536865  5265 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:02:57.573258  5072 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.616101  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:57.627499  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.614439  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:57.627548  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.632426  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.633776  1601 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:57.619721  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.547039  5397 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:57.526911  5269 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.638422  1603 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.541599  5388 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:02:57.643586  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63649us
I20260709 13:02:57.649091  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:02:57.598953  5512 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:57.614650  5142 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:57.663947  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.647519  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.667680  1601 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.669716  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:57.670686  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 278897us
I20260709 13:02:57.672175  5431 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:57.674355  5479 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:57.674773  5479 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:57.675717  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.675760  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:57.677094  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.678923  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:57.679584  1603 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.680727  1682 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.684799  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.628121  5508 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.688464  1601 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:57.690102  1604 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.643985  5387 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.690136  1530 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:57.646656  5157 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:57.697678  1603 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:57.688588  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.649390  5123 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:57.665784  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 176148us
I20260709 13:02:57.699740  1601 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:57.701910  1607 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.713864  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.713979  1574 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:57.715117  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.696766  5461 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:57.716156  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.717265  5461 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.717736  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.718628  5522 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:57.719165  5522 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:57.719303  5138 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:57.721108  1677 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.725819  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.726624  1532 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.687793  5509 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.732048  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.729633  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.719861  5138 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:57.727264  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.728971  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.599761  5463 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.649873  5453 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:57.731408  1675 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:57.742583  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.732666  1607 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:57.646070  5072 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.743996  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.708904  5387 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.744791  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.686690  5487 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:02:57.701318  5480 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:57.696542  5516 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.747828  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:57.749574  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.765847  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.693157  5505 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:57.731031  5239 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.764086  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.727262  5456 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.741500  5323 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.802692  1604 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:57.814692  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:57.737619  5508 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:57.820478  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:57.820709  1601 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:57.825377  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62406.6us
I20260709 13:02:57.726578  5157 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.730831  5344 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:57.887372  5516 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.785754  5515 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:57.824913  5536 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:02:57.835150  5323 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:57.887833  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 140247us
W20260709 13:02:57.888410  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 158855us
I20260709 13:02:57.750438  5310 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.823765  5480 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.819271  5472 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.821959  5388 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.751572  5484 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:57.750490  5534 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.821943  5429 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.905277  5520 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:57.911742  5464 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.911957  5456 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:57.905211  1607 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:57.905570  1576 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:02:57.973058  1576 leader_election.cc:403] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:57.886925  5439 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.910635  5269 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.910892  5517 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.894608  5092 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:57.907800  5514 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:02:57.961740  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:57.903358  1531 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:57.957329  5495 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.911720  5157 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:57.757161  5509 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:57.912070  5515 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:57.939301  5239 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:57.978077  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72633.5us
W20260709 13:02:57.964643  5513 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:02:57.999887  1648 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:58.001215  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.002424  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:57.956656  5323 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:57.983510  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 219483us
I20260709 13:02:57.960409  5388 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.006274  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:57.966054  5535 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:57.971105  5531 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:57.898332  5138 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.741967  5192 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.997684  5316 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:57.981067  5387 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:58.021682  1678 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:57.991902  5092 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.028189  5092 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.031014  5092 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.000402  5515 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.010535  5388 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.987963  5498 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.015000  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.046268  1682 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:57.976591  5464 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:58.019081  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.047190  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.996927  5520 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.014343  5524 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:58.008143  5518 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:02:57.971681  5534 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.998840  5456 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.008450  5439 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:58.026232  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:57.986447  5429 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
W20260709 13:02:58.052733  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50373.2us
I20260709 13:02:58.068444  1648 leader_election.cc:400] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12.
I20260709 13:02:58.054615  1679 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:57.906644  5508 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.720073  5522 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:57.672736  5431 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.057404  5505 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.978209  5480 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.018877  5157 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:58.003710  1603 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.917840  5516 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.000593  5509 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.069777  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.070472  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.056996  5528 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:58.052439  5464 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.008683  5517 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:02:58.085381  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.099375  5157 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.675575  5479 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.088593  5542 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:58.089143  5523 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 13:02:58.090142  5539 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:02:58.150997  5483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.015s	sys 0.013s
W20260709 13:02:58.151439  5483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.015s	sys 0.013s
I20260709 13:02:58.063016  5386 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.153391  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.154510  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.066269  5239 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.155768  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.094718  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:58.156499  1603 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.095130  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:58.118327  5527 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:02:58.118734  5540 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:58.045755  5316 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:58.065667  5310 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.073225  5072 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:58.124533  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54843.8us
I20260709 13:02:58.020234  5535 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.184878  5535 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:58.121959  5544 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:58.185302  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.186661  5544 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.186949  1648 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13.
I20260709 13:02:58.152604  5386 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.189008  5534 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.189096  5386 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:58.190615  5545 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:58.193601  5494 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:58.194026  5494 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:58.194469  5524 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.195086  5524 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.197417  5551 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:58.197964  5551 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:58.198928  5551 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.202384  5509 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:58.203894  5540 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:58.204427  5540 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.205592  5540 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.207129  5540 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.208446  5310 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.211565  5310 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:58.216439  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.218264  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:58.172171  5142 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:02:58.221742  5358 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.222169  5358 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.223078  5358 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.224264  5358 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.172736  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.177011  5528 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:58.180159  5529 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.181231  5550 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:58.157030  5542 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:58.182298  5543 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:58.167009  1605 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:58.202564  5516 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.175814  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.264993  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:02:58.266395  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.235302  1648 leader_election.cc:403] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.236358  1603 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:58.147020  5453 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:58.155190  5157 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.246281  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:58.223901  5478 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.001s
I20260709 13:02:58.250648  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:58.259461  1605 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:58.271140  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.275426  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.276219  1526 raft_consensus.cc:2368] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:02:58.275879  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.278995  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.279814  1526 raft_consensus.cc:2410] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:58.280006  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.280789  1527 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:58.281571  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.282083  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.282246  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.283331  1680 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:58.283470  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:58.284116  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97306.4us
I20260709 13:02:58.280234  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.285619  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.285987  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.240320  5536 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.295615  1531 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:58.282182  1535 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:02:58.169520  5482 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.297561  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.291898  1527 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:58.293012  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.286867  1526 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:58.298995  1678 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:58.298942  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.299451  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.300114  1526 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:02:58.300556  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.301210  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.302299  1648 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13.
I20260709 13:02:58.303182  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.251173  5551 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.305655  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.307768  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.308492  1535 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.267499  5505 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.271025  5453 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:58.281399  5516 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.316226  1605 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:58.262915  5542 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.318461  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.281033  5517 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.331393  1678 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.326948  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:58.250573  5485 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:02:58.335886  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.154062  5480 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.295472  5466 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13.
I20260709 13:02:58.304288  5461 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.278148  5478 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.318392  5453 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.360417  1535 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:58.172132  5456 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.261276  5529 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.372012  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.326728  5463 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:58.172627  5520 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.345100  5057 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:58.396756  5552 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:02:58.398085  5547 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:58.403033  5557 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.403568  5557 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:58.404414  5557 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.405678  5557 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.412415  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.413071  1532 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:02:58.414041  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.414783  1532 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:58.415504  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.419008  1532 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:58.377265  1535 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:02:58.311057  5536 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:58.420264  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 117106us
I20260709 13:02:58.332202  5516 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.385640  5549 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.349334  5092 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:58.411522  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:58.422173  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.422853  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.425472  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:58.426645  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 76979.3us
I20260709 13:02:58.435460  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.438302  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.439023  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:58.436558  1530 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:02:58.445434  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.446285  1530 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:58.449395  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.450397  1535 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:58.342042  5517 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.457873  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.461948  5453 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.463408  1678 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.464581  5453 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:58.421401  5551 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.424400  5522 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:58.428954  5549 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.423563  5508 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.485615  1527 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:02:58.465684  5239 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:58.516925  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45210.1us
I20260709 13:02:58.358634  5528 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.487650  5549 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.533854  1526 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:58.517419  5461 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.535581  5554 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 13:02:58.546192  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.552897  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:58.488818  5551 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:58.576387  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.538748  5239 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:02:58.583747  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.583995  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 1933) took 1045 ms. Trace:
I20260709 13:02:58.545559  5461 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:58.589257  1604 rpcz_store.cc:276] 0709 13:02:57.538581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.627242 (+ 88661us) service_pool.cc:224] Handling call
0709 13:02:58.583820 (+956578us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b5400365e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:58.583940 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142357376}
I20260709 13:02:58.488525  5522 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.594184  5473 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.594851  5473 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.597097  5522 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:58.600778  5316 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.601397  5316 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.603600  5316 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.604360  5478 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.615409  1574 leader_election.cc:400] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:02:58.615921  1574 leader_election.cc:403] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.616900  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.620613  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.622120  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.624008  1610 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:58.624425  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.625000  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.625669  1610 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:02:58.593196  5566 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:02:58.630714  1602 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.630864  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:58.632083  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.627063  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.627233  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.633495  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.634981  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.635622  1534 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:58.636605  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.636634  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.605190  5461 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.641420  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.643749  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:58.644390  1602 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:58.638021  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.647189  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.653226  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.653537  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.610186  5473 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:58.680768  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.666378  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.661144  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.654564  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.665100  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.688484  1534 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:58.689911  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:58.646602  5515 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 13:02:58.638335  5481 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:02:58.691627  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:02:58.696734  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117916us
I20260709 13:02:58.697638  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.696158  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:58.704604  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.665225  5483 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:58.683908  5406 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:58.729871  5563 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:02:58.693434  5571 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:58.736166  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.654877  5092 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.697140  1602 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.697494  1534 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.735713  5516 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.736908  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.737128  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.697335  5529 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.693306  5530 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.649221  5478 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.665074  5310 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.762671  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.701589  5072 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:58.761157  5530 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.770542  5072 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.770874  5530 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.771163  5072 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:58.771642  5567 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:02:58.732100  5239 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.732344  5387 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.746920  5536 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.688477  5123 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:58.701577  5386 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:02:58.759757  1534 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:58.746224  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.793579  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.794504  1528 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.763770  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.760354  5517 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:58.766034  5388 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.705s	user 0.016s	sys 0.000s
W20260709 13:02:58.768666  5323 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
I20260709 13:02:58.696141  5553 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.697197  5515 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.812323  1675 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:58.813004  5540 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.004s
I20260709 13:02:58.813405  5515 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:58.813594  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.796792  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.814705  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1920) took 1449 ms. Trace:
I20260709 13:02:58.814837  5388 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.815146  1606 rpcz_store.cc:276] 0709 13:02:57.364821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.368065 (+  3244us) service_pool.cc:224] Handling call
0709 13:02:57.368341 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:57.498643 (+130302us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:57.537365 (+ 38722us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.975745 (+438380us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:57.976310 (+   565us) log.cc:844] Serialized 52 byte log entry
0709 13:02:57.976446 (+   136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:57.976480 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.814344 (+837864us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000fffd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:58.814385 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.814437 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:58.814526 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.814655 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35163,"prepare.queue_time_us":33221,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":4359,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":18457,"spinlock_wait_cycles":295800192,"thread_start_us":428236,"threads_started":1,"wal-append.queue_time_us":499813}
I20260709 13:02:58.816995  5535 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:58.817931  5535 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:58.815140  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.818492  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.819106  1533 raft_consensus.cc:2376] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12. Re-sending same reply.
I20260709 13:02:58.817755  5323 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.798760  5387 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.819473  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:02:58.798333  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 95648.5us
I20260709 13:02:58.818887  5535 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.819839  5387 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.799283  5529 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.821272  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.821518  5485 raft_consensus.cc:2764] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:58.821430  5529 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.822045  5557 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.822261  5485 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.822526  5387 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.823549  5529 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.801069  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.826414  5426 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.826670  5323 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.827176  1607 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [10.7-12.8]
W20260709 13:02:58.827723  5464 consensus_meta.cc:287] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
I20260709 13:02:58.828619  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1924) took 1122 ms. Trace:
I20260709 13:02:58.842609  1607 rpcz_store.cc:276] 0709 13:02:57.706252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.980468 (+274216us) service_pool.cc:224] Handling call
0709 13:02:57.980788 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:58.827595 (+846807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.828179 (+   584us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540005cdd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:58.828542 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945897216}
I20260709 13:02:58.819974  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.770960  5509 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:58.831439  5559 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.408s	user 0.000s	sys 0.004s
I20260709 13:02:58.823511  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.825626  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.836477  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:02:58.751211  5542 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.785813  5481 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.847446  1526 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
W20260709 13:02:58.821036  5578 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:02:58.816980  5388 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.814733  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:58.843791  1533 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:02:58.786650  5395 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.868577  5387 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.850023  1534 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.850942  5142 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.788265  5516 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:02:58.870573  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47135.7us
W20260709 13:02:58.870095  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 262567us
I20260709 13:02:58.835855  1528 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:58.866858  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:02:58.869274  5387 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.876000  1682 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:58.828647  5551 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.878192  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.884557  5583 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.885296  5583 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.886816  5387 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.886868  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:58.887602  5509 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:58.888065  1535 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.888408  5583 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.890367  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:02:58.891054  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:02:58.873275  5142 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.895618  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:02:58.893913  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74516.2us
I20260709 13:02:58.879209  5516 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.898680  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.899745  5481 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.875381  5386 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.901737  1535 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:02:58.901918  1530 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:58.902436  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.906281  5477 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.849751  5464 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:58.909866  5464 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:58.909022  5142 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:58.916109  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.922464  1534 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:02:58.932404  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:02:58.934880  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:02:58.936928  1535 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:58.939564  5535 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.940297  5535 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:58.940814  5535 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.943325  5553 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:58.944593  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.945420  1607 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:02:58.946077  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.946113  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.946885  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:58.947120  1606 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 8.
I20260709 13:02:58.948477  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.949604  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:58.963639  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.949774  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:02:58.955026  1535 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:59.109637  1535 pending_rounds.cc:85] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:02:59.110059  1535 pending_rounds.cc:107] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:59.110399  1535 raft_consensus.cc:2889] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.994946  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.111546  1526 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.114535  1535 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:02:58.952137  5157 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.665s	user 0.005s	sys 0.007s
I20260709 13:02:58.936586  5386 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.952791  5526 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.999975  5540 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:58.951174  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:02:59.043342  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.946113  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:02:58.896418  5551 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.944172  5553 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:58.955307  5481 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:59.120684  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.121027  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 171319us
I20260709 13:02:58.954862  5072 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:58.949602  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.952353  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:58.956630  5516 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:02:59.116081  5524 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.005s
I20260709 13:02:59.109658  1606 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:02:59.260455  5481 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.249624  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 303558us
I20260709 13:02:59.252000  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:02:59.125576  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 176814us
I20260709 13:02:59.278285  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:59.280129  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:02:59.262514  1604 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:02:59.259930  5580 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:59.135007  5386 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.249634  1526 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:02:59.259792  5589 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.230330  5472 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.264813  5540 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:59.260316  5239 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:58.962406  5557 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:02:59.120157  5157 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.284539  5481 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.267376  5515 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:02:59.289397  5549 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.731s	user 0.002s	sys 0.008s
I20260709 13:02:59.303620  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:02:59.306159  5530 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.534s	user 0.000s	sys 0.010s
I20260709 13:02:59.291764  5344 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:59.288514  5395 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.291164  5386 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.292117  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:59.291391  5472 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:59.276023  5524 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.313102  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:02:59.295965  5580 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:59.315979  1683 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.312319  5395 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:02:59.310189  5461 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.002s
I20260709 13:02:59.316918  5589 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:59.345621  1602 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:02:59.323916  5472 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.311810  5515 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.337610  5395 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.311132  5549 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.313282  5530 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.354151  5344 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:02:59.334354  5265 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.392927  5265 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.393394  5265 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:59.399941  5579 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.625s	user 0.000s	sys 0.012s
I20260709 13:02:59.366168  5535 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.402297  5535 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.366860  5540 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.359419  5542 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:02:59.346084  5589 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:59.406551  5589 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.346028  5165 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:02:59.369170  5157 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.374183  5344 consensus_queue.cc:1243] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:59.374881  5580 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.377383  5549 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.378118  1605 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:02:59.380318  5591 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:02:59.381570  5524 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.391088  5072 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.391960  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:59.392316  5597 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:59.580431  5597 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.399875  5123 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:59.582717  5123 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.349247  5461 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.587347  5461 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.600934  5549 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.601482  5549 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:02:59.602394  5549 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.603833  5549 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.402331  5530 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.447047  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1560) took 1099 ms. Trace:
I20260709 13:02:59.447633  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1621) took 1430 ms. Trace:
I20260709 13:02:59.631517  1675 rpcz_store.cc:276] 0709 13:02:58.017555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.018016 (+   461us) service_pool.cc:224] Handling call
0709 13:02:58.018346 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.812752 (+794406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.447386 (+634634us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400404f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.447573 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825346432}
I20260709 13:02:59.633234  1675 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.635156  5492 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:59.636574  5492 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.637008  5492 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:59.638008  5492 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:59.639181  5492 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.450992  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:59.452239  5239 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:02:59.454125  4931 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.640967  1676 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:02:59.641456  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1991) took 1028 ms. Trace:
I20260709 13:02:59.456701  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1946) took 1215 ms. Trace:
I20260709 13:02:59.467262  5601 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:02:59.641775  1676 rpcz_store.cc:276] 0709 13:02:58.613054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.450633 (+837579us) service_pool.cc:224] Handling call
0709 13:02:59.641398 (+190765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:59.470222  1680 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.471899  1606 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:59.641932  1601 rpcz_store.cc:276] 0709 13:02:58.241714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.241904 (+   190us) service_pool.cc:224] Handling call
0709 13:02:58.242297 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.452681 (+210384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.452711 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.467980 (+ 15269us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.558324 (+ 90344us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:58.558366 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.433434 (+875068us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.433516 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.433590 (+    74us) raft_consensus.cc:1685] finished
0709 13:02:59.433611 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.456612 (+ 23001us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199,"raft.run_cpu_time_us":855,"raft.run_wall_time_us":26279,"spinlock_wait_cycles":483080448,"thread_start_us":28619,"threads_started":1,"wal-append.queue_time_us":171793}
I20260709 13:02:59.474472  5431 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.645681  1601 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.414323  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 194) took 1218 ms. Trace:
I20260709 13:02:59.649088  1682 rpcz_store.cc:276] 0709 13:02:58.196407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.230201 (+ 33794us) service_pool.cc:224] Handling call
0709 13:02:58.230484 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.879659 (+649175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.413930 (+534271us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002e8bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.414232 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483824384}
I20260709 13:02:59.486907  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1617) took 1472 ms. Trace:
I20260709 13:02:59.651093  1677 rpcz_store.cc:276] 0709 13:02:58.014872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.016619 (+  1747us) service_pool.cc:224] Handling call
0709 13:02:58.016908 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.024126 (+  7218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.024161 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.024657 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.486084 (+1461427us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18001e8bc0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1
0709 13:02:59.486303 (+   219us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:59.486355 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.486474 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.486538 (+    64us) raft_consensus.cc:1685] finished
0709 13:02:59.486555 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.486835 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3625,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5840,"spinlock_wait_cycles":8745728,"thread_start_us":90410,"threads_started":1,"wal-append.queue_time_us":98845,"wal-append.run_cpu_time_us":2688,"wal-append.run_wall_time_us":1239189}
I20260709 13:02:59.487955  5358 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.490079  5479 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.496376  5583 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.656275  5583 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:59.657399  5583 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.657756  5395 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.658710  5583 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.502214  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:59.505853  1607 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.511994  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1556) took 1218 ms. Trace:
I20260709 13:02:59.662184  1527 rpcz_store.cc:276] 0709 13:02:58.293752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.300324 (+  6572us) service_pool.cc:224] Handling call
0709 13:02:59.511744 (+1211420us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400440054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:02:59.511875 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424145792}
I20260709 13:02:59.663705  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.664420  1527 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.518239  5192 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:59.519708  5553 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.665904  5192 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.522656  5516 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.667711  5516 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.523165  5551 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:59.523845  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1570) took 1121 ms. Trace:
I20260709 13:02:59.528195  5142 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:02:59.670463  5142 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:59.670327  5551 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:02:59.531059  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.537380  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:59.539243  5478 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.545699  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1915) took 2182 ms. Trace:
I20260709 13:02:59.673128  5478 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:02:59.673233  1608 rpcz_store.cc:276] 0709 13:02:57.363423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.366671 (+  3248us) service_pool.cc:224] Handling call
0709 13:02:57.377659 (+ 10988us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:57.586785 (+209126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.586811 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:58.208526 (+621715us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b2c0000e678. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:58.209064 (+   538us) log.cc:844] Serialized 52 byte log entry
0709 13:02:58.276151 (+ 67087us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:58.276185 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.401441 (+125256us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:59.545200 (+1143759us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001720d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.545291 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.545366 (+    75us) raft_consensus.cc:1685] finished
0709 13:02:59.545385 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.545613 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84114,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":518219904,"thread_start_us":66144,"threads_started":1,"wal-append.queue_time_us":120980,"wal-append.run_cpu_time_us":4032,"wal-append.run_wall_time_us":1069135}
I20260709 13:02:59.564936  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1630) took 1327 ms. Trace:
I20260709 13:02:59.578212  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1569) took 1176 ms. Trace:
I20260709 13:02:59.551564  5494 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.675624  5494 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.642153  5601 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.469280  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:59.662184  5546 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:02:59.519610  5057 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:59.678038  5057 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.679118  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1990) took 1066 ms. Trace:
I20260709 13:02:59.679944  5510 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.680498  5510 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:02:59.675118  1533 rpcz_store.cc:276] 0709 13:02:58.401645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.867729 (+466084us) service_pool.cc:224] Handling call
0709 13:02:58.868128 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.868528 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.868556 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.869009 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.201211 (+332202us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:59.267601 (+ 66390us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.522169 (+254568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.522242 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.577886 (+ 55644us) raft_consensus.cc:1685] finished
0709 13:02:59.577917 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.578113 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286685,"prepare.queue_time_us":85367,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2029,"raft.queue_time_us":258881,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":213,"thread_start_us":331456,"threads_started":1,"wal-append.queue_time_us":391945}
I20260709 13:02:59.681787  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.682346  1533 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.674111  5478 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.675729  1683 rpcz_store.cc:276] 0709 13:02:58.247906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.273052 (+ 25146us) service_pool.cc:224] Handling call
0709 13:02:58.278791 (+  5739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.331262 (+1052471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.564615 (+233353us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400140854. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.564848 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384894336}
I20260709 13:02:59.684379  5478 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.684633  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:02:59.670290  1528 rpcz_store.cc:276] 0709 13:02:58.401930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.876717 (+474787us) service_pool.cc:224] Handling call
0709 13:02:58.891023 (+ 14306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.913816 (+ 22793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.913847 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.914261 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.248841 (+334580us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:59.290632 (+ 41791us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.448794 (+158162us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b4800002958. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:02:59.523296 (+ 74502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.523396 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.523453 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:59.523589 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.523773 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352436,"prepare.queue_time_us":43336,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":47,"raft.queue_time_us":258890,"raft.run_cpu_time_us":9078,"raft.run_wall_time_us":520023,"spinlock_wait_cycles":145170688,"thread_start_us":334204,"threads_started":1,"wal-append.queue_time_us":357908}
I20260709 13:02:59.679508  1678 rpcz_store.cc:276] 0709 13:02:58.612774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.579603 (+966829us) service_pool.cc:224] Handling call
0709 13:02:59.588619 (+  9016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.678274 (+ 89655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.678306 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:59.678347 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:59.678376 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.678902 (+   526us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b54002e9ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.678944 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.679063 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205664640}
I20260709 13:02:59.686944  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.687558  1528 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.665951  5553 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.641150  5239 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:02:59.690174  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.681344  5510 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:59.699513  1677 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:59.706832  5358 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.707044  5598 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:02:59.707463  5358 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.707522  5598 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.709914  5358 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.743623  5303 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.744421  5303 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:02:59.747071  5303 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.759842  5057 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.759948  1603 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.761092  5516 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.761561  1608 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:59.630344  1531 rpcz_store.cc:276] 0709 13:02:58.347665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.348335 (+   670us) service_pool.cc:224] Handling call
0709 13:02:58.370442 (+ 22107us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:58.370864 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.370904 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:58.378629 (+  7725us) log.cc:844] Serialized 52 byte log entry
0709 13:02:58.644609 (+265980us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:58.893412 (+248803us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.917784 (+ 24372us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.917983 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.918058 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.395838 (+477780us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:02:59.446807 (+ 50969us) raft_consensus.cc:1685] finished
0709 13:02:59.446830 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.446985 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68342,"prepare.queue_time_us":124575,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":55,"raft.queue_time_us":20074,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":24205,"spinlock_wait_cycles":27552128,"thread_start_us":312690,"threads_started":2,"wal-append.queue_time_us":294706}
I20260709 13:02:59.762706  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.763141  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:59.763739  1608 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.765002  5472 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:02:59.772130  5510 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.774082  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1791) took 1276 ms. Trace:
I20260709 13:02:59.777482  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1578) took 1373 ms. Trace:
I20260709 13:02:59.780150  5536 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.781744  5536 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:02:59.782241  5536 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.789222  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1545) took 1510 ms. Trace:
I20260709 13:02:59.814859  1529 rpcz_store.cc:276] 0709 13:02:58.278949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.279069 (+   120us) service_pool.cc:224] Handling call
0709 13:02:58.279309 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.848462 (+569153us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:58.874443 (+ 25981us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.788102 (+913659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:59.788162 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:59.788229 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.788948 (+   719us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54000a3cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.789003 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.789146 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410883,"prepare.queue_time_us":30828,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":424188,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":307,"spinlock_wait_cycles":1287965568,"thread_start_us":519236,"threads_started":2,"wal-append.queue_time_us":393838}
I20260709 13:02:59.817869  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:02:59.998071  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 313674us
I20260709 13:03:00.005275  1529 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:02:59.778141  1534 rpcz_store.cc:276] 0709 13:02:58.432406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.923279 (+490873us) service_pool.cc:224] Handling call
0709 13:02:58.935663 (+ 12384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.509211 (+573548us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:59.509536 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.776330 (+266794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:59.776409 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:59.776473 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.777167 (+   694us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54000f7154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:02:59.777234 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.777405 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11392,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"spinlock_wait_cycles":1318391168,"thread_start_us":266400,"threads_started":1,"wal-append.queue_time_us":250077}
I20260709 13:02:59.857337  1601 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:00.009802  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:00.011034  1534 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.011130  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:00.012272  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.009s	sys 0.010s
I20260709 13:02:59.817780  1527 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:00.012848  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.014319  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.014647  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:02:59.805703  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.997990  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.998250  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:00.016997  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.774580  1526 rpcz_store.cc:276] 0709 13:02:58.497903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.291041 (+793138us) service_pool.cc:224] Handling call
0709 13:02:59.291471 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.524616 (+233145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.524663 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.525329 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.772941 (+247612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:59.773578 (+   637us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.773780 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.773851 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.773892 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:59.773903 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.774024 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232682,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":234868,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":247186,"threads_started":1,"wal-append.queue_time_us":245836}
I20260709 13:03:00.019722  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.021301  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:02:59.854049  1602 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:59.855962  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:00.030344  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:00.012780  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.009s	sys 0.010s
I20260709 13:03:00.027163  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.034801  1533 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:00.036180  1602 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:00.038002  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.031893  1603 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:02:59.771788  1608 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:02:59.839777  1607 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.070596  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:02:59.799997  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1947) took 1556 ms. Trace:
I20260709 13:02:59.820307  1610 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.075358  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:59.860471  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.082475  1610 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:02:59.840718  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:02:59.878691  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.048725  1680 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:00.049678  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.166745  1675 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.167428  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.168459  1682 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:00.169196  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 1992) took 1537 ms. Trace:
I20260709 13:03:00.169555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.169626  1680 rpcz_store.cc:276] 0709 13:02:58.632179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.866549 (+234370us) service_pool.cc:224] Handling call
0709 13:03:00.168976 (+1302427us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400034654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:00.169131 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365391616}
I20260709 13:03:00.170931  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.050065  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1983) took 1885 ms. Trace:
I20260709 13:03:00.172272  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.172516  1681 rpcz_store.cc:276] 0709 13:02:58.164350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.164496 (+   146us) service_pool.cc:224] Handling call
0709 13:02:58.164907 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:58.240522 (+ 75615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.240570 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:59.423922 (+1183352us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:02:59.452949 (+ 29027us) log.cc:844] Serialized 52 byte log entry
0709 13:02:59.866268 (+413319us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:59.866322 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.866419 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.049413 (+182994us) raft_consensus.cc:1685] finished
0709 13:03:00.049458 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.049877 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12453,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":197,"spinlock_wait_cycles":22220160,"thread_start_us":412895,"threads_started":1,"wal-append.queue_time_us":470483}
I20260709 13:03:00.174217  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.174760  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.175501  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.050630  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.052302  1683 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.053501  1527 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:00.076886  1604 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:00.176628  1678 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:00.176889  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.179044  1680 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:00.072531  1609 rpcz_store.cc:276] 0709 13:02:58.243855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.244066 (+   211us) service_pool.cc:224] Handling call
0709 13:02:58.244429 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.244709 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:58.283080 (+ 38371us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.423258 (+1140178us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18000e61a0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:59.779813 (+356555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:59.779867 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:59.779914 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.799761 (+ 19847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.799921 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36084,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":81,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":10575744,"thread_start_us":324558,"threads_started":1,"wal-append.queue_time_us":1479494}
I20260709 13:03:00.176008  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.185159  1609 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:00.177052  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.185609  5269 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.186182  5269 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.187235  1683 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:00.187758  1683 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.080725  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.081336  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:02:59.826030  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.190832  5316 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:00.191668  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 365595us
W20260709 13:03:00.192998  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.876139  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:00.085117  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.083899  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.103551  5165 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:00.096652  5092 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.007596  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:00.235430  1603 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:00.107245  5072 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:00.111101  1610 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:00.106185  1607 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:00.128209  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1988) took 1515 ms. Trace:
I20260709 13:03:00.130565  5057 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.131603  5157 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.136847  5123 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.156940  1433 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.995782  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.094508  5192 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.189668  5269 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.887140  5395 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:02:59.926625  5472 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:00.258096  5464 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:03:00.259958  5472 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:00.260217  5072 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.261190  5472 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.263515  5072 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:59.886157  5456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.000s	sys 0.030s
W20260709 13:02:59.930094  5481 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.010s
W20260709 13:03:00.300699  5456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.527s	user 0.000s	sys 0.031s
I20260709 13:03:00.300940  5481 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:00.302822  5629 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.365s	user 0.000s	sys 0.002s
I20260709 13:03:00.304199  1684 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.304167  1433 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.305130  5498 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.195166  5515 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.306043  5498 consensus_queue.cc:1243] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:00.306640  1601 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:00.306739  5323 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.199299  5546 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.307307  5323 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:00.266124  5453 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:03:00.308930  5481 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:00.185249  5265 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.791s	user 0.017s	sys 0.003s
I20260709 13:03:00.273947  5524 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.309674  5265 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.310103  5524 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.310635  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1576) took 1906 ms. Trace:
I20260709 13:03:00.170935  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.185232  1681 raft_consensus.cc:2393] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:00.189085  1683 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.214185  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:00.215724  5386 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.897s	user 0.009s	sys 0.008s
I20260709 13:02:59.930291  5553 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:02:59.956444  5589 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.013s
I20260709 13:02:59.930225  5598 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.929654  5597 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:02:59.903052  5601 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.223039  1609 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:00.366972  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 497122us
I20260709 13:03:00.177052  1534 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
W20260709 13:03:00.211815  5492 consensus_meta.cc:287] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.010s
I20260709 13:03:00.371692  5553 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.371789  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:00.372215  5589 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.372632  5553 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.374022  1606 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:00.238199  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72574.7us
I20260709 13:03:00.376735  5553 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.326736  5386 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.378578  5395 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.379592  5386 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.246212  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.246591  1679 rpcz_store.cc:276] 0709 13:02:58.612148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.482473 (+870325us) service_pool.cc:224] Handling call
0709 13:02:59.482938 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:59.483427 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.483453 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:59.488562 (+  5109us) log.cc:844] Serialized 52 byte log entry
0709 13:02:59.808751 (+320189us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:59.837408 (+ 28657us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.111803 (+274395us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b18003efc20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:00.127378 (+ 15575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.127515 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.127601 (+    86us) raft_consensus.cc:1685] finished
0709 13:03:00.127707 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.127976 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4443,"prepare.queue_time_us":32056,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":292056,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":321,"spinlock_wait_cycles":49554816,"thread_start_us":319734,"threads_started":1,"wal-append.queue_time_us":315776}
I20260709 13:03:00.397883  1679 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.252535  5157 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:00.267805  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.273902  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.399549  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1793) took 1871 ms. Trace:
I20260709 13:03:00.271330  5165 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.400780  5157 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.399968  1533 rpcz_store.cc:276] 0709 13:02:58.527847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.051198 (+1523351us) service_pool.cc:224] Handling call
0709 13:03:00.051888 (+   690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.056915 (+  5027us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:00.056970 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.063734 (+  6764us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.243041 (+179307us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:00.246812 (+  3771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.252124 (+  5312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.399294 (+147170us) raft_consensus.cc:1685] finished
0709 13:03:00.399315 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.399469 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135242,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":70,"thread_start_us":168832,"threads_started":1,"wal-append.queue_time_us":300276}
I20260709 13:03:00.401750  5165 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.401855  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:00.402740  1533 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.402951  1676 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:00.274256  4931 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.017s
W20260709 13:03:00.281883  5549 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.018s
I20260709 13:03:00.289217  5483 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.404233  5493 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.404595  5483 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.404840  5493 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.407141  5483 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.290935  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:00.408082  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117339us
I20260709 13:03:00.408939  5493 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.409240  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.409819  5493 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:00.410336  5493 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:00.291141  5516 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.410857  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:00.411311  5516 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.412055  5553 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.412882  5553 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:00.413230  5553 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.291653  5142 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:00.292224  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50994.8us
W20260709 13:03:00.413184  5536 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.011s
I20260709 13:03:00.414599  5536 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.415982  5142 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.416682  5142 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.293181  5610 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.293777  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1790) took 1796 ms. Trace:
I20260709 13:03:00.418998  5142 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.417937  1535 rpcz_store.cc:276] 0709 13:02:58.497215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.115447 (+618232us) service_pool.cc:224] Handling call
0709 13:02:59.118202 (+  2755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.118470 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:59.233555 (+115085us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.271713 (+1038158us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.286268 (+ 14555us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.287200 (+   932us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.289308 (+  2108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:00.289896 (+   588us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.292628 (+  2732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.292817 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.293133 (+   316us) raft_consensus.cc:1685] finished
0709 13:03:00.293145 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.293444 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21876,"prepare.queue_time_us":373015,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":1813,"raft.queue_time_us":159915,"raft.run_cpu_time_us":552,"raft.run_wall_time_us":552,"thread_start_us":982367,"threads_started":2,"wal-append.queue_time_us":671456}
I20260709 13:03:00.420303  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:00.422474  1535 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 13:03:00.423310  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1798) took 1887 ms. Trace:
W20260709 13:03:00.295696  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.296464  1529 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.427369  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.298141  5551 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:00.299019  5530 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:00.444257  5515 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:00.444939  5530 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:00.445082  5466 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:00.445453  5530 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:00.445930  5515 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.446384  5515 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.308493  5323 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.447688  5323 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:00.448694  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.865314  5505 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:03:00.446703  5530 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.263286  5472 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.312999  1602 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.304682  5621 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.330910  1678 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:03:00.330986  5138 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:00.311123  1530 rpcz_store.cc:276] 0709 13:02:58.403592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.902984 (+499392us) service_pool.cc:224] Handling call
0709 13:02:58.953217 (+ 50233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.999966 (+ 46749us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:59.119042 (+119076us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.513910 (+394868us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:02:59.517318 (+  3408us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:02:59.821194 (+303876us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.822258 (+  1064us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.854280 (+ 32022us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4697c2fd70 00007f4697c23293 00007f4697c18cea 00007f4697c1923a 00007f4698083a2a 00007f46980930bf 00007f4698093038
0709 13:02:59.854605 (+   325us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.855082 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.855224 (+   142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:59.855254 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.855329 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.286723 (+431394us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:00.290241 (+  3518us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:00.292642 (+  2401us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:00.294504 (+  1862us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b180038fda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4697c2fd70 00007f4697c201a8 00007f4697c137a1 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169 00007f4697c1d131
0709 13:03:00.310252 (+ 15748us) raft_consensus.cc:1685] finished
0709 13:03:00.310272 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.310456 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95139,"prepare.queue_time_us":159050,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":125,"raft.queue_time_us":51834,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":8061,"spinlock_wait_cycles":124638720,"thread_start_us":273357,"threads_started":1,"wal-append.queue_time_us":647708}
I20260709 13:03:00.342415  5461 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:00.343753  5583 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:00.346397  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 1978) took 2195 ms. Trace:
I20260709 13:03:00.348106  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.360575  5524 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.242292  1675 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:00.380046  5614 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:00.380407  5479 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.012s
W20260709 13:03:00.384130  1528 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.636s	user 0.015s	sys 0.010s
I20260709 13:03:00.393216  5589 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.394454  5481 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:00.457893  5621 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.465355  5481 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.460631  5583 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.465726  5481 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:00.451970  5536 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.466782  5481 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:00.366400  5265 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.413678  5553 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.460772  1684 rpcz_store.cc:276] 0709 13:02:58.150866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.155616 (+  4750us) service_pool.cc:224] Handling call
0709 13:02:58.155892 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.305044 (+2149152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.345923 (+ 40879us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54003cc8d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:00.346282 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4939273600}
I20260709 13:03:00.462570  5614 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:00.459002  5138 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.469815  5614 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.471215  5614 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.452507  5598 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:00.472470  5310 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.472831  5598 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.473064  5310 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.428014  5386 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.432448  5494 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.014s
I20260709 13:03:00.413877  5516 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.296986  5057 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.441011  5605 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:00.413620  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:00.460362  5461 consensus_queue.cc:1243] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:00.473397  5598 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.460008  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.467669  5583 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:00.431555  5478 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.746s	user 0.017s	sys 0.005s
I20260709 13:03:00.410842  5493 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.423748  1535 rpcz_store.cc:276] 0709 13:02:58.535630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.421487 (+1885857us) service_pool.cc:224] Handling call
0709 13:03:00.422022 (+   535us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:00.422939 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.423206 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:00.475724  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.477810  1528 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:00.506551  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93027.6us
I20260709 13:03:00.505218  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.487202  5303 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.487793  5481 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.455852  5466 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:00.519044  5466 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.464494  5239 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.453301  5453 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:00.461479  5530 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.461359  5472 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.481446  2210 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:00.484403  5386 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:00.457257  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.477506  5610 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.466785  5621 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.447533  5515 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.470635  5138 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:00.514099  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:00.487159  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.482190  1529 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:00.508924  5516 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:00.474193  5549 consensus_queue.cc:1175] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:03:00.547112  5310 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.549569  5463 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:00.550623  5463 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:00.552923  5515 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.553375  5610 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.559091  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.560328  1608 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:00.560549  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:00.551880  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.562532  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.563220  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:00.564590  5453 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.565052  5453 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.566035  5453 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.567008  5601 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:00.567489  5601 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:00.532639  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:00.526659  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1590) took 1138 ms. Trace:
I20260709 13:03:00.569011  1528 rpcz_store.cc:276] 0709 13:02:59.382918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.686700 (+303782us) service_pool.cc:224] Handling call
0709 13:03:00.518009 (+831309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:00.568744  5601 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.569375  5310 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:00.570125  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.570041  5310 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:00.570406  5601 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.533300  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.571445  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:00.536455  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.520300  5583 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:00.535614  1683 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.537441  1526 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:03:00.539705  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 112482us
I20260709 13:03:00.567553  5453 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.568668  2212 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:00.521016  5303 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.581512  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.538254  5598 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.549625  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.575273  1528 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.579574  1533 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:00.572182  1530 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:00.551499  5553 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.615643  1675 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.524732  5239 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.555867  5610 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.618218  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.624641  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.624722  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.626559  1530 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:00.580348  5583 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:00.627249  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 94028.9us
I20260709 13:03:00.630683  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.632499  1684 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:00.630748  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.635470  1533 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:00.635735  1530 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.635986  1532 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:00.635118  5466 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.655570  5466 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.613327  5157 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:00.663270  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51211.3us
I20260709 13:03:00.663837  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:00.636384  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1799) took 2100 ms. Trace:
I20260709 13:03:00.675199  1530 rpcz_store.cc:276] 0709 13:02:58.542407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.629666 (+2087259us) service_pool.cc:224] Handling call
0709 13:03:00.635520 (+  5854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.636136 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.636307 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:00.636595  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.671502  1531 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:00.676669  1601 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:00.646018  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1796) took 2112 ms. Trace:
W20260709 13:03:00.677903  5646 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:00.646142  5303 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.637185  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1800) took 2094 ms. Trace:
I20260709 13:03:00.626113  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:00.657723  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:00.677928  1534 rpcz_store.cc:276] 0709 13:02:58.534990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.369292 (+1834302us) service_pool.cc:224] Handling call
0709 13:03:00.369757 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.370233 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.370382 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.370950 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.516899 (+145949us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:00.516934 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.517001 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.645814 (+128813us) raft_consensus.cc:1685] finished
0709 13:03:00.645832 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.645959 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1949,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"thread_start_us":145495,"threads_started":1,"wal-append.queue_time_us":236327}
I20260709 13:03:00.683132  1683 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:00.717145  1675 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:00.717993  1533 rpcz_store.cc:276] 0709 13:02:58.542685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.636325 (+2093640us) service_pool.cc:224] Handling call
0709 13:03:00.636637 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.636897 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.636919 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:00.636958 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:00.636989 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.637036 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.637120 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:00.672643  1608 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:00.630010  5583 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.721872  1529 raft_consensus.cc:606] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.722256  1529 raft_consensus.cc:614] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:00.727074  1528 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:00.729331  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1586) took 1376 ms. Trace:
I20260709 13:03:00.729907  1531 rpcz_store.cc:276] 0709 13:02:59.353336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.762437 (+409101us) service_pool.cc:224] Handling call
0709 13:03:00.729048 (+966611us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000a46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:00.729243 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714562944}
W20260709 13:03:00.732995  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1573) took 2330 ms (client timeout 1887 ms). Trace:
W20260709 13:03:00.733573  1532 rpcz_store.cc:269] 0709 13:02:58.402709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.422629 (+ 19920us) service_pool.cc:224] Handling call
0709 13:03:00.732687 (+2310058us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54000fb754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:00.732888 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4975732608}
I20260709 13:03:00.736545  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.737439  1535 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:00.739486  5553 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.655990  5493 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:00.742058  5493 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:00.661962  5542 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 13:03:00.752019  1534 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:00.753178  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1801) took 2210 ms. Trace:
I20260709 13:03:00.731532  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:00.754863  1534 rpcz_store.cc:276] 0709 13:02:58.542858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.751177 (+2208319us) service_pool.cc:224] Handling call
0709 13:03:00.751712 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.752807 (+  1095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.753102 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:00.641157  5057 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:00.679574  5386 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:01.237061  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.896080  2178 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.757462  5598 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.845326  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1792) took 2328 ms. Trace:
I20260709 13:03:01.239231  1526 rpcz_store.cc:276] 0709 13:02:58.517091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.019602 (+1502511us) service_pool.cc:224] Handling call
0709 13:03:00.506226 (+486624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.582708 (+ 76482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.845053 (+262345us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540020ab50. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:00.845219 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110182144}
I20260709 13:03:00.818470  5493 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.240769  5493 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.241196  5493 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.776362  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:01.244520  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:01.245134  1530 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:00.871407  1533 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:01.246763  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1805) took 2703 ms. Trace:
I20260709 13:03:01.247201  1533 rpcz_store.cc:276] 0709 13:02:58.543529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.847880 (+2304351us) service_pool.cc:224] Handling call
0709 13:03:00.870850 (+ 22970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.246522 (+375672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.246695 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:00.824972  5641 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:03:00.780408  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 122756us
W20260709 13:03:01.062181  5649 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:03:01.249457  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1795) took 2719 ms. Trace:
I20260709 13:03:01.250007  1527 rpcz_store.cc:276] 0709 13:02:58.530052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.180591 (+1650539us) service_pool.cc:224] Handling call
0709 13:03:00.181161 (+   570us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:00.181965 (+   804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.181999 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:00.224784 (+ 42785us) log.cc:844] Serialized 52 byte log entry
0709 13:03:00.529847 (+305063us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:00.579205 (+ 49358us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.742298 (+163093us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b180034dda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:03:00.742620 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.742870 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.742968 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.745696 (+  2728us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b180034dda0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:01.249268 (+503572us) raft_consensus.cc:1685] finished
0709 13:03:01.249290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.249402 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76658,"prepare.queue_time_us":218918,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":79,"raft.queue_time_us":16421,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":377,"spinlock_wait_cycles":109010048,"thread_start_us":261848,"threads_started":1,"wal-append.queue_time_us":315719}
I20260709 13:03:01.249445  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:00.845189  1529 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:01.254057  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1804) took 2710 ms. Trace:
W20260709 13:03:00.872267  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.871802  5642 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:01.254407  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:01.258411  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:00.888631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:01.259842  1528 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:01.259934  5642 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:01.232007  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.252549  1535 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.994802  1531 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:01.267730  1605 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:01.267997  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1802) took 2724 ms. Trace:
I20260709 13:03:01.255169  1529 rpcz_store.cc:276] 0709 13:02:58.543345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.825454 (+2282109us) service_pool.cc:224] Handling call
0709 13:03:00.825840 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.252959 (+427119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.253899 (+   940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.237493  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:00.846860  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.827505  1532 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:00.819180  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 59283.3us
I20260709 13:03:01.269565  1535 rpcz_store.cc:276] 0709 13:02:58.543023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.774937 (+2231914us) service_pool.cc:224] Handling call
0709 13:03:01.252328 (+477391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.266186 (+ 13858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.267898 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.278030  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:01.300446  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1803) took 2757 ms. Trace:
I20260709 13:03:01.300894  1532 rpcz_store.cc:276] 0709 13:02:58.543182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.756198 (+2213016us) service_pool.cc:224] Handling call
0709 13:03:00.818751 (+ 62553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.295148 (+476397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.300375 (+  5227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:00.933423  5643 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:03:01.293201  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 613389us
W20260709 13:03:01.303648  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.309105  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:01.309731  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.230729  5601 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
I20260709 13:03:01.302007  1606 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:01.310137  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.304407  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:01.315954  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:00.818969  5310 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:01.324277  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.325379  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.316663  1679 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:03:01.275946  5650 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.382s	user 0.000s	sys 0.006s
W20260709 13:03:01.311470  5614 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.003s
I20260709 13:03:01.339850  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:01.348233  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 51035.2us
I20260709 13:03:01.349027  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.281812  5239 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:01.347822  5530 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.353199  1534 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:01.353267  5642 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:01.356531  5057 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:01.392247  5057 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:01.360939  5310 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:01.393735  5057 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:01.394747  5310 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:01.396139  5310 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.396329  5530 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.399302  5530 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:01.365504  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:01.371579  5466 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.003s
I20260709 13:03:01.343544  5386 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.400354  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1582) took 2796 ms. Trace:
W20260709 13:03:01.385987  5481 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.867s	user 0.004s	sys 0.007s
I20260709 13:03:01.391291  5522 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.402478  1679 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:01.400830  1534 rpcz_store.cc:276] 0709 13:02:58.582231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.330594 (+2748363us) service_pool.cc:224] Handling call
0709 13:03:01.352940 (+ 22346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.377928 (+ 24988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.378194 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.403183  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 54253.2us
I20260709 13:03:01.404301  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 177) took 2816 ms. Trace:
W20260709 13:03:01.404970  5515 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.001s
I20260709 13:03:01.404722  1534 rpcz_store.cc:276] 0709 13:02:58.589773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.403286 (+2813513us) service_pool.cc:224] Handling call
0709 13:03:01.403668 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.403905 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.403935 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.403997 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:01.404066 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.404123 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.404241 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.405776  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:01.406626  1534 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:01.407713  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.407258  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 178) took 2798 ms. Trace:
I20260709 13:03:01.408285  5642 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.409066  5642 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:01.408704  1534 rpcz_store.cc:276] 0709 13:02:58.608480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.406059 (+2797579us) service_pool.cc:224] Handling call
0709 13:03:01.406454 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.407012 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.407206 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.417537  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.423440  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.349237  5494 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.425786  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:01.438083  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.455263  5386 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.455914  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.425139  5515 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:01.460587  1534 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.430810  5530 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.428471  5522 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:01.447268  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 104196us
I20260709 13:03:01.469771  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.470126  5466 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.470770  5466 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:01.471323  5466 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.473212  5598 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.473821  5598 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.407907  5493 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.485916  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 179) took 2698 ms. Trace:
I20260709 13:03:01.486533  1534 rpcz_store.cc:276] 0709 13:02:58.767439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.425761 (+2658322us) service_pool.cc:224] Handling call
0709 13:03:01.460342 (+ 34581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.465084 (+  4742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.465367 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.493717  1526 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:01.494716  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1807) took 2619 ms. Trace:
I20260709 13:03:01.495169  1526 rpcz_store.cc:276] 0709 13:02:58.875827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.437809 (+2561982us) service_pool.cc:224] Handling call
0709 13:03:01.493480 (+ 55671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.494381 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.494628 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.489022  5583 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
I20260709 13:03:01.459437  5515 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:01.513243  1533 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:01.464849  5530 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:01.522852  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1809) took 2631 ms. Trace:
I20260709 13:03:01.523475  1533 rpcz_store.cc:276] 0709 13:02:58.882829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.484970 (+2602141us) service_pool.cc:224] Handling call
0709 13:03:01.506324 (+ 21354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.513821 (+  7497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.514095 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.512434  5583 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.534411  5583 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:01.457854  5494 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.542915  5583 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.505471  5481 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:01.520079  5530 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.549263  1534 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:01.517472  5515 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.552740  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 180) took 2282 ms. Trace:
I20260709 13:03:01.552770  1527 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.553247  1526 rpcz_store.cc:276] 0709 13:02:59.270573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.505222 (+2234649us) service_pool.cc:224] Handling call
0709 13:03:01.547522 (+ 42300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.552358 (+  4836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.552392 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.552441 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:01.552478 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.552547 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.552681 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.559832  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1808) took 2678 ms. Trace:
I20260709 13:03:01.560411  1527 rpcz_store.cc:276] 0709 13:02:58.881876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.496665 (+2614789us) service_pool.cc:224] Handling call
0709 13:03:01.535541 (+ 38876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.559465 (+ 23924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.559753 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.498695  5522 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.558871  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1812) took 2303 ms. Trace:
I20260709 13:03:01.566596  1534 rpcz_store.cc:276] 0709 13:02:59.255020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.487567 (+2232547us) service_pool.cc:224] Handling call
0709 13:03:01.549023 (+ 61456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.558515 (+  9492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.558799 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.578859  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:01.581591  1526 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:03:01.567358  5642 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:01.620472  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54968.6us
I20260709 13:03:01.650184  5598 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:01.652211  5601 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:01.653540  5601 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:01.653870  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1594) took 1666 ms. Trace:
W20260709 13:03:01.654718  5652 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:01.656661  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1595) took 1669 ms. Trace:
I20260709 13:03:01.657145  1532 rpcz_store.cc:276] 0709 13:02:59.987618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.655591 (+1667973us) service_pool.cc:224] Handling call
0709 13:03:01.655990 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.656265 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.656298 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.656351 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:01.656397 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.656457 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.656593 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.565312  5481 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.665793  1529 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:01.666693  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1596) took 1678 ms. Trace:
I20260709 13:03:01.667299  1529 rpcz_store.cc:276] 0709 13:02:59.988080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.664911 (+1676831us) service_pool.cc:224] Handling call
0709 13:03:01.665353 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.666380 (+  1027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.666625 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.654484  1530 rpcz_store.cc:276] 0709 13:02:59.987161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.652598 (+1665437us) service_pool.cc:224] Handling call
0709 13:03:01.653113 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.653440 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.653464 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.653536 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:01.653589 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.653660 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.653798 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.653920  5601 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:01.653544  5583 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.683928  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1597) took 1691 ms. Trace:
I20260709 13:03:01.702181  1529 rpcz_store.cc:276] 0709 13:02:59.988453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.668769 (+1680316us) service_pool.cc:224] Handling call
0709 13:03:01.679178 (+ 10409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.679415 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.679454 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.679511 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:01.679556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.679629 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.679767 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.677067  5598 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:03:01.685235  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:01.682983  5453 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.098s	user 0.014s	sys 0.000s
I20260709 13:03:01.711597  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:01.706219  1530 pending_rounds.cc:85] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:03:01.716099  1602 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:01.659751  5466 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.713321  1530 pending_rounds.cc:107] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:03:01.736210  1530 raft_consensus.cc:2889] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.729713  1529 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:01.737630  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1813) took 1367 ms. Trace:
I20260709 13:03:01.738046  1529 rpcz_store.cc:276] 0709 13:03:00.369863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.708795 (+1338932us) service_pool.cc:224] Handling call
0709 13:03:01.720338 (+ 11543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.737320 (+ 16982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.737570 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.744002  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58876.8us
I20260709 13:03:01.712150  5493 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:01.754027  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.717096  5583 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:01.782349  1529 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:01.783557  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1817) took 1409 ms. Trace:
I20260709 13:03:01.784215  1529 rpcz_store.cc:276] 0709 13:03:00.374335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.739060 (+1364725us) service_pool.cc:224] Handling call
0709 13:03:01.781905 (+ 42845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.783111 (+  1206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.783483 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.775069  5653 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:03:01.752770  5453 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.745273  5494 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:01.786984  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1814) took 1416 ms. Trace:
W20260709 13:03:01.802625  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.776526  5549 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:01.778483  5481 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:01.817659  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.819485  5549 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.822026  1529 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:03:01.822389  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.826730  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1819) took 1395 ms. Trace:
I20260709 13:03:01.822438  1532 rpcz_store.cc:276] 0709 13:03:00.370410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.734731 (+1364321us) service_pool.cc:224] Handling call
0709 13:03:01.776680 (+ 41949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.786563 (+  9883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.786594 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.786635 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:01.786663 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.786731 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.786914 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33795}
I20260709 13:03:01.827234  1529 rpcz_store.cc:276] 0709 13:03:00.431434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.785339 (+1353905us) service_pool.cc:224] Handling call
0709 13:03:01.821624 (+ 36285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.826397 (+  4773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.826655 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.829244  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1997) took 1104 ms. Trace:
I20260709 13:03:01.837852  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1821) took 1405 ms. Trace:
W20260709 13:03:01.837852  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 83908.9us
I20260709 13:03:01.840483  1531 rpcz_store.cc:276] 0709 13:03:00.432095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.836694 (+1404599us) service_pool.cc:224] Handling call
0709 13:03:01.837082 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.837497 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.837527 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.837576 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:01.837612 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.837674 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.837794 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:01.842691  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.022s
W20260709 13:03:01.843127  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.006s	sys 0.022s
I20260709 13:03:01.844319  1529 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:01.845162  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1820) took 1413 ms. Trace:
I20260709 13:03:01.845546  1529 rpcz_store.cc:276] 0709 13:03:00.431746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.828247 (+1396501us) service_pool.cc:224] Handling call
0709 13:03:01.844077 (+ 15830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.844811 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.845092 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.818074  5483 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:01.818745  5494 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:01.859601  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.860390  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.857470  1531 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:03:01.872946  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.934212  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.934821  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.931384  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1823) took 1498 ms. Trace:
I20260709 13:03:01.937065  1531 rpcz_store.cc:276] 0709 13:03:00.432814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.842385 (+1409571us) service_pool.cc:224] Handling call
0709 13:03:01.857097 (+ 14712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.864495 (+  7398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.931298 (+ 66803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.791383  5239 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.952672  1529 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:01.955376  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1833) took 1283 ms. Trace:
I20260709 13:03:01.955870  1529 rpcz_store.cc:276] 0709 13:03:00.672385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.857636 (+1185251us) service_pool.cc:224] Handling call
0709 13:03:01.952237 (+ 94601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.955009 (+  2772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.955299 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.956796  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1818) took 1514 ms. Trace:
I20260709 13:03:01.957440  1535 rpcz_store.cc:276] 0709 13:03:00.431069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.777775 (+1346706us) service_pool.cc:224] Handling call
0709 13:03:01.821008 (+ 43233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.929174 (+108166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.929206 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.944608 (+ 15402us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:01.944682 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.944783 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.944961 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.958850  1532 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:01.960857  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:01.964048  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1831) took 1412 ms. Trace:
I20260709 13:03:01.964619  1532 rpcz_store.cc:276] 0709 13:03:00.551147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.857541 (+1306394us) service_pool.cc:224] Handling call
0709 13:03:01.950239 (+ 92698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.963679 (+ 13440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.963951 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:01.789237  5583 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.847807  5466 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:01.929028  5453 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.973120  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131065us
W20260709 13:03:01.962214  5654 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:01.952070  5386 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.956009  5494 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:01.951328  5493 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:01.829376  5601 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.001235  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:01.962186  5522 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:01.979308  5310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.056s	sys 0.159s
I20260709 13:03:01.936586  5483 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:02.001057  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.501s (SENT) [suppressed 22 similar messages]
I20260709 13:03:02.027366  1534 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:03:02.032161  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.024219  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.018s
W20260709 13:03:02.024171  5310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.056s	sys 0.159s
W20260709 13:03:02.037930  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.022s
W20260709 13:03:02.039939  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.000s	sys 0.022s
I20260709 13:03:02.017239  5453 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:02.033541  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.002s	sys 0.018s
I20260709 13:03:02.030143  5522 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:02.040597  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.011s
W20260709 13:03:02.058017  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.013s	sys 0.011s
I20260709 13:03:02.028782  5493 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:02.058959  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.015s	sys 0.025s
W20260709 13:03:02.064113  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.015s	sys 0.025s
W20260709 13:03:02.064471  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 815041us
W20260709 13:03:02.066113  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 596422us
I20260709 13:03:02.066483  5466 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:02.067147  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:02.070679  5656 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:02.071447  5657 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.400s	user 0.001s	sys 0.002s
I20260709 13:03:02.047403  5663 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.073385  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.085219  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.074059  5549 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.090718  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.095317  5483 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:02.099442  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.021s
W20260709 13:03:02.099893  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.002s	sys 0.021s
I20260709 13:03:02.088327  5601 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.102254  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.076471  5522 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:03:02.094080  5555 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:02.103178  1609 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.010s	sys 0.010s
W20260709 13:03:02.145186  1609 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.012s	sys 0.011s
I20260709 13:03:02.098140  5386 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.098416  5598 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.100744  5310 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:02.181989  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.087931  5656 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.198702  5386 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:02.199280  5667 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:03:02.200101  5664 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.201236  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2001) took 1284 ms. Trace:
I20260709 13:03:02.206607  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 1998) took 1447 ms. Trace:
I20260709 13:03:02.210569  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.097952  5239 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:03:02.215564  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117437us
I20260709 13:03:02.133757  5555 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.182687  5057 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.193250  5598 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.215067  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1668) took 1602 ms. Trace:
W20260709 13:03:02.218418  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92935.6us
I20260709 13:03:02.096614  5663 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.212005  1607 rpcz_store.cc:276] 0709 13:03:00.916774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.917087 (+   313us) service_pool.cc:224] Handling call
0709 13:03:01.246134 (+329047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.246415 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.246439 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.246915 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.265416 (+ 18501us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:01.265454 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.265531 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.944263 (+678732us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:02.200894 (+256631us) raft_consensus.cc:1685] finished
0709 13:03:02.200923 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.201169 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57378688,"thread_start_us":18028,"threads_started":1,"wal-append.queue_time_us":322081}
I20260709 13:03:02.212093  1608 rpcz_store.cc:276] 0709 13:03:00.758844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.759025 (+   181us) service_pool.cc:224] Handling call
0709 13:03:00.794174 (+ 35149us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.376541 (+582367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.376578 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.453159 (+ 76581us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.046131 (+592972us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.046190 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.046285 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.206355 (+160070us) raft_consensus.cc:1685] finished
0709 13:03:02.206375 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.206541 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525833,"raft.queue_time_us":606408,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":8940,"thread_start_us":530399,"threads_started":1,"wal-append.queue_time_us":713551}
I20260709 13:03:02.196085  5310 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:02.210044  2176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.021s	sys 0.011s
W20260709 13:03:02.224514  2176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.021s	sys 0.012s
W20260709 13:03:02.225083  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 638096us
I20260709 13:03:02.214293  5583 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.225878  5310 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.220288  5555 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.228899  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:01.830593  1601 rpcz_store.cc:276] 0709 13:03:00.717136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.717298 (+   162us) service_pool.cc:224] Handling call
0709 13:03:00.731388 (+ 14090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.731642 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:00.731972 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.820883 (+1088911us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.821135 (+   252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.821183 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:01.821230 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.821296 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.821402 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487571,"prepare.queue_time_us":71793,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":484599,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":35665,"thread_start_us":612350,"threads_started":2,"wal-append.queue_time_us":677993}
W20260709 13:03:02.231539  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.223589  5057 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.239068  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.239704  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.242255  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:02.244273  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.010s	sys 0.013s
I20260709 13:03:02.221120  5598 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:02.259378  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.015s	sys 0.015s
I20260709 13:03:02.228837  5239 raft_consensus.cc:2764] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:02.267763  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.261477  5057 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:02.245178  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 154562us
I20260709 13:03:02.262719  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.223203  5494 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.271720  1603 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:03:02.264470  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.264530  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 1.01016e+06us
W20260709 13:03:02.266158  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 800137us
I20260709 13:03:02.269302  1605 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:02.273701  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:02.269237  1608 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:02.243129  5466 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.289781  5472 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:02.290351  5472 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:02.290993  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.291254  5472 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.292316  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.293007  1683 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:02.295078  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1591) took 2909 ms. Trace:
I20260709 13:03:02.296198  5057 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.296765  5057 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.298928  5057 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.289657  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.300633  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.295488  1534 rpcz_store.cc:276] 0709 13:02:59.385850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.615751 (+2229901us) service_pool.cc:224] Handling call
0709 13:03:01.652568 (+ 36817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.027972 (+375404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.294809 (+266837us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400440554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:02.295020 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861159296}
I20260709 13:03:02.265970  5642 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.306819  5472 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.309056  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.265627  5656 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.320324  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.307657  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.284548  5453 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.315213  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.318760  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.316747  1684 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:02.266891  5549 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:02.320143  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.325584  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:02.321782  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.036s	sys 0.018s
I20260709 13:03:02.326203  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:03:02.326406  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.036s	sys 0.019s
I20260709 13:03:02.328248  5494 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.328768  5494 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.330338  5494 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.301908  5661 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.312300  5665 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.315503  5642 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.332767  1607 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:02.316737  5614 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.343511  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.220070  1682 rpcz_store.cc:276] 0709 13:03:00.612600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.618293 (+  5693us) service_pool.cc:224] Handling call
0709 13:03:00.825414 (+207121us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:00.825647 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.845504 (+ 19857us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:01.738592 (+893088us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.214693 (+476101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.214752 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.214793 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.214864 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.214994 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":448127,"prepare.queue_time_us":530460,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":5183,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":6601,"spinlock_wait_cycles":4841216,"thread_start_us":853125,"threads_started":2}
I20260709 13:03:02.311169  5466 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.340829  5642 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.354825  5493 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:02.358532  5515 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.001s
I20260709 13:03:02.358975  5515 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:02.361213  5658 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.781s	user 0.008s	sys 0.009s
W20260709 13:03:02.362911  5530 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
I20260709 13:03:02.363312  5530 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.342893  5665 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:02.364820  5677 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:02.366307  5665 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:02.367079  5665 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:02.367514  5665 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:02.332799  5549 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.369719  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.370013  5549 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:02.370373  1603 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.371173  1602 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:03:02.373140  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.375488  5530 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:02.377635  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 157) took 18552 ms (client timeout 15000 ms). Trace:
I20260709 13:03:02.380609  5665 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.382449  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2007) took 1150 ms. Trace:
I20260709 13:03:02.382860  1606 rpcz_store.cc:276] 0709 13:03:01.232436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.344835 (+112399us) service_pool.cc:224] Handling call
0709 13:03:01.389999 (+ 45164us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.453608 (+ 63609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.453692 (+    84us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.553911 (+100219us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.100340 (+546429us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.100378 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.100443 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.382202 (+281759us) raft_consensus.cc:1685] finished
0709 13:03:02.382220 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.382375 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6329,"raft.queue_time_us":3998,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":14387,"thread_start_us":519645,"threads_started":1,"wal-append.queue_time_us":755486}
I20260709 13:03:02.383683  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.385426  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.385620  5522 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:02.325040  5481 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:02.386091  5522 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.386456  5239 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:02.386538  5522 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.387056  5239 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:02.388082  5239 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.392189  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.392846  5663 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:02.393036  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.394150  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:02.394519  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87181.2us
I20260709 13:03:02.395030  5522 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.395421  5453 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.402791  5453 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.403415  5453 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.404181  5522 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.404203  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.405004  5522 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.405539  5522 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.405900  5522 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.406566  5515 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.403064  5687 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:02.395308  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.405124  1608 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.413193  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.414005  1606 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.342890  5661 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.414209  5522 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.416383  5661 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.395841  5614 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.420229  5664 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.421149  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.421999  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.422305  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.421108  5522 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.423447  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.423772  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.424062  1682 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:02.425354  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.426718  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.427404  1684 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
W20260709 13:03:02.378021  1431 rpcz_store.cc:269] 0709 13:02:43.825447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.825735 (+   288us) service_pool.cc:224] Handling call
0709 13:03:02.377396 (+18551661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:57.311928 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:57.363213 (+ 51285us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:57.363271 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:02:57.363296 (+    25us) tablet.cc:662] Decoding operations
0709 13:02:57.365552 (+  2256us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:57.365637 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:57.365675 (+    38us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:02:58.122660 (+756985us) tablet.cc:701] Row locks acquired
0709 13:02:58.158712 (+ 36052us) write_op.cc:260] PREPARE: finished
0709 13:02:58.228143 (+ 69431us) write_op.cc:270] Start()
0709 13:02:58.228314 (+   171us) write_op.cc:276] Timestamp: P: 1783602178171618 usec, L: 0
0709 13:02:58.228338 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:58.237876 (+  9538us) log.cc:844] Serialized 11397 byte log entry
0709 13:02:58.688786 (+450910us) op_driver.cc:464] REPLICATION: finished
0709 13:02:58.910850 (+222064us) write_op.cc:301] APPLY: starting
0709 13:02:58.910975 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:58.911606 (+   631us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:58.911760 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:59.306119 (+394359us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:59.306585 (+   466us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 13:02:59.306644 (+    59us) write_op.cc:312] APPLY: finished
0709 13:02:59.360106 (+ 53462us) log.cc:844] Serialized 193 byte log entry
0709 13:02:59.375539 (+ 15433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.375867 (+   328us) write_op.cc:454] Released schema lock
0709 13:02:59.375989 (+   122us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:59.376562 (+   573us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:59.376607 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":760660,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":215804,"apply.run_cpu_time_us":11269,"apply.run_wall_time_us":465658,"num_ops":29,"prepare.queue_time_us":450817,"prepare.run_cpu_time_us":19821,"prepare.run_wall_time_us":1149768,"raft.queue_time_us":141334,"raft.run_cpu_time_us":56191,"raft.run_wall_time_us":262683,"replication_time_us":409604,"spinlock_wait_cycles":55040,"thread_start_us":535651,"threads_started":4,"wal-append.queue_time_us":222556,"wal-append.run_cpu_time_us":5511,"wal-append.run_wall_time_us":1915184}]]}
I20260709 13:03:02.428983  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.430433  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.430542  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.431363  1607 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:02.419889  5614 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.434434  1603 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:03:02.435899  5642 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.436659  5679 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.437500  5679 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.438246  5642 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.440397  5664 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.441205  5664 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.443254  1608 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:02.444638  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.445144  5494 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.445914  5494 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.447350  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.447628  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.448431  5666 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.449411  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.449642  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.449752  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.449120  5666 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.450152  1529 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.451903  5666 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.452759  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.453096  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.453449  1528 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:02.453636  5666 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.453840  1534 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:02.454376  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.454177  5666 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.454641  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.455054  1528 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:02.455266  1534 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.450003  1677 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.456388  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.457139  1535 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:02.457104  5668 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.457799  5668 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.458142  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.458786  1535 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 8.
I20260709 13:03:02.459594  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.459875  5668 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.455844  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.460557  5494 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.460855  1528 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.461190  1535 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:02.461606  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.462117  5668 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.462523  1605 raft_consensus.cc:2410] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:03:02.462602  5668 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.459848  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.463550  5679 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.463737  1532 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 9: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:02.464735  5668 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.464910  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.462081  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:02.465790  1535 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.410065  5466 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.456693  5666 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.468406  1534 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:03:02.470170  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.471102  1528 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:02.465827  1532 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:03:02.478173  1677 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:02.452869  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.480284  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:02.481446  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.481844  1529 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:02.485991  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1587) took 3132 ms. Trace:
I20260709 13:03:02.501693  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.502200  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:02.502822  1608 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:02.487397  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.503736  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.503780  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 231202us
I20260709 13:03:02.489656  1527 raft_consensus.cc:606] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:02.505587  1527 raft_consensus.cc:614] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:02.505739  1534 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:02.491343  1606 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
W20260709 13:03:02.489377  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 488295us
I20260709 13:03:02.490834  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.510226  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.479935  5664 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.498401  1533 rpcz_store.cc:276] 0709 13:02:59.353617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.541427 (+2187810us) service_pool.cc:224] Handling call
0709 13:03:01.556888 (+ 15461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.583183 (+ 26295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.583228 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.621360 (+ 38132us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.100410 (+479050us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:02.476498 (+376088us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.485581 (+  9083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.485661 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.485717 (+    56us) raft_consensus.cc:1685] finished
0709 13:03:02.485735 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.485918 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5326,"raft.queue_time_us":235496,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":4910,"thread_start_us":713197,"threads_started":2,"wal-append.queue_time_us":578830}
I20260709 13:03:02.511905  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:02.515862  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.515705  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.516410  1680 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:02.516577  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.517422  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2000) took 1629 ms. Trace:
I20260709 13:03:02.517805  1609 rpcz_store.cc:276] 0709 13:03:00.888133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.888340 (+   207us) service_pool.cc:224] Handling call
0709 13:03:01.237146 (+348806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.331101 (+ 93955us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:02.146880 (+815779us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.517127 (+370247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.517176 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:02.517216 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.517273 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.517373 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10900,"prepare.queue_time_us":53066,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":1066409,"threads_started":2}
I20260709 13:03:02.518859  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:02.519441  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:02.515087  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.525055  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.524928  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:02.526156  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.527184  1675 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:03:02.528147  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.526772  1605 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:02.535635  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.537257  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:02.492092  5493 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.540376  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.540827  1532 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:02.540380  5672 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.539422  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.538151  2212 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:02.534448  1533 pending_rounds.cc:85] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:03:02.552728  1533 pending_rounds.cc:107] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:03:02.553681  1533 raft_consensus.cc:2889] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.536876  5663 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.545912  5672 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.537840  5666 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:02.530390  5661 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.560132  5661 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.561520  5672 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.562594  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.562842  5661 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:02.563995  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:02.559367  5663 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.565945  5663 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.575736  5666 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.576526  5666 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:02.528474  5682 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.581164  5682 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:02.582154  5682 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.584465  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.585861  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.586664  1603 raft_consensus.cc:2410] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:02.587370  5057 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.587929  5057 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.547675  5493 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.590495  5522 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.616895  5522 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:02.592767  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.618952  1608 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:02.619568  5522 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.594538  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.620398  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.621191  1608 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:02.591908  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.622372  1605 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:02.601241  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1834) took 1928 ms. Trace:
I20260709 13:03:02.624625  1526 rpcz_store.cc:276] 0709 13:03:00.672654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.858364 (+1185710us) service_pool.cc:224] Handling call
0709 13:03:01.951104 (+ 92740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.966732 (+ 15628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.966760 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.974147 (+  7387us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.489474 (+515327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:02.489536 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.489997 (+   461us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.601053 (+111056us) raft_consensus.cc:1685] finished
0709 13:03:02.601072 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.601187 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13334,"raft.queue_time_us":80642,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10228,"thread_start_us":460150,"threads_started":1,"wal-append.queue_time_us":581714}
I20260709 13:03:02.617590  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.595474  1676 raft_consensus.cc:2410] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:02.599603  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.610680  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2002) took 1677 ms. Trace:
I20260709 13:03:02.533772  5664 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.633999  1607 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:02.634644  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.635375  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:02.643740  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.645679  1608 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:02.646565  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.648334  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:02.652552  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 258475us
I20260709 13:03:02.647341  1684 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:02.655908  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.657009  1601 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:02.617568  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:02.658938  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.670809  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.659490  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.601339  5057 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.702610  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.703809  1535 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:02.687674  1609 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
W20260709 13:03:02.699584  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 353882us
I20260709 13:03:02.701568  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.605872  5493 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:02.636425  5664 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.706646  1606 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:02.641088  5679 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.655887  5494 raft_consensus.cc:2764] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:02.632745  1604 rpcz_store.cc:276] 0709 13:03:00.934320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.934539 (+   219us) service_pool.cc:224] Handling call
0709 13:03:00.934968 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.778511 (+843543us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:01.828391 (+ 49880us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.324253 (+495862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.345424 (+ 21171us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.345619 (+   195us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:02.345670 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.345862 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.608242 (+262380us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:02.610341 (+  2099us) raft_consensus.cc:1685] finished
0709 13:03:02.610468 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.610616 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374877,"prepare.queue_time_us":45632,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":477632,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":8072,"spinlock_wait_cycles":76838656,"thread_start_us":837938,"threads_started":2,"wal-append.queue_time_us":666656}
I20260709 13:03:02.611073  5666 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.715571  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.715766  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.680548  5583 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.588019  5598 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.719288  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.600335  5453 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.740213  1607 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [12.7-14.9]
I20260709 13:03:02.721081  5663 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.743721  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:02.717483  5664 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:02.777087  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 159581us
I20260709 13:03:02.835107  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:02.711985  5659 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.889290  1607 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:02.884575  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.750839  1609 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:02.888456  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1598) took 2899 ms. Trace:
I20260709 13:03:02.602545  5555 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.740478  5668 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:02.892262  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 113150us
I20260709 13:03:02.893783  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.748971  5493 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.895217  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:02.835737  5310 consensus_meta.cc:287] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.002s
I20260709 13:03:02.906983  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.891475  1530 rpcz_store.cc:276] 0709 13:02:59.988802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.673150 (+1684348us) service_pool.cc:224] Handling call
0709 13:03:01.683561 (+ 10411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.824635 (+141074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.824680 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.825385 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.306476 (+481091us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:02.682446 (+375970us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.888082 (+205636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.888152 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.888193 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:02.888204 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.888393 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8053,"prepare.queue_time_us":264067,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":239592,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7515,"thread_start_us":871098,"threads_started":3,"wal-append.queue_time_us":549393}
W20260709 13:03:02.908339  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 237665us
I20260709 13:03:02.776265  5483 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.712533  5691 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
W20260709 13:03:02.911953  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 165164us
I20260709 13:03:02.910132  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:02.883955  5057 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:02.905157  5671 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.920960  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:02.923970  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:02.919857  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:02.914755  5661 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:02.937459  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.942975  5706 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.943503  5706 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:02.943912  5706 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.918681  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.918568  5493 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:02.945806  5598 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:02.946342  5493 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.906144  5239 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:03:02.932224  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.923751  5671 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.909241  5668 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.969360  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:02.913074  5310 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.917393  5483 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.910938  5659 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:02.936709  5661 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:02.925483  5057 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:02.971836  5671 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:02.994424  5681 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:03:02.995375  5661 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.015136  5666 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.018381  5483 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.020406  5583 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.047495  5583 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.048192  5583 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:03.052114  5701 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:03:03.022598  5709 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:03.025609  5694 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:03:03.073873  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 188424us
I20260709 13:03:03.026532  5690 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.028676  5555 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:03.037142  5693 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:03:03.037664  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2004) took 1968 ms. Trace:
I20260709 13:03:03.012245  5707 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.026166  5695 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:03.074003  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.093918  1677 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:03.091180  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 121917us
I20260709 13:03:03.095849  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.089900  1610 rpcz_store.cc:276] 0709 13:03:01.069256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.069461 (+   205us) service_pool.cc:224] Handling call
0709 13:03:01.084499 (+ 15038us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:02.326948 (+1242449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.326978 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:02.483372 (+156394us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.702081 (+218709us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:02.761366 (+ 59285us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.761625 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.761759 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.026688 (+264929us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18002e2580. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:03.037169 (+ 10481us) raft_consensus.cc:1685] finished
0709 13:03:03.037284 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.037578 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283711,"prepare.queue_time_us":45782,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":3631,"raft.queue_time_us":462271,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":27253,"spinlock_wait_cycles":12480128,"thread_start_us":1164543,"threads_started":2,"wal-append.queue_time_us":410132}
I20260709 13:03:03.109890  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.116385  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.116899  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.117318  1676 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:03.083798  5690 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.108980  5695 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.109200  5668 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.111904  5679 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:03.139036  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.140169  1677 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.138960  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.127900  5690 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.149830  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.150822  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.151561  1676 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:03.154479  1684 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
W20260709 13:03:03.157810  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 239174us
I20260709 13:03:03.160238  5530 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.160722  5530 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:03.161201  5699 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:03:03.164440  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:03.165119  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.165086  1684 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:03.161123  5530 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.136547  5695 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.174556  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:03.187590  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 109394us
I20260709 13:03:03.188066  1683 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:03.188701  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.174844  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.175655  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.186019  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.172397  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.193421  1677 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:03.195601  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.209754  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.202806  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.202209  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.215114  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.219044  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.219897  1605 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.221195  1602 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:03.222815  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.143503  5679 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.225044  1684 raft_consensus.cc:2368] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:03.225055  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.228819  1604 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.193013  5386 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:03.148641  5598 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:03:03.172224  5493 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.192406  5668 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:03.195430  5666 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.153592  5555 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:03:03.208964  5483 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:03.242472  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53844.2us
I20260709 13:03:03.216946  5466 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.220669  5310 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.254606  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.235303  5717 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.278863  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1835) took 2597 ms. Trace:
I20260709 13:03:03.254161  5723 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:03.203460  5722 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:03:03.276688  5712 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:03:03.248672  5493 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.302484  1606 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.322570  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.288837  1531 rpcz_store.cc:276] 0709 13:03:00.681058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.969007 (+1287949us) service_pool.cc:224] Handling call
0709 13:03:02.002284 (+ 33277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.026080 (+ 23796us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:02.490493 (+464413us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.720662 (+230169us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.961309 (+240647us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800378220. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:03.126925 (+165616us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b1800378220. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:03.189096 (+ 62171us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.189398 (+   302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.189471 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:03.189557 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.277075 (+ 87518us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b1800378220. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:03.278558 (+  1483us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54000dd254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:03.278615 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.278780 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7203,"prepare.queue_time_us":503348,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":8942,"raft.queue_time_us":381848,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":6397,"spinlock_wait_cycles":111907840,"thread_start_us":859723,"threads_started":3,"wal-append.queue_time_us":500578}
I20260709 13:03:03.281145  5668 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:03.325510  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 208628us
I20260709 13:03:03.230773  5715 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:03:03.253450  5466 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.252532  5721 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.327858  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.231002  5719 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:03:03.330443  1679 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:03.250428  5549 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:03:03.293721  5717 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.287410  5057 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:03.253159  5472 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:03:03.318856  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.364872  1604 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:03.301254  5386 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:03.320333  5310 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.329481  5494 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.280627  5483 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.361142  5679 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.337334  5493 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.340299  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.316716  5723 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:03.249598  5720 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:03:03.343356  5466 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.344437  5719 consensus_queue.cc:1243] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:03.366814  1605 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:03.355808  5583 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.375893  5493 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:03.368606  5310 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:03.393932  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 75181.1us
I20260709 13:03:03.432651  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.394068  5690 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.394754  5737 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.395295  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:03.395378  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 55139.4us
I20260709 13:03:03.441689  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.395932  5707 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.396721  5723 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:03.444423  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 198248us
I20260709 13:03:03.398944  5691 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:03.361847  5057 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:03:03.347640  5717 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.372316  5715 consensus_queue.cc:1243] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:03.432199  5493 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.440357  5737 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:03.407662  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 159657us
W20260709 13:03:03.449011  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 194554us
I20260709 13:03:03.436296  5310 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.440002  5731 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:03.479575  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 388626us
I20260709 13:03:03.478106  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.444832  5707 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.475000  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.458722  5691 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:03.482084  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.414402  5661 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:03.422606  5664 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:03:03.463609  5494 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.463922  5057 consensus_queue.cc:1243] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:03.500133  5494 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:03.500627  5494 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.348068  5721 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:03.501116  1533 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.503149  5721 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:03.497972  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.504357  1531 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:03:03.506911  1534 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.508327  5664 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.509013  2211 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.510576  5664 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.511758  5494 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.512529  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.513485  1533 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.512683  2212 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:03.514297  5494 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.516589  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.517278  1526 raft_consensus.cc:2368] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:03.517550  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.518079  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.518204  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.518409  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.519026  1528 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:03.519275  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.518119  1532 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:03.519855  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.519838  1534 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.520551  1528 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:03.519212  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.521224  1529 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:03.520574  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.521989  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.522558  1529 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:03.522630  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.523419  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.523633  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.516003  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.523957  1529 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.524323  1528 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.524441  1533 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:03.525453  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.525652  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.526307  1532 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:03.532109  1576 leader_election.cc:400] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:03.532621  1576 leader_election.cc:403] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:03.528405  1534 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:03.535159  1529 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:03.535913  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.537334  5721 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.537935  5721 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.541381  5721 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.542080  5494 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.548230  5494 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:03.548904  5721 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:03.551204  5721 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.553987  5721 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.549948  5494 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.557190  5494 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.559113  1528 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:03.495644  5732 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.563869  1529 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:03.478866  5737 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.565323  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.565622  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.575752  1601 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:03.565337  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.576436  1529 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:03.566495  5659 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.562734  5664 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:03.594156  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:03.567621  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92173us
I20260709 13:03:03.567268  5691 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.568125  5614 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:03.569561  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:03.495812  5731 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.495482  5707 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.577023  1605 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:03.577556  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.577728  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.599663  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.498049  5720 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:03:03.607645  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.614158  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.603927  5731 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.466866  5668 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.617067  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.618539  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.578533  5472 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:03:03.623490  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.621771  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.623405  1676 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:03.499168  5386 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:03.630330  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60904.6us
I20260709 13:03:03.593578  5715 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:03.633862  1679 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:03.638254  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:03.644565  5738 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:03.664719  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:03.670967  1528 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:03.641270  1684 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:03.626442  5691 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.660758  5661 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.634344  5659 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.676301  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.657187  5453 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:03.668531  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.616739  5481 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:03.664745  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:03.611186  5733 raft_consensus.cc:2764] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:03.680636  5483 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.694737  5466 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.704718  5661 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:03.705899  5661 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:03.706305  5661 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:03.706362  5466 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:03.680454  5671 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:03:03.681182  5690 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:03.685501  5583 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:03.685648  5666 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:03.708278  5666 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.710641  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.687489  1534 raft_consensus.cc:2368] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
W20260709 13:03:03.671797  5706 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.004s
I20260709 13:03:03.679473  5745 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.698045  5530 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:03.698618  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60467us
W20260709 13:03:03.716189  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 180363us
I20260709 13:03:03.716498  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:03.699247  5736 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:03.700073  5614 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.700404  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.728705  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.696925  5737 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:03.702651  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.704248  1679 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:03.731531  1679 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:03.717617  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:03.722767  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.722975  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 267877us
I20260709 13:03:03.730697  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:03.734925  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:03.741497  5737 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:03.732684  1679 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:03.743062  1679 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.744246  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:03.744994  1606 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:03.745887  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.747789  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.748663  1676 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.751456  1534 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:03.753643  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:03.780148  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62910.7us
I20260709 13:03:03.780941  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.782181  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.707437  5661 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.796506  5738 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:03.807639  1602 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:03.742923  5614 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.730517  5706 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:03.707459  5671 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.813912  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:03.702692  5717 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.825278  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.829068  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:03.796617  5583 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.832161  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.807853  5740 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.836234  1679 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:03:03.844816  1679 pending_rounds.cc:85] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 9
I20260709 13:03:03.845110  1679 pending_rounds.cc:107] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:03:03.845367  1679 raft_consensus.cc:2889] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.850298  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.826293  5598 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.918385  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 92525.2us
I20260709 13:03:03.825453  5239 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.918217  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93624.5us
I20260709 13:03:03.930097  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.931922  1530 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:03.934973  1608 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:03.935432  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 319347us
I20260709 13:03:03.939113  2175 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.731128  5745 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:03.834956  5661 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.936512  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.854070  5614 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.844573  5732 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.968438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.970201  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.947588  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:04.054291  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 106768us
I20260709 13:03:04.054695  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:04.055392  1683 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:03.972052  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:04.057533  1678 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.971423  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.999866  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:03.927376  5734 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:03.935990  5494 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.008464  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:03.854439  5739 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:04.012315  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 74184.6us
I20260709 13:03:03.936604  5679 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.844718  5740 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:04.017118  5728 raft_consensus.cc:2764] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:04.049655  5666 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.002874  5738 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:04.075562  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:04.050359  5747 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:03:04.050922  5664 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.994477  5751 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
W20260709 13:03:04.052009  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 298421us
W20260709 13:03:04.017608  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75437.2us
I20260709 13:03:04.102772  1648 leader_election.cc:400] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:04.103165  1648 leader_election.cc:403] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:04.065330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:04.074646  5695 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.865s	user 0.006s	sys 0.005s
I20260709 13:03:04.063519  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:04.082362  1682 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:04.103981  1677 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:04.066659  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:04.072713  5740 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.066905  5752 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:04.062211  5494 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:04.067760  5739 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.110144  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:04.110345  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:04.112532  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:04.064100  5734 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:04.067309  5679 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:04.117409  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53993.6us
I20260709 13:03:04.122577  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:04.123195  5466 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:04.123306  5756 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:04.123850  5466 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:04.124790  5466 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.125559  5666 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.128176  5515 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:04.128739  5515 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:04.129922  1607 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.130954  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:04.132062  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:04.017958  5310 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.134294  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:04.137063  1606 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.129595  5515 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.001858  5614 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:03.944666  5721 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.001030  5732 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:04.141991  2212 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:04.142052  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:03.994832  5730 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 13:03:04.118886  5707 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:03:03.947598  5598 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.152772  5614 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.101172  5731 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.106036  5664 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.072855  5754 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:03:04.168783  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:04.133251  5739 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.186401  1610 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.132607  5679 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.159181  5721 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:04.141429  5530 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.134521  5752 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:04.133204  5494 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.945727  5239 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.162245  1606 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:04.204833  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:04.163419  5687 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:04.157752  5736 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:04.167826  5057 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:04.164363  5732 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.115952  5695 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.172669  5755 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:04.196395  5728 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.260840  5757 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:03:04.232904  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:04.207701  5721 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:04.263726  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161583us
I20260709 13:03:04.281188  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:04.217975  5706 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:04.232745  5691 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:04.179296  5707 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.298190  1676 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 13:03:04.222019  5671 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:04.287698  5766 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:04.317866  5707 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.320475  1531 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:04.320250  5752 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.322696  5466 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:04.324177  5466 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:04.324568  5466 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:04.325099  5731 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.325366  5466 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.327191  5466 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:04.328775  5493 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.000s
I20260709 13:03:04.329209  5493 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.330520  1526 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.331008  5453 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.331543  5453 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.332650  5758 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:03:04.305420  1676 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:04.310611  5750 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.334306  5750 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:04.334740  5750 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.335602  5664 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.316298  5706 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.263543  5717 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:04.337575  5706 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.338340  1535 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:04.339852  1610 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
W20260709 13:03:04.716080  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 289499us
I20260709 13:03:04.338020  1606 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:04.722524  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 1992) took 1264 ms. Trace:
I20260709 13:03:04.340004  5691 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:04.731118  5691 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.293792  5734 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.732059  5734 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.737752  5706 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:04.716641  1678 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.003s
I20260709 13:03:04.723011  1605 rpcz_store.cc:276] 0709 13:03:03.458268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.458438 (+   170us) service_pool.cc:224] Handling call
0709 13:03:03.471373 (+ 12935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.599957 (+128584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.722281 (+1122324us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540030a2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:04.722454 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242448256}
I20260709 13:03:04.729595  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:04.740235  1678 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:04.558427  5466 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.752681  5466 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.754812  5466 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:04.755225  5740 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.000s
W20260709 13:03:04.771246  5494 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.001s
I20260709 13:03:04.774353  5664 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.774938  5664 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.775367  5614 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.001s
I20260709 13:03:04.777609  5664 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.777841  5745 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:04.778589  5493 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.779330  5715 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:04.784608  5661 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:04.786931  5739 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:03:04.775770  5614 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.833499  1601 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.837903  5614 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.771835  5494 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.843257  5679 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:03:04.787566  5739 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.558065  5750 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.292784  5728 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:04.376857  5598 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:04.299579  5386 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:04.371699  5239 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:04.755625  5740 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.910225  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.037s
W20260709 13:03:04.910993  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.037s
W20260709 13:03:04.861111  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 112999us
I20260709 13:03:04.715915  5310 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:04.870398  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.012s	sys 0.040s
W20260709 13:03:04.869582  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.019s	sys 0.034s
W20260709 13:03:04.929237  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.019s	sys 0.035s
W20260709 13:03:04.929112  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.012s	sys 0.041s
I20260709 13:03:04.904675  1531 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 4
I20260709 13:03:04.930567  1531 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:03:04.930896  1531 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.898666  5664 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:04.954761  1604 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:04.978405  5739 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:04.930648  5691 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:04.901788  5738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.018s	sys 0.050s
I20260709 13:03:04.893787  5679 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:05.187408  5775 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:03:04.930070  5386 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:05.188086  5738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.018s	sys 0.051s
W20260709 13:03:05.214125  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 1.07204e+06us
I20260709 13:03:05.207826  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:05.205958  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 329954us
I20260709 13:03:05.206733  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.209870  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:05.225169  1683 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:05.208943  1682 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:05.226015  1682 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.212116  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.211735  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:05.227242  1677 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:05.223232  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:05.218737  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1705) took 1606 ms. Trace:
W20260709 13:03:05.216472  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 54) took 13453 ms (client timeout 15000 ms). Trace:
W20260709 13:03:05.207613  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 294154us
W20260709 13:03:05.210053  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 1999) took 1568 ms (client timeout 1966 ms). Trace:
W20260709 13:03:05.231037  1608 rpcz_store.cc:269] 0709 13:03:03.641948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.668272 (+ 26324us) service_pool.cc:224] Handling call
0709 13:03:05.209848 (+1541576us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400085f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:05.209973 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535285504}
I20260709 13:03:05.228629  1675 rpcz_store.cc:276] 0709 13:03:03.612690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.612808 (+   118us) service_pool.cc:224] Handling call
0709 13:03:05.218126 (+1605318us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54eee 0000000000375939 00007f469cfc81e0 00007f469d0910c4 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:05.218271 (+   145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.218446 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.218469 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.218507 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.218536 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.218586 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.218688 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3211136}
I20260709 13:03:05.232191  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.209339  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1858) took 1689 ms. Trace:
I20260709 13:03:05.233259  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:05.200318  5691 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:04.973235  5664 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.252501  1601 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [12.7-14.9]
I20260709 13:03:05.231673  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:05.239003  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1845) took 1722 ms. Trace:
I20260709 13:03:05.262014  1527 rpcz_store.cc:276] 0709 13:03:03.516531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.516642 (+   111us) service_pool.cc:224] Handling call
0709 13:03:03.752769 (+236127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.780241 (+ 27472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.780303 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.780366 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:03.780412 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.780513 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.238822 (+1458309us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000dd750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:05.238945 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27057,"raft.queue_time_us":27668,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4652,"spinlock_wait_cycles":542357248}
I20260709 13:03:05.248770  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1849) took 1727 ms. Trace:
I20260709 13:03:05.250403  5483 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.265830  5483 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:05.229646  1433 rpcz_store.cc:269] 0709 13:02:51.762756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.767145 (+  4389us) service_pool.cc:224] Handling call
0709 13:03:05.216401 (+13449256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:00.637713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:00.638355 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:00.638408 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:00.638434 (+    26us) tablet.cc:662] Decoding operations
0709 13:03:00.638914 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:00.638978 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:00.639005 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:00.639418 (+   413us) tablet.cc:701] Row locks acquired
0709 13:03:00.639458 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:03:00.639610 (+   152us) write_op.cc:270] Start()
0709 13:03:00.639740 (+   130us) write_op.cc:276] Timestamp: P: 1783602180639550 usec, L: 0
0709 13:03:00.639759 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:00.640475 (+   716us) log.cc:844] Serialized 918 byte log entry
0709 13:03:02.345796 (+1705321us) op_driver.cc:464] REPLICATION: finished
0709 13:03:02.918668 (+572872us) write_op.cc:301] APPLY: starting
0709 13:03:02.925923 (+  7255us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:02.939071 (+ 13148us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807632a 00007f4697ffbf14 00007f4697ffbec3 00007f4697ffbe38 00007f4697ffbdf3 00007f4697ffb0dc 00007f4698024e16 00007f469800ccbb 00007f4697ff739d 00007f4697ffad75
0709 13:03:02.952116 (+ 13045us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:02.971650 (+ 19534us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:03.053108 (+ 81458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:03.053387 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:03.053436 (+    49us) write_op.cc:312] APPLY: finished
0709 13:03:03.053725 (+   289us) log.cc:844] Serialized 28 byte log entry
0709 13:03:03.053940 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.054039 (+    99us) write_op.cc:454] Released schema lock
0709 13:03:03.054100 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:03.054533 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.054568 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":208,"mutex_wait_us":46492,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":345426,"apply.run_cpu_time_us":2834,"apply.run_wall_time_us":146639,"num_ops":2,"prepare.queue_time_us":255491,"prepare.run_cpu_time_us":56714,"prepare.run_wall_time_us":256238,"raft.queue_time_us":647006,"raft.run_cpu_time_us":55204,"raft.run_wall_time_us":631465,"replication_time_us":1684590,"spinlock_wait_cycles":5898624,"thread_start_us":1118920,"threads_started":4,"wal-append.queue_time_us":903344,"wal-append.run_cpu_time_us":23038,"wal-append.run_wall_time_us":2513360}]]}
I20260709 13:03:05.237294  5239 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:05.271368  5734 consensus_meta.cc:287] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.001s
I20260709 13:03:05.272204  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:05.272797  1529 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.277194  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:05.278800  5672 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:05.279212  5672 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.279592  5672 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.263794  1526 rpcz_store.cc:276] 0709 13:03:03.518039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.520111 (+  2072us) service_pool.cc:224] Handling call
0709 13:03:03.520376 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.330880 (+810504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.245523 (+914643us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540020a154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.245745 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862682496}
I20260709 13:03:05.287463  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:05.288645  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:05.290993  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1841) took 1741 ms (client timeout 1500 ms). Trace:
W20260709 13:03:05.291435  1535 rpcz_store.cc:269] 0709 13:03:03.506281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.512266 (+  5985us) service_pool.cc:224] Handling call
0709 13:03:05.247199 (+1734933us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54000a46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:05.247372 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897173888}
I20260709 13:03:05.210045  5522 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.249812  1682 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.216466  5733 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:05.205075  5750 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.301728  1682 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.302029  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.302610  1610 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.294214  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:05.297788  1529 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:05.221881  5738 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:05.232770  1532 rpcz_store.cc:276] 0709 13:03:03.520349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.558030 (+ 37681us) service_pool.cc:224] Handling call
0709 13:03:03.558394 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.688454 (+130060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.688486 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.689028 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.829943 (+140915us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:04.064015 (+234072us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.064216 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.208836 (+1144620us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000f7654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.208915 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.208988 (+    73us) raft_consensus.cc:1685] finished
0709 13:03:05.209098 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.209271 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":390287,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":71300,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":313204864,"thread_start_us":336879,"threads_started":2,"wal-append.queue_time_us":427669}
I20260709 13:03:05.217492  5695 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.307216  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:05.307844  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76250.9us
I20260709 13:03:05.356093  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:05.298604  5733 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:05.286733  5723 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.234441  5755 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:03:05.295521  5665 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.382913  1680 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:05.344331  5679 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.348209  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.349478  5453 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.311223  1526 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:05.296221  5614 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:05.332713  1535 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:03:05.322968  5779 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:03:05.305998  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:05.323144  1529 pending_rounds.cc:85] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 3
I20260709 13:03:05.415531  1529 pending_rounds.cc:107] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:05.415587  1534 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.415968  1529 raft_consensus.cc:2889] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.366068  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:05.417551  1526 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:05.374742  1610 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:05.305941  5777 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:05.420302  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54305.8us
I20260709 13:03:05.356664  5778 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.400270  1609 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:05.359584  1608 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:05.430711  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.431452  1608 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.345556  5691 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:05.297217  5601 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:05.352828  5775 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:05.422956  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:05.382957  5715 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.407764  5728 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.443924  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.418844  5494 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.427860  5453 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:05.440835  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.419530  5752 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.436301  5706 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.444805  1609 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:05.455015  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 185) took 2384 ms. Trace:
I20260709 13:03:05.427127  5665 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.301409  5522 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.429896  5483 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.453598  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.507181  1683 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.452447  1680 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:05.455535  1530 rpcz_store.cc:276] 0709 13:03:03.062933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.063100 (+   167us) service_pool.cc:224] Handling call
0709 13:03:03.091557 (+ 28457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.945458 (+853901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.447152 (+1501694us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54000de654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.447349 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749978880}
I20260709 13:03:05.456203  1534 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:05.406138  5723 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.433480  5691 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:05.471258  5752 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.471603  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:05.472587  5783 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:05.447103  5750 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:05.435281  5778 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.471309  5706 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.478044  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2060) took 1347 ms. Trace:
I20260709 13:03:05.480059  5665 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:05.483296  5753 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.431s	user 0.010s	sys 0.013s
I20260709 13:03:05.539603  5778 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.540350  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.541569  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.542127  1609 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:05.543232  5750 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.488655  5776 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.544302  5776 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.545871  5752 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:05.489604  5732 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.187s	user 0.011s	sys 0.000s
I20260709 13:03:05.450865  5239 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:03:05.491578  5721 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.186s	user 0.011s	sys 0.000s
I20260709 13:03:05.547717  5721 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.513756  5691 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.441704  5740 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.436154  5601 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.489626  5664 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:05.467787  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.550416  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.549758  5601 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.551362  5601 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.445776  5733 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.506445  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.552436  1610 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:05.552850  5733 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.553210  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1854) took 2034 ms. Trace:
I20260709 13:03:05.552431  1683 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:05.553601  1533 rpcz_store.cc:276] 0709 13:03:03.519275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.526341 (+  7066us) service_pool.cc:224] Handling call
0709 13:03:03.526613 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.542891 (+ 16278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.542929 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.543481 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.795823 (+252342us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.141223 (+345400us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.145613 (+  4390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.145739 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.482599 (+1336860us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:05.546441 (+ 63842us) raft_consensus.cc:1685] finished
0709 13:03:05.553041 (+  6600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.553158 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38146,"prepare.queue_time_us":383963,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4194,"raft.queue_time_us":162617,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":24662,"spinlock_wait_cycles":49235712,"thread_start_us":569225,"threads_started":2,"wal-append.queue_time_us":388830}
I20260709 13:03:05.555371  5719 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:05.555851  5719 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.556190  5695 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:05.556850  5695 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.511976  1679 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:03:05.559733  1679 pending_rounds.cc:85] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 7
I20260709 13:03:05.560082  1679 pending_rounds.cc:107] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:03:05.560371  1679 raft_consensus.cc:2889] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.560853  5472 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:05.422516  5777 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.561355  5472 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.563633  5777 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.516678  5679 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.497720  5738 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.513458  5730 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:05.532213  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.593480  1676 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.447394  5515 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:03:05.537837  5723 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.538736  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2052) took 1459 ms. Trace:
I20260709 13:03:05.546885  5732 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.502588  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1867) took 1979 ms. Trace:
I20260709 13:03:05.513669  5386 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.564441  5715 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:05.515602  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:05.569185  5721 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.544327  5750 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.586964  1604 rpcz_store.cc:276] 0709 13:03:04.130355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.739144 (+608789us) service_pool.cc:224] Handling call
0709 13:03:04.739513 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.957033 (+217520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.477810 (+520777us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400086454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.477976 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494573824}
I20260709 13:03:05.609369  1528 rpcz_store.cc:276] 0709 13:03:03.522699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.068068 (+545369us) service_pool.cc:224] Handling call
0709 13:03:04.102232 (+ 34164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.269032 (+166800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.269078 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.288535 (+ 19457us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.751495 (+462960us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:04.751784 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.751973 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.752065 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.502301 (+750236us) raft_consensus.cc:1685] finished
0709 13:03:05.502329 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.502515 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4029,"prepare.queue_time_us":5579,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":55027,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":12393,"thread_start_us":549917,"threads_started":2,"wal-append.queue_time_us":657883}
I20260709 13:03:05.599895  1682 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:03:05.614482  1682 pending_rounds.cc:85] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 8
I20260709 13:03:05.614791  1682 pending_rounds.cc:107] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:05.615028  1682 raft_consensus.cc:2889] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:05.601388  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 307290us
I20260709 13:03:05.592577  5776 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.599124  1681 rpcz_store.cc:276] 0709 13:03:04.079481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.079733 (+   252us) service_pool.cc:224] Handling call
0709 13:03:04.080181 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.217847 (+137666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.217878 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.236018 (+ 18140us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.911504 (+675486us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.911562 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.538350 (+626788us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400034654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.538396 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.538443 (+    47us) raft_consensus.cc:1685] finished
0709 13:03:05.538462 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.538668 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6078,"raft.queue_time_us":22415,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":20671,"spinlock_wait_cycles":301414144,"thread_start_us":605194,"threads_started":1,"wal-append.queue_time_us":995710}
I20260709 13:03:05.610235  1676 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:05.593500  1608 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:05.624329  5756 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.627259  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.629611  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.637212  1574 leader_election.cc:400] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:05.644876  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.596376  5730 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:05.575920  5691 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.594159  5679 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:05.642747  5555 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:05.669088  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.676049  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:05.652115  5722 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:05.614104  5715 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:05.700418  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2050) took 1573 ms (client timeout 1506 ms). Trace:
W20260709 13:03:05.700922  1602 rpcz_store.cc:269] 0709 13:03:04.127347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.130759 (+  3412us) service_pool.cc:224] Handling call
0709 13:03:05.668892 (+1538133us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54e9c 00007f4694f54a5b 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:03:05.700339 (+ 31447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4690816}
I20260709 13:03:05.692898  5515 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.696017  5720 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:05.666074  5672 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.752518  5453 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.757819  5695 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.653816  5756 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:05.698551  5598 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:03:05.702896  5722 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:05.772758  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 157169us
I20260709 13:03:05.781667  1605 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:05.782660  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 122647us
W20260709 13:03:05.784616  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.786002  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.775189  5515 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.790480  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:05.792452  2212 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.792869  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.794183  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.795249  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.799808  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.787806  5799 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:05.801344  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.791339  5522 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.774569  5720 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.822882  2212 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:05.797953  5744 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:05.801191  5742 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:05.840797  5730 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:05.842114  5781 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:03:05.808429  5614 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:05.846385  5719 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:05.849196  5776 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.821805  5598 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:05.813035  5799 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.851126  5744 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.854790  5522 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.850932  5732 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.851966  5742 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.853401  5749 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:05.862514  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7575947609999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:03:05.853945  5672 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.855203  5665 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:05.875941  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5298947609999232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:03:05.889873  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2059) took 1759 ms. Trace:
I20260709 13:03:05.890260  1606 rpcz_store.cc:276] 0709 13:03:04.130080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.286749 (+156669us) service_pool.cc:224] Handling call
0709 13:03:04.287046 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.719968 (+432922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.889614 (+1169646us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b5400087354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:05.889809 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116756224}
I20260709 13:03:05.890960  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:05.862491  5776 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:05.865877  5598 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.871503  5744 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:05.894140  5754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.661s	user 0.011s	sys 0.017s
W20260709 13:03:05.894624  5754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.672s	user 0.011s	sys 0.017s
I20260709 13:03:05.893442  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:05.815214  5453 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.854504  5722 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.898550  5749 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.899530  5749 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.887730  5742 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.906713  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 203) took 1157 ms. Trace:
I20260709 13:03:05.870939  5522 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.892469  5776 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.907230  1678 rpcz_store.cc:276] 0709 13:03:04.749206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.749570 (+   364us) service_pool.cc:224] Handling call
0709 13:03:04.749921 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.750302 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.750330 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.755753 (+  5423us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.222453 (+466700us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:05.222510 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.222576 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.841566 (+618990us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:05.905815 (+ 64249us) raft_consensus.cc:1685] finished
0709 13:03:05.905837 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.906646 (+   809us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1135,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":73213824,"thread_start_us":466418,"threads_started":1,"wal-append.queue_time_us":702442}
I20260709 13:03:05.906032  5665 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.915258  5239 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:05.918150  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:05.886094  5679 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:05.865167  5614 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:05.906350  5598 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.907366  5790 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:05.940819  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 115689us
I20260709 13:03:05.919910  5522 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.950369  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.931051  5733 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:05.953590  1608 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.957337  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.957942  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.920403  5239 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:05.867094  5515 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:05.954192  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:03:05.962934  1606 raft_consensus.cc:606] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:05.963411  1606 raft_consensus.cc:614] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:05.966094  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.929708  5809 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:05.971254  1601 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:05.972219  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.974910  1604 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:05.969515  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.973500  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.975539  1603 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:05.975715  1605 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:05.972792  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.976763  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.977540  1607 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:05.975765  1609 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:05.945055  5806 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.982492  1608 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:05.968019  5672 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:05.983377  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:05.987923  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:05.985780  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:05.996927  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:06.000442  5782 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.565s	user 0.000s	sys 0.002s
I20260709 13:03:06.010314  1610 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.978750  5733 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.018705  1676 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:05.981304  5756 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.019716  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:05.984409  5665 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.030752  1681 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.020650  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.022083  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.031841  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:06.032066  1676 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.023150  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.025148  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.029248  1679 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.029248  1677 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.022296  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.034245  1682 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.035238  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.037245  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.038256  1610 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:06.040067  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.041026  1607 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:05.996361  5672 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:05.978565  5743 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:03:06.067428  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.004398  5601 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:03:05.935298  5799 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.018963  5239 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.054581  5733 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.088455  5672 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.090852  1681 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.068251  1679 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.095517  5696 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.096151  5696 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.096892  5715 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.098978  5472 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.099063  5751 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.099553  5751 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.100512  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:06.100412  5751 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.101171  2212 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:03:05.994163  5806 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.102622  5614 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.103163  5740 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:06.103487  5806 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.105077  5706 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.107594  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.075526  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.070399  1682 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.087157  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:06.087615  5793 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:06.109181  1608 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:06.114691  1574 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.112368  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.116496  1605 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 5.
I20260709 13:03:06.117303  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:06.098327  5696 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:06.076634  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 104160us
I20260709 13:03:06.122778  5672 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.143455  5672 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.142598  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.144021  5672 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:06.148597  5816 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:06.157626  5744 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.160986  5805 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:06.161304  5755 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:06.161616  5751 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.162364  5755 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.162721  5755 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:06.142189  5786 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.164285  5794 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.164716  5723 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:06.164852  5794 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.165175  5722 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.165290  5723 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.165709  5722 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.166078  5795 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:06.166702  5795 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.166793  5722 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.167469  5794 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.168021  5722 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.168385  5768 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.169610  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:06.170473  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.186851  1534 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:06.186976  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5396b1c71261414f9ca554acc690f489"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:06.188047  1528 raft_consensus.cc:606] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:06.188401  1528 raft_consensus.cc:614] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:06.161751  5749 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:06.163532  5755 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.168016  5794 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.190718  5755 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.190620  5794 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.190925  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.191529  1535 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.192695  5794 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.159911  5744 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.103585  5740 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.121857  5790 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.094158  5665 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.196374  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.196623  1526 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.197130  1531 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:06.197567  5814 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:03:06.198199  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1873) took 1325 ms. Trace:
I20260709 13:03:06.199082  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1874) took 1324 ms. Trace:
I20260709 13:03:06.199185  5720 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.199520  1532 rpcz_store.cc:276] 0709 13:03:04.874430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.339513 (+465083us) service_pool.cc:224] Handling call
0709 13:03:05.339972 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.355074 (+ 15102us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:05.586836 (+231762us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.198752 (+611916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.198807 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:06.198858 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.198923 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.199030 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423456,"prepare.queue_time_us":337223,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":373240,"threads_started":2,"wal-append.queue_time_us":215252}
I20260709 13:03:06.196295  5665 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.203320  1530 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.198607  1529 rpcz_store.cc:276] 0709 13:03:04.874140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.316873 (+442733us) service_pool.cc:224] Handling call
0709 13:03:05.322573 (+  5700us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:03:05.434665 (+112092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.434695 (+    30us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:03:05.439274 (+  4579us) log.cc:844] Serialized 104 byte log entry
0709 13:03:05.755287 (+316013us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.755612 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.197105 (+441493us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.197479 (+   374us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.197739 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.197892 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.197962 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.198004 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:06.198016 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.198143 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445492,"prepare.queue_time_us":21452,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":467030,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":4688,"thread_start_us":262920,"threads_started":1,"wal-append.queue_time_us":302470}
I20260709 13:03:06.209038  1535 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:06.211917  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.212677  1529 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:06.213910  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70109.1us
I20260709 13:03:06.214074  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.215390  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.216009  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:06.217207  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.217510  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.218721  1532 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:06.218061  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 112148us
I20260709 13:03:06.220085  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.220506  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.220106  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.222289  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.155580  5598 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.222397  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.223613  1679 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:06.223994  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.224363  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.224638  1532 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.225226  1681 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:06.228058  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.167513  5723 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.226868  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.235407  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.236099  1529 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:06.231871  1675 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.234018  1534 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:06.237167  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:06.238369  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.238561  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:06.231420  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.237198  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.239194  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:06.248713  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.195621  5790 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.222605  5752 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.262743  1678 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:06.253595  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.224535  5794 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:06.255983  1529 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:06.168869  5768 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.262123  5777 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.261821  5743 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:03:06.256867  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.266603  5777 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.267143  5777 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:06.268000  5777 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.269240  5665 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.252281  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.164747  5786 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.225267  5493 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.271395  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:06.271905  1535 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:06.270077  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1869) took 1397 ms. Trace:
I20260709 13:03:06.277887  1534 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:06.273605  1527 rpcz_store.cc:276] 0709 13:03:04.872270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.286783 (+414513us) service_pool.cc:224] Handling call
0709 13:03:05.303364 (+ 16581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.303691 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.303719 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.311676 (+  7957us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.628270 (+316594us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:05.788504 (+160234us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.939820 (+151316us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b18001d38c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:06.168218 (+228398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.168301 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.269785 (+101484us) raft_consensus.cc:1685] finished
0709 13:03:06.269884 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.270024 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393707,"prepare.queue_time_us":113841,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":379765,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":2327936,"thread_start_us":334690,"threads_started":2,"wal-append.queue_time_us":374551}
W20260709 13:03:06.278738  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 333647us
I20260709 13:03:06.280282  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.247507  5691 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.281198  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.254643  5723 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.291028  5789 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:03:06.291783  5598 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.292241  5789 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.292150  5522 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.292718  5789 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:06.293573  5789 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.294373  5522 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.294812  5789 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.296103  5493 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.296535  5493 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.296895  5493 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.297840  5786 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.272976  5483 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:03:06.284348  5790 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.280268  5720 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:06.299398  5720 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.299773  5720 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.281996  5386 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:06.301110  5386 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.301486  5386 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:06.302318  5386 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.288416  5723 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.303550  5386 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.304313  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.308297  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:06.247623  5730 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:03:06.283351  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.272717  5787 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.314224  5811 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:06.304559  5795 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.337204  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.338006  1534 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.338794  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.304366  5723 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.340448  5799 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.315608  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.343216  1535 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.344225  1532 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:06.290036  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:06.277361  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.358543  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69156.6us
I20260709 13:03:06.360499  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.315354  5493 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.315941  5239 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.316323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.273190  5794 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.317451  5768 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.319396  5665 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.322078  5672 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.280982  5822 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:03:06.281816  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.323930  1527 raft_consensus.cc:606] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:06.254309  5776 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.326483  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:06.328393  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:06.330798  5811 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.334872  5790 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.335762  5740 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.272531  5742 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.328224  5668 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:06.362476  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.371062  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:06.371592  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81640.7us
I20260709 13:03:06.380082  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:06.382805  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.386754  1534 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.600871  1529 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.382483  5813 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:06.569670  2175 leader_election.cc:336] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.723s (SENT)
I20260709 13:03:06.606333  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.598500  1527 raft_consensus.cc:614] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:06.598301  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 316538us
I20260709 13:03:06.558653  2212 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:06.613214  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.613790  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.614790  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.615552  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.616724  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:06.616899  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.616741  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.617484  1607 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:06.439841  1532 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:06.602423  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 240018us
I20260709 13:03:06.480635  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.638247  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.638593  1529 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
W20260709 13:03:06.603549  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 277124us
I20260709 13:03:06.640547  1605 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.641463  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.641959  1605 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.643188  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.599041  5790 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.618741  1606 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:06.603000  5665 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.619374  5752 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.620018  5721 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.620151  5787 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.617973  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.453882  5794 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.620909  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.614894  5755 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.660876  1526 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:06.448201  1418 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3ab72f324d545a6b4ecb1025df1f7c0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:06.464602  1530 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:06.629172  5822 consensus_queue.cc:1243] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:06.662467  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.382658  5706 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:06.444645  5815 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 13:03:06.623612  5720 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:06.672848  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.673653  1601 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:06.600004  5795 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:06.635190  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.637275  1608 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:06.637748  1610 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:06.638651  1528 raft_consensus.cc:2376] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11. Re-sending same reply.
I20260709 13:03:06.676204  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.598083  1535 raft_consensus.cc:2376] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14. Re-sending same reply.
I20260709 13:03:06.643950  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.677317  1532 raft_consensus.cc:2368] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:06.677431  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.678093  1535 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:06.653944  5786 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.386706  5722 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.645035  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.653286  5820 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:03:06.700107  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55152.8us
I20260709 13:03:06.653925  5614 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:03:06.701045  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.702131  5672 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.702612  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.646699  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.648936  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.650755  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.606844  5483 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.652792  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.621388  5776 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.613926  5730 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.659808  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.704429  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:03:06.706244  5751 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.004s
I20260709 13:03:06.708845  5730 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:06.709461  5730 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:06.658895  5752 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.712600  1606 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.713878  5752 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:06.714596  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.715484  5720 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:06.716288  1603 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.662675  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.718618  1530 raft_consensus.cc:2368] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:06.719588  5706 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.719640  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.720203  5706 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.720785  1530 raft_consensus.cc:2368] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:03:06.721930  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.722958  1530 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:06.623858  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.724084  1607 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.664695  1534 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:06.724570  1607 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.725325  1607 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.726388  1607 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.726871  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.665557  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.629565  5813 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.728343  1529 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:03:06.728736  5813 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.729249  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:06.729580  5826 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:06.730297  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.667197  1527 raft_consensus.cc:2368] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:06.730823  1529 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.731379  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.732071  1527 raft_consensus.cc:2368] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:06.732981  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.733819  1527 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:06.734730  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.735627  1527 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.645643  5768 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.653841  5310 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.738662  5310 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.682026  1605 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:06.741516  5790 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.655524  5787 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.628633  5749 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:06.687158  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.687289  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:06.747201  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 98315.3us
I20260709 13:03:06.747838  1532 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
I20260709 13:03:06.629117  5522 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:06.761677  5522 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.762117  5522 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.763098  5522 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.764869  5749 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.765378  5749 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:06.766357  5749 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.768180  5787 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.750679  5722 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.770505  5722 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.774259  5794 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.776662  5493 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.777410  5493 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:06.780509  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 78007.2us
W20260709 13:03:06.684012  1418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 236084us
I20260709 13:03:06.692894  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.782164  1526 raft_consensus.cc:2368] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:06.782330  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.783478  1532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9463f88e50794193abace66439f1975b"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:06.784190  1532 raft_consensus.cc:606] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.784564  1532 raft_consensus.cc:614] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:06.723873  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.767717  5749 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.782702  5810 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.797605  5768 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:06.798383  5810 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.799314  5768 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.782032  5790 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.800829  5810 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.782624  5733 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.802358  5733 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.804553  5733 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:06.805994  5789 consensus_meta.cc:287] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 13:03:06.750012  5723 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.808445  5723 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.809258  1528 raft_consensus.cc:2368] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:06.809090  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.810006  5723 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.811583  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.747272  1535 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.752151  5239 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.752336  5776 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:06.752807  5310 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:06.752748  5720 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:06.753484  5601 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.753860  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.752184  5751 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:03:06.756438  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.728504  1430 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:06.756295  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109680us
I20260709 13:03:06.757448  5614 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.757965  5672 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.758402  5483 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.789824  1680 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.743161  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.782496  5822 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.839269  5614 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.839042  5822 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.839601  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.815975  5691 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.841112  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.843974  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.844547  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.844799  1678 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:06.845526  1605 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:06.846169  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.846966  1681 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:06.811465  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.813310  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.634141  5740 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.848501  1682 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:06.849766  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.815111  1603 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:06.816063  1606 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:06.817761  1529 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:06.826749  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.852555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.664165  5811 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.828949  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.859768  1676 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.861235  1534 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.862715  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.863080  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.863072  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.815726  5668 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.876379  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.876557  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.877028  1679 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.877663  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.878830  1574 leader_election.cc:400] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:06.879156  1574 leader_election.cc:403] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:06.840452   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:03:06.879474  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.816229  5723 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:06.864218  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.865614  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.886360  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.887465  1605 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:06.887593  1610 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:06.888602  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:06.867636  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.820201  5522 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.865936  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.864979  1430 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:06.877249  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:06.882081  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:06.882985  1675 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.823396  5794 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:06.839612  5832 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:06.892475  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:06.893121  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.900362  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:06.900676  1605 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:06.836725  1535 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:06.700197  5665 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.904161  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.911321  1610 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:06.837718  5672 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:06.840361  5614 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.913359  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.913661  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.913841  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.914173  1535 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:06.914919  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.913446  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.888764  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.916110  1602 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:06.865993  5310 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:06.902105  5810 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:06.876211  5691 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.901471   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:06.914930  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.881258  5721 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:06.929800  1601 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:06.912120  1574 leader_election.cc:400] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:06.828644  5601 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.916893  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.938623  1608 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:03:06.939493  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:06.940017  1608 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:06.899282  5833 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:03:06.875480  5795 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.875727  5752 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:06.916421  5820 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:06.922943  5794 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.996745  1678 raft_consensus.cc:2410] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:06.928285  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:06.930572  1574 leader_election.cc:403] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:06.909273  1527 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.907351  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.998418  1526 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.930886  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:06.999464  1535 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.936518  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:06.864853  5786 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:03:06.903339  5789 raft_consensus.cc:2764] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:03:06.910671  5659 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.915771  5733 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:06.979157  1534 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:06.922667  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.992962  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:06.922524  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:06.994844  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.014017  1529 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:06.905149  5723 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:06.928920  5742 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:06.993970  5665 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.016597  1610 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 9: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:07.004717  1607 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:07.001132  1430 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 9 to 10, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.992653  5820 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:07.006798  1608 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
W20260709 13:03:07.008282  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96439.5us
I20260709 13:03:07.011210  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:07.021235  1529 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.007079  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:07.034340  1574 leader_election.cc:400] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:03:07.034812  1574 leader_election.cc:403] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.012547  5733 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.037428  1532 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
W20260709 13:03:07.027429  5743 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:07.020972  5239 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.060488  1528 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:03:07.051529  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.027614  5820 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.063098  1430 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 8 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.075886  1601 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:07.042527  5733 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.083866  1535 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:07.006233  5483 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.063426  5668 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:07.062757  5386 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:07.041673  5730 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:07.154440  1430 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 11 to 12, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:07.158430  1535 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.068142  5239 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.091928  5822 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:07.190719  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.230319  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 480123us
I20260709 13:03:07.200400  1422 maintenance_manager.cc:419] P 0d9f4d25497a4ade8ff13a53360853c8: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033338
I20260709 13:03:07.231877  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.163039  5386 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.150171  5668 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.252902  5799 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.249383  1430 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 11, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 11 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:07.260998  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.264951  1531 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:07.271703  1532 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.275324  1531 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:07.247141  5601 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:07.275378  1532 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.279632  5730 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:07.281425  5706 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.001s
I20260709 13:03:07.281862  5706 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.285347  5668 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.285943  5799 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.287774  5386 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.289326  5723 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.289849  1430 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:03:07.291864  5787 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:03:07.292496  5787 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.294751  5787 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.294858  5239 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:07.291821  5706 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.276685  5672 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.297528  5672 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.305465  1527 raft_consensus.cc:1240] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:07.308444  1530 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.314689  5799 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:07.248801  5822 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:07.325857  1526 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 9.
W20260709 13:03:07.327065  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66185.6us
W20260709 13:03:07.333021  1609 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.066s	sys 0.103s
W20260709 13:03:07.333590  1609 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.066s	sys 0.103s
I20260709 13:03:07.359046  1535 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:03:07.329238  5809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.008s	sys 0.014s
W20260709 13:03:07.412709  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.037s
W20260709 13:03:07.369441  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.413261  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.017s	sys 0.037s
W20260709 13:03:07.415151  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52771.5us
W20260709 13:03:07.399468  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 167674us
I20260709 13:03:07.330816  5822 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:07.436273  1681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.062s	sys 0.123s
I20260709 13:03:07.464349  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:07.507921  1681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.065s	sys 0.142s
I20260709 13:03:07.357359  5722 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.417696  5809 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
W20260709 13:03:07.508666  5740 consensus_meta.cc:287] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:03:07.508935  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:07.414835  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 538313us
W20260709 13:03:07.556946  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.019s
I20260709 13:03:07.566804  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:07.567543  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.022s	sys 0.021s
W20260709 13:03:07.422677  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.569656  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:07.570380  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:07.447847  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1909) took 1120 ms. Trace:
W20260709 13:03:07.363680  5813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.016s
I20260709 13:03:07.447923  1528 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 16. Ops: []
W20260709 13:03:07.516695  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.560719  5614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.012s
I20260709 13:03:07.417698  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.440904  1608 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:07.509395  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:07.435603  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.045s
W20260709 13:03:07.582620  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 164987us
I20260709 13:03:07.579304  5809 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.574127  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.571197  1607 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:07.578696  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.012s
I20260709 13:03:07.509444  5659 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.575379  5789 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.596673  5839 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:07.598137  5839 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:07.598608  5839 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:07.586663  5838 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.601411  5749 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:07.602353  5749 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:07.588562  5720 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.604305  5720 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:07.604856  5720 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.611200  5844 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.510358  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1913) took 1122 ms. Trace:
W20260709 13:03:07.582814  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.014s	sys 0.054s
W20260709 13:03:07.613806  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 710291us
I20260709 13:03:07.573949  1604 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:07.613587  1529 rpcz_store.cc:276] 0709 13:03:06.387667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.036673 (+649006us) service_pool.cc:224] Handling call
0709 13:03:07.065050 (+ 28377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.292120 (+227070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.292154 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.292201 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:07.292241 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.510117 (+217876us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000a37d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:07.510162 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.510285 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521607552}
I20260709 13:03:07.584224  5809 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:07.585796  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76533.6us
W20260709 13:03:07.570779  5721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.007s
W20260709 13:03:07.586815  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.010s	sys 0.012s
I20260709 13:03:07.467020  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:07.416858  5805 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:07.579641  5813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.013s	sys 0.025s
I20260709 13:03:07.564945  5722 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.591714  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.624797  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.571843  1530 rpcz_store.cc:276] 0709 13:03:06.327796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.030650 (+702854us) service_pool.cc:224] Handling call
0709 13:03:07.045812 (+ 15162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.308945 (+263133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.447525 (+138580us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002c01d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:07.447776 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603503488}
I20260709 13:03:07.592806  5847 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:07.594260  1418 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3ab72f324d545a6b4ecb1025df1f7c0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:07.594653  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.631867  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.633021  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:07.585915  5614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.007s	sys 0.012s
I20260709 13:03:07.578096  5740 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 10. Current term is 11.
I20260709 13:03:07.435148  5522 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:03:07.620500  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.620500  1601 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.569398  5733 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.665172  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2103) took 1015 ms. Trace:
I20260709 13:03:07.665637  1604 rpcz_store.cc:276] 0709 13:03:06.650282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.706293 (+ 56011us) service_pool.cc:224] Handling call
0709 13:03:06.706652 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.614767 (+908115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.664878 (+ 50111us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540024b3d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:07.665109 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993742080}
I20260709 13:03:07.630589  5789 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.611826  5844 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:07.636122  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.013s	sys 0.015s
W20260709 13:03:07.677605  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.013s	sys 0.015s
W20260709 13:03:07.640122  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.019s
W20260709 13:03:07.678802  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.012s	sys 0.019s
W20260709 13:03:07.652367  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.653844  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:07.679922  1610 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:07.654932  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:07.655885  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:07.681890  1608 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:07.629937  5691 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:07.691366  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70879.1us
I20260709 13:03:07.657332  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.630934  5722 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:07.621601  5721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.012s	sys 0.007s
W20260709 13:03:07.676659  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.639643  5749 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:07.640064  5838 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.654058  5768 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.639919  5840 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:07.705716  1602 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:03:07.708194  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.715773  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:07.719336  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.729533  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.644019  5744 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:03:07.729532  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:07.631187  5310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.020s
I20260709 13:03:07.599699  5839 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:07.706100  5811 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.701825  5239 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.695214  5751 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.740665  1604 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:07.708159  5721 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:07.748828  5310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.003s	sys 0.021s
W20260709 13:03:07.727435  5795 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.020s	sys 0.021s
I20260709 13:03:07.752914  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:07.779285  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 122032us
W20260709 13:03:07.747342  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.020s	sys 0.031s
I20260709 13:03:07.701175  5755 consensus_queue.cc:1059] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:07.740131  5838 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:07.754156  5706 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.742440  5749 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:07.727519  5691 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:03:07.756968  5841 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:03:07.729947  5787 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:03:07.789834  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.806388  1601 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:03:07.813026  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60190.3us
I20260709 13:03:07.821609  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:07.786070  5795 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.020s	sys 0.022s
W20260709 13:03:07.795012  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.020s	sys 0.031s
I20260709 13:03:07.785004  5310 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:07.824517  1601 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:07.825634  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.872867  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 838593us
I20260709 13:03:07.788056  5239 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:07.877995  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:07.795500  5723 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.797551  5706 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:07.802651  5839 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:07.827907  5843 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
W20260709 13:03:07.883739  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.044s	sys 0.098s
I20260709 13:03:07.791329  5854 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:07.901446  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 111727us
I20260709 13:03:07.876055  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1732) took 1025 ms. Trace:
I20260709 13:03:07.821743  5777 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:07.788729  5751 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:07.932279  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 238456us
W20260709 13:03:07.897787  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.045s	sys 0.098s
I20260709 13:03:07.917951  1681 rpcz_store.cc:276] 0709 13:03:06.850840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.873841 (+ 23001us) service_pool.cc:224] Handling call
0709 13:03:06.874278 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.874552 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:07.508471 (+633919us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.875547 (+367076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.875623 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:07.875697 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.875793 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.875960 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634450,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4754,"raft.queue_time_us":71119,"thread_start_us":945768,"threads_started":2}
I20260709 13:03:07.920210  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:07.883994  5555 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:07.827129  5822 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.897065  5706 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.882212  1604 pending_rounds.cc:85] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 6
W20260709 13:03:07.937512  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 315402us
I20260709 13:03:07.964522  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.965881  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:07.899605  5743 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.968554  5743 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:07.969624  5743 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:07.940711  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119203us
I20260709 13:03:07.941190  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2094) took 1302 ms. Trace:
I20260709 13:03:07.980537  1609 rpcz_store.cc:276] 0709 13:03:06.638342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.639384 (+  1042us) service_pool.cc:224] Handling call
0709 13:03:06.658379 (+ 18995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.658573 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:07.334053 (+675480us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.940821 (+606768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.940877 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:07.940922 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.940995 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.941130 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5843,"prepare.queue_time_us":39135,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"raft.queue_time_us":6722,"thread_start_us":1261871,"threads_started":2}
I20260709 13:03:07.970175  5743 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:07.989001  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:07.942997  1574 leader_election.cc:400] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:07.990970  1574 leader_election.cc:403] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.958890  5733 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:07.992048  5733 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.992503  5733 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.992924  5733 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:07.950512  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 242426us
I20260709 13:03:07.998327  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.000851  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:08.002717  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59834.2us
I20260709 13:03:08.003777  1574 leader_election.cc:400] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:08.004168  1574 leader_election.cc:403] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.005478  1574 leader_election.cc:400] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:08.005805  1574 leader_election.cc:403] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.007486  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.016479  5743 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.027148  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:08.027961  1607 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.029014  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.032197  1609 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.032666  1608 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:08.033417  1609 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.034736  1604 pending_rounds.cc:107] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:08.035041  1604 raft_consensus.cc:2889] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:08.027148  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.037951  1607 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:08.040582  5733 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:07.963111  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.914474  5723 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:08.048884  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50640.2us
I20260709 13:03:08.053695  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:07.916481  5809 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.058151  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.066764  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.067922  1678 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:08.045409  5789 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:08.045668  5822 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.053416  5691 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.092927  5787 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.093101  5789 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:08.093779  5787 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.094560  5789 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.098275  5787 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.057497  5777 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:08.084499  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.069999  5601 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.105827  1678 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:07.912855  5721 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:07.935405  5749 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.077270  5867 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:08.120062  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.076205  5742 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:08.079389  5809 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:08.074868  5846 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:08.055299  5856 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:03:08.131032  5776 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.131544  5851 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:03:08.132787  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2041) took 1246 ms. Trace:
I20260709 13:03:08.133139  1606 rpcz_store.cc:276] 0709 13:03:06.886346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.903615 (+ 17269us) service_pool.cc:224] Handling call
0709 13:03:06.904087 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.904376 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.904410 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.904956 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.433971 (+529015us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:07.434030 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.434126 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.132590 (+698464us) raft_consensus.cc:1685] finished
0709 13:03:08.132614 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.132733 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":453206,"threads_started":1,"wal-append.queue_time_us":788280}
I20260709 13:03:08.123040   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.946452  5838 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.105048  5744 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.125445  5855 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 13:03:08.126127  5859 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:03:08.126924  5672 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.002s
I20260709 13:03:08.105932  5840 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:08.158259  5871 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.158560  5840 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.158958  5871 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.162796  5722 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:08.166003  5863 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
W20260709 13:03:08.130451  5665 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.104s	user 0.003s	sys 0.007s
I20260709 13:03:08.136523  5813 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:08.137127  5751 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.076647  5239 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.131596  5776 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.142963  5744 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.113124  5601 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:08.157279  5659 raft_consensus.cc:3055] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:08.121847  5755 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:08.166222  5871 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.146098  5742 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:08.212426  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.213222  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.169327  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2047) took 1260 ms. Trace:
I20260709 13:03:08.214092  1602 rpcz_store.cc:276] 0709 13:03:06.908707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.916781 (+  8074us) service_pool.cc:224] Handling call
0709 13:03:06.941024 (+ 24243us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:07.739501 (+798477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.169080 (+429579us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400247f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:08.169269 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757724544}
I20260709 13:03:08.170331  5555 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:08.170745  5722 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.175153  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:08.207831  5820 consensus_meta.cc:287] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.124s	user 0.006s	sys 0.006s
W20260709 13:03:08.140259  5850 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:03:08.118261  5844 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.119987  5867 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:08.184424  1606 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:03:08.234838  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.235555  1606 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:08.072474  5310 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.186007  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:08.111824  5787 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.187781  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:08.192833  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.247710  1610 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:08.082139  5805 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:03:08.200268  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:08.250197  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 50058.4us
I20260709 13:03:08.250362  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1908) took 1923 ms. Trace:
I20260709 13:03:08.250744  1534 rpcz_store.cc:276] 0709 13:03:06.327458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.021590 (+694132us) service_pool.cc:224] Handling call
0709 13:03:07.021882 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.022082 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.022107 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.022560 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.620055 (+597495us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:07.963927 (+343872us) log.cc:844] Serialized 14 byte log entry
0709 13:03:08.054808 (+ 90881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.054896 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.250160 (+195264us) raft_consensus.cc:1685] finished
0709 13:03:08.250179 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.250299 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106847,"prepare.queue_time_us":328306,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":94170,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11386,"thread_start_us":876224,"threads_started":2,"wal-append.queue_time_us":766027}
I20260709 13:03:08.201617  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.203596  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:08.194010  5720 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.005s
W20260709 13:03:08.205497  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 200189us
I20260709 13:03:08.268319  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.210734  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.269407  1675 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:08.270977  1676 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.215312  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:08.225018  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49946.4us
I20260709 13:03:08.178119  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.272488  1530 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 15.
I20260709 13:03:08.227707  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.274062  1683 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:08.209632  5598 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:08.233111  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.209368  5601 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.237056  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.238158  1607 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:08.276686  2210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41274 (request call id 144) took 1354 ms. Trace:
I20260709 13:03:08.238536  1608 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:08.209144  5659 raft_consensus.cc:740] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:08.244732  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.254745  5867 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.255973  5795 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:08.257000  5789 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:08.258311  5776 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.258186  5856 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:08.226994  5555 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.259503  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:08.332988  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73587.7us
I20260709 13:03:08.262389  5742 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.207019  5777 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.276733  1677 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:08.278563  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:08.283973  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2044) took 1379 ms. Trace:
I20260709 13:03:08.232084  5820 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.306098  5706 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.307478  5867 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.309010  5744 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.285482  5768 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:08.275810  5598 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:08.310554  5811 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:03:08.249329  5873 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:08.317246  5881 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.316744  5659 consensus_queue.cc:260] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.275902  5720 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.287408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.277170  2210 rpcz_store.cc:276] 0709 13:03:06.911795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.911942 (+   147us) service_pool.cc:224] Handling call
0709 13:03:06.928324 (+ 16382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.928671 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.928701 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.929135 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.304080 (+374945us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b180006be00. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:03:07.704478 (+400398us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:07.704532 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.704618 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.165489 (+460871us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:08.266099 (+100610us) raft_consensus.cc:1685] finished
0709 13:03:08.266123 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.266255 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":965,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":43465,"spinlock_wait_cycles":21805696,"thread_start_us":400201,"threads_started":1,"wal-append.queue_time_us":987687}
I20260709 13:03:08.321624  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.322257  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.370666  5848 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:08.325156  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.030s	sys 0.064s
W20260709 13:03:08.267416  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 301602us
I20260709 13:03:08.223737  5755 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.337438  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:08.327450  5790 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.526s	user 0.008s	sys 0.007s
I20260709 13:03:08.338570  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:08.417701  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 79244.1us
W20260709 13:03:08.343111  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71059.3us
I20260709 13:03:08.268086  5787 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.342983  1605 rpcz_store.cc:276] 0709 13:03:06.904893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.905624 (+   731us) service_pool.cc:224] Handling call
0709 13:03:06.905951 (+   327us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:06.910256 (+  4305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.910284 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:06.910878 (+   594us) log.cc:844] Serialized 78 byte log entry
0709 13:03:07.460866 (+549988us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:07.526653 (+ 65787us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.543139 (+ 16486us) log.cc:844] Serialized 14 byte log entry
0709 13:03:07.825056 (+281917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.825151 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.189706 (+364555us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18003ccee0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:08.283676 (+ 93970us) raft_consensus.cc:1685] finished
0709 13:03:08.283708 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.283898 (+   190us) inbound_call.cc:177] Queueing success response
0709 13:03:08.316626 (+ 32728us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18003ccee0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
Metrics: {"mutex_wait_us":19824,"prepare.queue_time_us":787551,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":21726,"raft.queue_time_us":471474,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":12587,"spinlock_wait_cycles":8622336,"thread_start_us":758691,"threads_started":2,"wal-append.queue_time_us":772627}
I20260709 13:03:08.350095  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.366179  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:03:08.419574  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53524.3us
I20260709 13:03:08.371160  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.375566  1533 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:08.397854  1676 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:08.357419  5668 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:08.404074  1682 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 9.
I20260709 13:03:08.373143  5776 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.292946  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.413764  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.416445  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:08.370474  5723 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:08.427599  1681 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.421420  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:08.429981  1677 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.433568  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.436992  1531 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:08.423081  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73104.3us
I20260709 13:03:08.444499  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:08.444630  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 151815us
I20260709 13:03:08.431511  5659 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.428449  5873 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.457710  1574 leader_election.cc:400] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:08.462462  1574 leader_election.cc:403] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.427044  5768 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.431200  5854 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.462908  1679 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:08.429634  5882 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:08.438023  5522 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.483145  5522 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.439181  5776 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.458859  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:08.486255  5706 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.487284  5805 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:08.487888  5805 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:08.488075  5840 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:08.488776  5787 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.438530  5598 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.493023  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.493409  5733 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:08.493995  5838 consensus_queue.cc:1175] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 16 status { last_received { term: 14 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.8-15.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:08.494517  1574 leader_election.cc:400] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:08.494391  5733 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.468293  5882 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.495643  5882 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.496649  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:08.454715  5790 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.467483  5849 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:08.502640  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.463973  5668 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:08.477799  5755 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.480847  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.446022  5740 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:08.419837  5848 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:08.481349  5839 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.582s	user 0.002s	sys 0.007s
I20260709 13:03:08.481089  5720 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.465763  5873 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.488808  5805 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.470445  5844 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:08.474478  5884 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:03:08.463168  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.495113  1574 leader_election.cc:403] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.464401  5768 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.512326  5668 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.484565  5776 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.527396  5848 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:08.511992  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.460654  5880 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:08.559321  5880 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:08.559897  5880 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:08.535936  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72841.5us
I20260709 13:03:08.561687  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.523846  5751 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.532101  5874 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:08.529726  5879 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
W20260709 13:03:08.543797  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.573421  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.544121  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49767.5us
I20260709 13:03:08.571882  5874 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:08.571704  5751 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.576467  5751 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:08.545071  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.545575  5733 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
W20260709 13:03:08.547652  5889 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:08.524243  5723 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:08.538167  5706 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.548974  5820 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.538586  5768 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.550457  5601 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.552517  5849 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.556856  5721 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:08.567997  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.569715  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.573235  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.582983  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.635269  1609 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:08.635340  1601 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:08.635362  1610 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:08.636798  1601 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:08.543632  5691 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.580117  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:08.637899  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:08.590137  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.584615  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:08.591861  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:08.592311  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.592151  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:08.592530  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.013s
W20260709 13:03:08.643424  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.002s	sys 0.014s
I20260709 13:03:08.521450  5749 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.581790  5789 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.590881  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.604525  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1665) took 1795 ms. Trace:
I20260709 13:03:08.607278  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1642) took 1874 ms. Trace:
I20260709 13:03:08.648458  1531 rpcz_store.cc:276] 0709 13:03:06.808949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.295780 (+486831us) service_pool.cc:224] Handling call
0709 13:03:07.296119 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.441726 (+1145607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.604185 (+162459us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540003f054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:08.604449 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620835584}
I20260709 13:03:08.596890  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.647782  1676 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.619814  1602 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:03:08.622385  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:08.629192  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.588809  5786 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:08.644520  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 76655.9us
W20260709 13:03:08.643761  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 562138us
I20260709 13:03:08.654426  1501 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.654899  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:08.648874  1533 rpcz_store.cc:276] 0709 13:03:06.732475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.043437 (+310962us) service_pool.cc:224] Handling call
0709 13:03:07.043829 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.421186 (+1377357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.607057 (+185871us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000f7154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:08.607219 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062081408}
I20260709 13:03:08.656661  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:08.657402  1607 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:08.661304  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:08.662993  1604 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:08.663355  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.672884  1610 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:08.673273  1682 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:08.659202  5795 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.685745  5795 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.687423  2210 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:08.691709  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99903.3us
I20260709 13:03:08.693965  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:08.697556  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.702783  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.648478  5749 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.646035  5706 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:08.704797  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.705570  1530 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.666646  5810 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.666695  5733 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.648265  5789 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:08.713088  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:08.717937  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:08.718611  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:08.718747  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.623116  5723 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.686427  5795 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.730786  1681 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:08.708745  5867 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.646341  5555 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.637518  5849 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.754523  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.723752  5868 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.730403  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:03:08.709304  5749 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.761142  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:08.759747  5706 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.777145  1681 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.778501  1681 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.708745  5848 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.780732  1528 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
W20260709 13:03:08.769464  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 110977us
I20260709 13:03:08.773402  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.789538  5723 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:08.783738  1532 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
W20260709 13:03:08.795514  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.799103  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 144723us
I20260709 13:03:08.800628  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.800900  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.802472  1534 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:08.802738  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.730374  5810 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.668282  5854 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:03:08.772825  5805 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:08.823029  1532 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:08.661473  5874 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.825591  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:08.800136  5881 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.798894  5867 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:08.833418  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:08.837694  2210 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:08.835162  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:08.807276  5723 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:08.856977  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.857911  1532 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:03:08.808087  5721 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:03:08.829452  5805 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:08.861755  5854 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.862118  5555 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.862349  5854 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.863027  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.863530  5805 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:08.837481  5867 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:08.864254  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:08.890173  5867 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.890947  5776 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.891189  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:08.892061  1684 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:08.896929  5849 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.897408  5882 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:08.900612  5902 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:08.901474  5723 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.901889  5721 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.902004  5723 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:08.903343  5900 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:08.906203  5790 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.906625  5790 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:08.907467  5790 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.908710  5790 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.865022  5912 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.912854  5912 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.915036  5912 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.915560  5912 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.919435  1418 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3ab72f324d545a6b4ecb1025df1f7c0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:08.921326  5776 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.923727  1534 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:03:08.872599  5903 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:08.802824  5789 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.874601  5810 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.883453  5706 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.864377  5601 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:08.928684  5854 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.866266  5852 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:08.932363  5723 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:08.915974  5912 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:08.887621  5751 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:08.867447  5901 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:03:08.964316  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.986096  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.014982  1532 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:09.011412  5810 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:09.019234  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.019094  5810 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.020126  1532 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.021868  5810 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:09.024928  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.935689  5749 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.009147  1530 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
W20260709 13:03:08.987520  5659 consensus_meta.cc:287] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 13:03:08.878026  5880 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:08.994053  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.025336  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.029832  1676 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:09.010648  5882 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.035254  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.036010  1676 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:09.038679  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.007599  5721 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:03:09.053419  1678 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:09.061522  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 235961us
W20260709 13:03:09.102263  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 389234us
W20260709 13:03:09.061825  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 233023us
I20260709 13:03:09.102475  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.110608  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.073999  5918 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.100399  5854 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.103626  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.081343  1532 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 16.
I20260709 13:03:09.099468  5882 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.122618  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.128075  5918 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:09.132903  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.104651  5722 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.133935  5722 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:09.135110  5873 consensus_meta.cc:287] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.004s
I20260709 13:03:09.135850  5873 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.137303  1679 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:09.138656  5795 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.141520  5795 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.141587  5918 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:09.144913  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.146067  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.118913  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:09.103060  5909 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.104728  5856 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.159089  5310 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.159593  5310 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:09.159408  5856 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.160513  5310 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.161710  5856 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.118086  5908 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.062991  5848 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.150856  5926 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.153811  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.173789  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.151226  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.165846  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.165776  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.166450  1677 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:09.142411  5867 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.175750  5805 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.178124  5740 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.190773  1605 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.191006  5749 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.157637  5751 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.173126  5776 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.192202  5776 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:09.194348  5776 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:09.179836  5917 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.180454  5672 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:09.149711  5854 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.156774  5659 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:09.172627  5909 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.196484  5867 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.196676  5659 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:09.197690  5659 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:09.198376  5909 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.198944  5926 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.199826  5926 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.153030  5810 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.154121  5923 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.183468  5868 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:09.202172  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.202294  5868 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:09.202811  5868 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.203877  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.204676  5672 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.155277  5880 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.157015  5601 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:09.206828  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.207032  5601 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.207535  1601 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:09.209297  5601 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.175797  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.211634  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.217695  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.167042  5722 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.149374  5882 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:09.205711  5672 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.212224  5740 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.212697  5881 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:09.213363  5733 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:09.213527  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.235016  1603 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:03:09.236019  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.236737  1603 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:09.237671  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.214073  5884 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:09.238161  5881 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.238870  5881 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.239120  5884 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.239560  5884 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.240398  5884 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.241690  5884 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.242036  5854 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.214918  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.156688  5912 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.216682  1535 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:09.242789  5867 consensus_queue.cc:1175] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36f53e9bfce749bbba4a4b34829f563d" responder_term: 11 status { last_received { term: 11 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 11 index: 6 } }
I20260709 13:03:09.217692  5874 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.193997  5805 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.243628  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.239786  5881 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.244357  1602 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:09.244841  5881 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.245234  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.245822  5805 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.186072  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.246312  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.220068  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.220698  1601 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:09.253072  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.253698  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:09.221885  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 68150.4us
I20260709 13:03:09.256356  5811 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:09.257023  5811 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.257666  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.258893  5706 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:09.259454  5795 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:09.226315  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.260618  5706 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:09.261744  5795 raft_consensus.cc:2764] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:09.227073  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.262455  5795 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:09.262841  5706 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.263260  5706 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:09.228892  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.228888  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.260164  5921 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.261621  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.264159  1606 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:03:09.269652  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 83650.1us
I20260709 13:03:09.271874  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.272362  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.254221  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.238279  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:09.230537  1605 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 16.
I20260709 13:03:09.274089  1677 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:09.275022  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.275476  1681 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:09.275935  1678 raft_consensus.cc:2368] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:03:09.276584  1603 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.276795  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.277408  1677 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:09.277747  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.278234  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.279189  1680 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.278358  1681 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:09.281158  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.281407  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.281245  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.281872  5848 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:09.282595  5733 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:09.280500  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.283135  1675 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:09.282022  1681 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:09.284411  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.284628  5777 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:09.284902  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:09.285053  5777 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:09.285475  1606 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.285943  5811 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.264328  5912 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:09.285866  5777 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.286633  5912 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:09.286911  5777 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.287542  5912 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.288439  5722 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.288738  5912 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.289124  5722 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:09.282862  5848 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:09.224444  5810 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.291006  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.287084  1610 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:09.282589  5917 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.295210  5825 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.295413  5848 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.295827  5825 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.298171  5310 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.295856  5522 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.227599  5740 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.299566  5733 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:09.299959  5740 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.300413  5733 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:09.302345  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.303836  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.228989  5790 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:03:09.308626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.310575  1678 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:09.311101  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.318945  1532 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:09.203670  5868 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.327852  1610 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:09.324816  5691 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.325646  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.325941  5874 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:09.326241  5840 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.305501  5789 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.301913  5810 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.331797  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.332259  1675 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:09.324371  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.333441  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.347287  1535 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:09.326891  5522 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.338055  1678 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:09.338068  1680 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:09.340584  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.307066  5917 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.341467  1682 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:09.344280  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.336377  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.301354  5733 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.326927  5909 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:09.348807  1603 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
W20260709 13:03:09.389501  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56131.2us
I20260709 13:03:09.350476  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.349364  1675 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:09.390439  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.391278  1684 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:09.420203  1682 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:03:09.310384  5706 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.421522  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.420753  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.423225  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 10.
I20260709 13:03:09.421959  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:09.391739  1501 leader_election.cc:400] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:03:09.420351  1535 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 6: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:09.343642  5840 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.345232  5744 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.349083  1606 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:09.338884  5880 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:03:09.426350  1501 leader_election.cc:403] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.430660  5749 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.429737  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.343590  5691 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.430964  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.351976  5867 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:09.451372  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.389959  5790 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.353669  5820 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:03:09.431499  5840 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.431008  1603 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:09.440101  1606 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:09.391578  5522 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.426342  5768 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.003s
I20260709 13:03:09.445516  5749 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.353138  5882 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.346913  5810 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:09.445434  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86472.1us
I20260709 13:03:09.422849  5751 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.447700  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.448196  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.449616  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.451661  5872 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:09.486363  1532 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:09.451110  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:09.454272  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.487434  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.456056  5691 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.473594  5875 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:09.458699  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.459977  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:09.495239  1533 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:09.471169  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.443972  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 141940us
I20260709 13:03:09.352334  5795 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:03:09.424342  5909 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.451472  5849 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.483608  1604 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:09.452481  5825 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.458858  5880 consensus_queue.cc:1243] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:09.483872  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:09.451557  5922 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:03:09.440744  5776 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:03:09.454330  5938 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:09.491704  1530 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:09.476878  5820 consensus_queue.cc:1243] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:09.472496  5790 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.477104  5522 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.483094  5749 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.490365  5872 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.500989  2209 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 6.
I20260709 13:03:09.485678  5751 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.509881  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:09.501507  5875 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.464865  5867 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.484000  5768 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.518196  5908 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:09.532142  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.510703  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:09.546604  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:09.487289  5659 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:09.565654  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.541818  5811 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:09.548609  5751 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.585695  1604 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:09.590731  1526 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.560770  1501 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:09.557732  5659 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.550297  5786 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.552069  5856 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:09.551409  5875 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.557058  5908 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.577337  5852 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.557938  5926 raft_consensus.cc:2764] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:09.607031  1604 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:09.587631  5811 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:09.593320  5659 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.598990  5786 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.583647  5668 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:03:09.583487  5907 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:09.647167  1604 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:09.614748  5852 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.655077  5920 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.604452  5908 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.662644  1604 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:09.663039  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70222.9us
I20260709 13:03:09.605499  5795 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:03:09.666543  1680 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:09.646063  5786 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.677085  5848 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.678423  1610 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:09.679487  5848 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.660454  5852 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.689043  5768 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.690515  5868 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.670733  5938 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.721669  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.705247  5948 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:09.763406  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 315916us
I20260709 13:03:09.764662  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.681042  5733 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:03:09.675150  5811 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.708379  5938 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.749696  5740 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.752665  5943 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:09.769129  5909 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:09.791814  5881 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 13:03:09.812381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.783757  5884 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:09.815007  5947 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:09.763885  5790 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.817867  5598 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.818005  5873 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:09.820219  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37256 (request call id 195) took 1312 ms (client timeout 1672 ms). Trace:
W20260709 13:03:09.820789  1528 rpcz_store.cc:269] 0709 13:03:08.507440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.507626 (+   186us) service_pool.cc:224] Handling call
0709 13:03:09.819982 (+1312356us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54000dd754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:09.820142 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509348736}
I20260709 13:03:09.825165  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.826076  1677 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:09.826942  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:09.827466  1677 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:09.793234  5849 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13.
I20260709 13:03:09.837962  1601 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:09.834353  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.856431  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:09.763450  5948 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.906100  5948 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:09.863170  5944 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:03:09.864089  5946 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:03:09.906872  5872 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:09.909014  5935 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.462s	user 0.002s	sys 0.000s
I20260709 13:03:09.912081  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:09.866732  5912 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
W20260709 13:03:09.866901  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 526052us
I20260709 13:03:09.868175  5740 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.868348  5820 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:09.869063  5881 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.873452  5884 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:09.881209  1683 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:09.811497  5867 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.887506  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1932) took 1182 ms. Trace:
I20260709 13:03:09.835884  5811 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:09.892668  2176 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:09.897734  5938 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:09.901504  5777 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.001s
I20260709 13:03:09.812824  5943 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:09.914886  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:09.997032  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82213.8us
I20260709 13:03:09.998202  1535 raft_consensus.cc:2410] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:09.919654  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:09.917913  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:09.937561  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 499464us
I20260709 13:03:09.939471  5787 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:09.999579  5787 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:10.000558  5787 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.001840  5787 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.944600  5920 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:09.947255  5856 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.950174  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.006434  1677 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:09.951472  5723 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.960752  1609 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:09.967662  5872 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.961756  5907 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.962381  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:09.987664  5874 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.964856  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.966274  5706 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.903424  5749 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:10.032240  5810 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.001s
I20260709 13:03:10.032718  5810 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.033744  5749 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:09.967780  1606 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:10.034358  1606 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:10.034734  5810 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.003764  5920 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.035122  1606 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.036245  1606 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.038367  1603 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:10.038208  5907 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.970333  1526 rpcz_store.cc:276] 0709 13:03:08.705408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.113759 (+408351us) service_pool.cc:224] Handling call
0709 13:03:09.114088 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.591384 (+477296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.887229 (+295845us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540003fa54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:09.887441 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095652736}
W20260709 13:03:09.989012  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96432.5us
I20260709 13:03:10.046643  5908 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.005849  5722 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.015389  5239 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:09.920017  5873 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:03:10.050137  5874 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.052349  5872 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:10.053294  5872 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:09.916704  5659 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:09.991746  5755 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.004613  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:09.920554  5820 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.961351  5768 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.008574  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 95582.5us
W20260709 13:03:10.076006  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61277.1us
I20260709 13:03:09.928309  5881 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:09.964484  5795 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:10.082090  1526 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:10.020223  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1931) took 1354 ms. Trace:
I20260709 13:03:10.009516  5856 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.040328  5907 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:09.992622  1602 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
W20260709 13:03:10.066510  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 146999us
I20260709 13:03:10.067201  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:10.091562  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.092226  1533 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:10.069386  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:09.921921  5852 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.082901  1534 rpcz_store.cc:276] 0709 13:03:08.665513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.979238 (+313725us) service_pool.cc:224] Handling call
0709 13:03:08.985164 (+  5926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.065137 (+ 79973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.065181 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.065778 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.186990 (+121212us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.473260 (+286270us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.473752 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.878899 (+405147us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18003bef00. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419
0709 13:03:10.019691 (+140792us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b540027c9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:10.019767 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.019829 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:10.019847 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.020128 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321211,"prepare.queue_time_us":269273,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":71091,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":16241,"spinlock_wait_cycles":78654848,"thread_start_us":98991,"threads_started":2,"wal-append.queue_time_us":98660}
I20260709 13:03:10.074096  1606 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:10.074635  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70106.4us
W20260709 13:03:10.071481  5916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.026s	sys 0.044s
I20260709 13:03:10.105496  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.105849  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:10.106330  1527 raft_consensus.cc:2410] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:03:10.106401  1609 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:10.078974  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.086301  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.108884  1531 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:10.088927  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2103) took 1761 ms (client timeout 2042 ms). Trace:
I20260709 13:03:10.093897  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:10.079761  5672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.027s	sys 0.052s
I20260709 13:03:10.103654  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:10.114050  1677 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:10.114494  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:10.104750  5916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.026s	sys 0.044s
I20260709 13:03:10.072000  5884 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.144676  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:10.144721  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:10.075248  5820 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.064327  5755 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:10.072445  5919 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:10.083333  5840 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.001s
I20260709 13:03:10.080668  5768 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.121533  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:10.075937  5777 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.013828  5776 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:03:10.123848  1528 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:10.190618  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.079267  5873 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:10.193264  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 89673.6us
I20260709 13:03:10.077521  5810 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:10.130960  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.081845  5881 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.130612  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.014066  5723 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.140805  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:10.109632  1683 rpcz_store.cc:269] 0709 13:03:08.327913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.413517 (+ 85604us) service_pool.cc:224] Handling call
0709 13:03:10.088760 (+1675243us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:10.088877 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314831616}
I20260709 13:03:10.081142  5795 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:10.057614  5751 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.098343  5868 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:10.121165  5844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:03:10.149787  1501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43535 timed out after 2.042s (SENT) [suppressed 17 similar messages]
I20260709 13:03:10.158399  5755 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.155586  1677 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:10.156316  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.265021  1526 raft_consensus.cc:2368] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:10.187188  2212 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:10.157627  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:10.266193  1605 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:10.081002  5598 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:03:10.127745  1682 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:03:10.269295  1682 pending_rounds.cc:85] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 7
I20260709 13:03:10.269583  1682 pending_rounds.cc:107] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:03:10.269843  1682 raft_consensus.cc:2889] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:10.213444  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.141815  5672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.028s	sys 0.053s
I20260709 13:03:10.217644  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:10.274367  1606 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:10.136919  5938 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.097923  5722 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:03:10.221710  1527 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:10.198942  5840 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.262660  5868 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.318460  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2148) took 1106 ms. Trace:
I20260709 13:03:10.222416  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:10.335201  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2144) took 1124 ms. Trace:
I20260709 13:03:10.216960  5919 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:10.219635  5810 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:10.338335  1684 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:10.232890  1683 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.222360  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:10.153133  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:10.153924  5955 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:10.262197  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.399415  1607 rpcz_store.cc:276] 0709 13:03:09.219108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.448371 (+229263us) service_pool.cc:224] Handling call
0709 13:03:09.448635 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.448852 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:09.467592 (+ 18740us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.468023 (+   431us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.885834 (+417811us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18001cbac0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:10.072891 (+187057us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b18001cbac0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4697c2fd70 00007f4697c23293 00007f4697c18cea 00007f4697c1923a 00007f4698083a2a 00007f46980930bf 00007f4698093038
0709 13:03:10.317711 (+244820us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.317994 (+   283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:10.318069 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:10.318139 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.318227 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.318381 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49362,"prepare.queue_time_us":64927,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":96,"raft.queue_time_us":8482,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":6702,"spinlock_wait_cycles":12464256,"thread_start_us":220006,"threads_started":1}
I20260709 13:03:10.402235  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:10.188489  5733 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.402770  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:10.267704  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.224421  5907 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.221642  5921 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:10.271268  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.295334  1682 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:10.302794  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:10.335132  5958 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:10.419062  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:10.423942  1683 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:10.397421  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.193478  5873 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:10.232584  5908 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.398532  1675 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:10.372115  5659 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.303785  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:10.403796  1607 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 15.
I20260709 13:03:10.308663  1605 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:10.329864  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:10.406438  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 184178us
I20260709 13:03:10.403410  5810 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.398499  1602 rpcz_store.cc:276] 0709 13:03:09.210982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.246116 (+ 35134us) service_pool.cc:224] Handling call
0709 13:03:10.335038 (+1088922us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001716d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:10.335147 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821937536}
I20260709 13:03:10.405829  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.288280  5920 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.336161  5962 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:03:10.370620  5957 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:10.461362  1684 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:10.311647  5522 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.001s
I20260709 13:03:10.294960  5601 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.428100  1527 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:10.484943  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:10.485721  1527 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:10.487412  1527 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:10.153137  5884 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.490660  5884 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.491338  5884 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:10.361244  5723 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.369628  5768 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.333715  5956 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.492690  5956 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.339789  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:10.256238  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 147976us
I20260709 13:03:10.431785  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.328799  5790 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:10.360863  5943 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.316828  5672 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.371547  5856 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.416114  5948 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:10.450573  1607 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:10.459738  1609 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
W20260709 13:03:10.306722  5789 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
I20260709 13:03:10.298908  5867 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:03:10.431151  5740 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:03:10.328011  5936 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.276s
I20260709 13:03:10.478816  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:10.520599  1605 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.417725  5852 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.297797  5938 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.328208  5950 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:10.481038  5875 consensus_meta.cc:287] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.006s
I20260709 13:03:10.512151  5811 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:10.512920  5825 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:10.545244  5919 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.526051  5598 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:03:10.514024  5239 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:10.514750  5722 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:10.300180  5795 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.415246  5733 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.416867  5777 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.427688  5921 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.474480  5920 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.523953  5740 consensus_queue.cc:1243] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:10.495558  5956 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.415416  5955 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.536489  5966 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:10.537098  5751 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:10.537642  5934 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.989s	user 0.005s	sys 0.000s
I20260709 13:03:10.542088  5938 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.543138  5950 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.503618  5790 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:10.543490  5875 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:10.498181  5522 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.502367  5601 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.543152  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:10.537184  5786 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.856s	user 0.012s	sys 0.000s
W20260709 13:03:10.602794  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.028s
W20260709 13:03:10.665078  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.031s
I20260709 13:03:10.660048  5790 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.670339  1605 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:03:10.672644  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2073) took 1469 ms. Trace:
I20260709 13:03:10.673172  1608 rpcz_store.cc:276] 0709 13:03:09.203225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.203340 (+   115us) service_pool.cc:224] Handling call
0709 13:03:09.203673 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.203984 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.204009 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.204461 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.422446 (+217985us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.422492 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.422556 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.536934 (+1114378us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:10.662611 (+125677us) raft_consensus.cc:1685] finished
0709 13:03:10.662631 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.672580 (+  9949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":496,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":6627584,"thread_start_us":217636,"threads_started":1,"wal-append.queue_time_us":285089}
I20260709 13:03:10.551954  5868 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.663030  5777 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.663321  5840 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:10.535657  5948 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.672237  5733 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.522732  5672 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.700325  5777 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.725488  5955 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.725862  5950 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.725509  5920 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.727442  5672 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.549541  5873 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.728996  5875 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:10.729117  5873 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.715984  5790 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.721197  5948 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.550931  5881 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:10.731964  5820 consensus_meta.cc:287] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:03:10.695735  5795 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:10.743175  5916 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:10.755761  5916 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:10.766876  5948 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.448385  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:10.465278  1526 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:03:10.812624  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 385457us
W20260709 13:03:10.814081  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.013s
W20260709 13:03:10.814761  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.011s	sys 0.013s
I20260709 13:03:10.470808  1531 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:10.821568  1532 raft_consensus.cc:2410] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:10.821812  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.823318  1684 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:10.805315  1501 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.002s	sys 0.022s
W20260709 13:03:10.824534  1501 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.002s	sys 0.022s
W20260709 13:03:10.824642  5720 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.294s	user 0.028s	sys 0.020s
W20260709 13:03:10.825194  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 675368us
I20260709 13:03:10.825274  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.828672  1676 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:10.813305  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:10.830678  1526 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.849054  5601 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:10.839602  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:10.676646  5786 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.852666  5659 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:10.857548  5787 consensus_meta.cc:287] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.001s
I20260709 13:03:10.859052  5659 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:10.859570  5659 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:10.831010  5522 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:10.825258  5720 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.028s	sys 0.020s
W20260709 13:03:10.842307  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.842494  5811 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.839519  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 391083us
I20260709 13:03:10.878396  1528 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:10.859943  5659 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.855770  5786 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.887642  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:10.888566  1681 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:10.888655  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2081) took 1672 ms (client timeout 2145 ms). Trace:
W20260709 13:03:10.889096  1601 rpcz_store.cc:269] 0709 13:03:09.216496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.253359 (+ 36863us) service_pool.cc:224] Handling call
0709 13:03:10.888185 (+1634826us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003be7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:10.888441 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303436544}
I20260709 13:03:10.895290  1533 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:10.896198  5923 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.896834  5881 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.897022  5923 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:10.896215  5755 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.004s
I20260709 13:03:10.898658  5755 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:10.901252  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.901893  2211 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.902482  5755 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.903010  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.905644  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:10.756101  5820 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.910696  5820 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.912716  1603 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:10.878429  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:10.899847  5923 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.941870  5706 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.943440  5706 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:10.944169  5706 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.943536  5916 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.945432  5916 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.942651  5907 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:10.949365  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:10.942613  5874 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:10.952984  5522 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:10.953891  5921 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.953819  5522 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.954584  5881 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.955260  5881 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.966506  1526 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:10.955978  1534 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:10.982486  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:10.983049  5749 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:10.983544  2212 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:10.958164  5811 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:10.995326  5811 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:10.996474  1682 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
W20260709 13:03:10.997509  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119346us
I20260709 13:03:10.997607  2209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 7) took 1025 ms. Trace:
I20260709 13:03:10.998528  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:10.999061  5907 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.999766  5907 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.000232  5926 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.001077  5926 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.002562  5907 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.003706  5926 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.964391  5881 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:10.958503  5522 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:10.998167  2209 rpcz_store.cc:276] 0709 13:03:09.971955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.989267 (+ 17312us) service_pool.cc:224] Handling call
0709 13:03:10.996966 (+1007699us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540088a4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807f735 00007f46980779fa 00007f469d03f4c9 00007f46965bbc54 00007f46965bbbe2 00007f46965bbb11 00007f46965bba8c 00007f46965bad42 00007f46963b448c 00007f46963b38c6
0709 13:03:10.997370 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918476032}
I20260709 13:03:11.010697  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1674) took 1696 ms. Trace:
I20260709 13:03:11.018031  1532 rpcz_store.cc:276] 0709 13:03:09.313812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.489380 (+175568us) service_pool.cc:224] Handling call
0709 13:03:11.010365 (+1520985us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400319f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:11.010586 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911268608}
W20260709 13:03:11.022555  1418 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3ab72f324d545a6b4ecb1025df1f7c0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:03:11.023434  5954 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.766s	user 0.007s	sys 0.005s
I20260709 13:03:10.970696  5820 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:10.983558  5749 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:11.038537  5749 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.030843  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.040607  1678 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:11.027421  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2131) took 1360 ms. Trace:
I20260709 13:03:11.042701  5722 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.041548  1680 rpcz_store.cc:276] 0709 13:03:09.665877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.669626 (+  3749us) service_pool.cc:224] Handling call
0709 13:03:09.691989 (+ 22363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.699664 (+  7675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.699685 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.704254 (+  4569us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.990821 (+286567us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:09.990878 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.990970 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.022429 (+1031459us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:11.025607 (+  3178us) raft_consensus.cc:1685] finished
0709 13:03:11.025626 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.025941 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7275,"raft.queue_time_us":7366,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3975,"spinlock_wait_cycles":11016064,"thread_start_us":207756,"threads_started":1,"wal-append.queue_time_us":385423}
I20260709 13:03:11.043248  5722 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:11.044929  5820 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.036305  5777 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.031358  2175 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.050935  5882 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:11.051566  5882 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:11.051106  5722 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.030751  1679 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:11.054104  5882 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.055444  5852 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:11.057402  5907 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:11.052416  5722 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.058954  5907 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:11.059365  5907 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:11.060647  5907 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.063030  5907 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:11.070528  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.072434  5884 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.073129  5884 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.081571  5820 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.083077  5777 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.084940  1529 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:11.085938  5805 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:11.087611  5825 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:11.088002  5825 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:11.089425  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.089886  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.039883  5749 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.106391  5691 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.106078  1433 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.107069  5691 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.106102  5755 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.108394  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.110699  1679 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:11.120186  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 116448us
I20260709 13:03:11.089200  5825 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.110761  5884 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.127835  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.129603  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.132617  1433 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 10 to 11, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:11.132666  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2168) took 1066 ms. Trace:
I20260709 13:03:11.109431  5755 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.147305  2175 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:11.162667  1530 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.005s
I20260709 13:03:11.163254  1530 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:11.163969  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 1952) took 1070 ms. Trace:
I20260709 13:03:11.164407  1530 rpcz_store.cc:276] 0709 13:03:10.093556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.339442 (+245886us) service_pool.cc:224] Handling call
0709 13:03:11.163865 (+824423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:11.164072  5706 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.168431  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.171000  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.172204  1609 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:11.172657  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.181572  1608 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.140460  1606 rpcz_store.cc:276] 0709 13:03:10.065812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.292343 (+226531us) service_pool.cc:224] Handling call
0709 13:03:10.312917 (+ 20574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.313182 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:10.662611 (+349429us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.097490 (+434879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:11.117176 (+ 19686us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:11.120004 (+  2828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.123397 (+  3393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.132390 (+  8993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42748,"prepare.queue_time_us":224850,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":49877,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1417,"thread_start_us":616071,"threads_started":2,"wal-append.queue_time_us":317541}
I20260709 13:03:11.173209  5820 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.206571  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.207557  1609 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.184798  5777 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.173038  5852 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.217958  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45345.7us
I20260709 13:03:11.227780  5950 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.229717  5795 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.230423  5959 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.244798  1681 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.230943  1607 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:03:11.232653  5956 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.200330  5820 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.197496  5786 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.236539  5943 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:11.236968  5810 consensus_meta.cc:287] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.014s
I20260709 13:03:11.240376  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.197763  5787 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.247400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.239463  5884 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.254793  1679 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.237614  5706 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:11.260182  5884 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.263828  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.263648  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:11.253507  5820 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.254611  5825 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.263037  5884 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.278258  1607 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:11.267838  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 8 to 9, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:11.250319  5777 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.282764  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.282913  5755 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.285115  5777 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.276309  5950 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.278416  5852 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.264045  5959 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.273855  5795 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:11.300272  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.300519  5795 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.301472  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.303248  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.304288  2211 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:11.303895  1602 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:11.291886  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:11.324649  5959 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:11.325435  5985 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:03:11.326751  5921 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.328948  1604 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:11.314670  5786 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:11.331074  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 150860us
I20260709 13:03:11.331389  5786 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.314244  5956 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.332221  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:11.333031  5920 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.333626  5920 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.334336  5956 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.297708  5787 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.338285  5787 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.327744  5659 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.321386  5916 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.342240  5916 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.342424  5659 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.342653  5916 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.278487  5691 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.344579  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.353083  1609 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:11.355667  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103771us
I20260709 13:03:11.264278  5810 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.358301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.324542  5852 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.335960  5920 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.362978  5976 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:11.364075  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.376579  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44538us
I20260709 13:03:11.378808  1602 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 6.
I20260709 13:03:11.383471  5976 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.383647  5868 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:11.384204  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 92510.2us
I20260709 13:03:11.384398  5976 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.384467  5868 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.385821  5776 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.387050  5976 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.392316  5959 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.393287  5959 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.394810  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:11.383594  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.359356  5956 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.396137  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1963) took 1029 ms. Trace:
I20260709 13:03:11.383507  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:11.402072  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.397888  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.396345  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.412724  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.376231  5795 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.411083  1533 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 6.
I20260709 13:03:11.414969  1610 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 15.
I20260709 13:03:11.375324  5691 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.418613  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.421478  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.424849  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.412616  5921 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:11.373430  5777 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:03:11.433534  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.396018  5959 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.432811  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.435935  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.405350  1531 rpcz_store.cc:276] 0709 13:03:10.322021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.850171 (+528150us) service_pool.cc:224] Handling call
0709 13:03:10.850907 (+   736us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:03:10.879668 (+ 28761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.879719 (+    51us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:03:10.912068 (+ 32349us) log.cc:844] Serialized 104 byte log entry
0709 13:03:10.938972 (+ 26904us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:11.018796 (+ 79824us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.213508 (+194712us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.258271 (+ 44763us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.350666 (+ 92395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.350813 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.350870 (+    57us) raft_consensus.cc:1685] finished
0709 13:03:11.350888 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.351166 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140202,"prepare.queue_time_us":255870,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":7848,"raft.queue_time_us":158972,"raft.run_cpu_time_us":670,"raft.run_wall_time_us":8711,"thread_start_us":211095,"threads_started":3,"wal-append.queue_time_us":105755}
I20260709 13:03:11.435705  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.438282  1678 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.438661  1529 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:11.439168  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.440232  5522 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:11.443064  1534 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:11.443523  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.444486  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1960) took 1173 ms. Trace:
I20260709 13:03:11.429109  5923 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.445360  5950 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:11.446475  5810 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:11.454840  5706 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:11.456897  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.456780  5776 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.457610  1683 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.458698  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.439102  5921 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.460136  1532 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.430177  5795 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.468564  5722 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:11.520221  1679 pending_rounds.cc:85] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 6
I20260709 13:03:11.470187  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:11.472290  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.467603  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.474283  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.475651  1677 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:11.476455  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.429242  5659 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.426813  5956 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.527207  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.483961  5916 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.489500  1680 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.492506  1608 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:11.483448  5820 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.499137  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.500401  1610 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.494809  1527 rpcz_store.cc:276] 0709 13:03:10.233438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.495002 (+261564us) service_pool.cc:224] Handling call
0709 13:03:10.495361 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:10.502239 (+  6878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.502282 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:10.806254 (+303972us) log.cc:844] Serialized 52 byte log entry
0709 13:03:10.951435 (+145181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:11.100366 (+148931us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003598c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:11.248239 (+147873us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b18003598c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:03:11.321209 (+ 72970us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.378359 (+ 57150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.398546 (+ 20187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.398588 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:11.398600 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.406349 (+  7749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83936,"prepare.queue_time_us":29790,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":7014,"raft.queue_time_us":69361,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":18803,"spinlock_wait_cycles":168610432,"thread_start_us":194200,"threads_started":2,"wal-append.queue_time_us":223020}
I20260709 13:03:11.521908  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.526161  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.531004  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:11.525094  1526 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:03:11.534446  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 75908.6us
I20260709 13:03:11.535679  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.536509  1680 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:11.534396  2211 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 6.
I20260709 13:03:11.537880  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.538941  5938 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.539436  5938 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.540782  1604 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:11.541692  5921 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.541925  1675 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.542471  5840 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:11.542992  5840 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:11.543958  5840 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.545992  1601 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:03:11.546203  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 176) took 26189 ms (client timeout 15000 ms). Trace:
I20260709 13:03:11.548060  1677 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:11.550509  5923 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.550979  5923 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.552408  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.552843  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.553117  1676 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:11.554369  5659 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:11.554589  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.554905  5956 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.555621  5740 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.555505  5659 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.556226  5740 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.557256  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:11.559610  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 92145.3us
I20260709 13:03:11.559880  5722 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:11.560670  1648 leader_election.cc:400] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:11.560962  1648 leader_election.cc:403] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:11.562104  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.562834  5522 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:11.563723  5522 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.564141  5522 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:11.564503  1606 raft_consensus.cc:2393] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:11.564493  5522 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.565598  5795 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:11.565793  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 126254us
I20260709 13:03:11.566201  5795 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.566570  5795 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.566897  5795 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.568608  2175 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.569530  5882 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:11.570081  5882 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.570483  5882 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.497100  5691 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.573658  1608 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.573992  5691 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.575665  5740 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.565629  5820 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.576526  5868 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.576764  1602 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:11.577685  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.578198  1499 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:11.531718  5776 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.579020  5950 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:11.579449  5950 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.579785  5950 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.580708  5776 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.581553  1681 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:11.581626  5923 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.579277  1675 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:11.584785  5923 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.585433  5522 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.588188  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.593127  1610 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:11.594025  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.595178  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.589311  5916 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.532573  5706 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.596172  5959 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.596356  1609 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:11.596737  5959 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.597952  5706 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.589715  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.598827  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.599237  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.599918  1601 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:11.600754  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.602164  1601 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:11.592368  5923 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.604378  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.520747  1679 pending_rounds.cc:107] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:03:11.608341  1679 raft_consensus.cc:2889] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.612974  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.579728  5882 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.620546  5938 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.623363  1605 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:11.623497  5923 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.638479  5923 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.599630  1609 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:11.624564  1610 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:11.625041  1606 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:11.625923  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.626230  5882 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.626668  1678 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.643093  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.643400  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.644003  1678 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.644354  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.645268  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.645498  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:11.627056  6000 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:11.627964  5522 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.643121  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.647866  1531 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:11.648690  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.630929  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.651383  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.631481  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:11.651858  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.653966  1681 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:11.654228  5868 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:11.632918  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.655074  5868 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.655547  5916 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.655990  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.656224  5522 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.657153  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.658046  5522 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.658335  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.536960  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.658819  5916 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:11.659153  1534 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.640595  5755 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:11.659353  5810 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:11.659601  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.659794  5916 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.660439  1527 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:11.659428  5740 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:11.660410  5820 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:11.661612  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.655112  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:11.662213  5820 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:11.662569  1527 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:11.662875  5884 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.663664  5820 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.664326  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:11.672289  5938 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.640470  5959 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.673413  5943 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.629391  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.664997  5820 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.661536  5740 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:11.675967  5740 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:11.677053  5740 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.678261  5740 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.660670  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:11.546571  1430 rpcz_store.cc:269] 0709 13:02:45.390957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.391157 (+   200us) service_pool.cc:224] Handling call
0709 13:02:46.570166 (+1179009us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:03:11.545900 (+24975734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:08.061350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:08.169146 (+107796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:08.169179 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:03:08.169190 (+    11us) tablet.cc:662] Decoding operations
0709 13:03:08.170049 (+   859us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:08.170104 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:08.170133 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:08.170717 (+   584us) tablet.cc:701] Row locks acquired
0709 13:03:08.170736 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:08.170876 (+   140us) write_op.cc:270] Start()
0709 13:03:08.170990 (+   114us) write_op.cc:276] Timestamp: P: 1783602188170830 usec, L: 0
0709 13:03:08.171012 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:08.171643 (+   631us) log.cc:844] Serialized 2864 byte log entry
0709 13:03:09.153330 (+981687us) op_driver.cc:464] REPLICATION: finished
0709 13:03:09.342269 (+188939us) write_op.cc:301] APPLY: starting
0709 13:03:09.342368 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:09.424342 (+ 81974us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:09.429913 (+  5571us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:09.520948 (+ 91035us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:09.583223 (+ 62275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:03:09.583307 (+    84us) write_op.cc:312] APPLY: finished
0709 13:03:09.614418 (+ 31111us) log.cc:844] Serialized 58 byte log entry
0709 13:03:09.639700 (+ 25282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:09.648933 (+  9233us) write_op.cc:454] Released schema lock
0709 13:03:09.652541 (+  3608us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:09.691855 (+ 39314us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:09.697693 (+  5838us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":677,"reported_tablets":55,"spinlock_wait_cycles":321160576,"child_traces":[["op",{"apply.queue_time_us":188610,"apply.run_cpu_time_us":4992,"apply.run_wall_time_us":328075,"num_ops":7,"prepare.queue_time_us":641127,"prepare.run_cpu_time_us":21838,"prepare.run_wall_time_us":325521,"raft.queue_time_us":403078,"raft.run_cpu_time_us":14570,"raft.run_wall_time_us":226670,"replication_time_us":939930,"thread_start_us":1038725,"threads_started":4,"wal-append.queue_time_us":257031,"wal-append.run_cpu_time_us":60804,"wal-append.run_wall_time_us":2254305}]]}
I20260709 13:03:11.681823  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.683480  5884 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:11.684082  5884 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:11.684240  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.646126  1682 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:11.685638  5522 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.651863  1684 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:11.682533  5938 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.686513  5938 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.686694  1576 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.686915  5938 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.685207  5884 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.687923  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.688922  5825 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:11.689023  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 125793us
I20260709 13:03:11.689384  5825 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.689857  5825 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.670756  5749 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:11.665109  1531 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:11.690630  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.680362  1602 raft_consensus.cc:3060] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.694221  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.699674  1678 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:11.700160  1527 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:03:11.651383  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.701099  1608 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.665879  1526 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:11.704587  1532 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:11.706275  1534 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:11.707846  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.712702  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:11.713416  2211 raft_consensus.cc:2368] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:03:11.716223  1574 leader_election.cc:400] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:03:11.716531  1574 leader_election.cc:403] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:03:11.720376  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.726070  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.726886  1531 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:11.729234  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.727921  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.733705  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.734004  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.744467  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.744724  1602 raft_consensus.cc:2468] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 7.
I20260709 13:03:11.744625  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.740718  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.702104  5956 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:11.753764  5956 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.754220  5956 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:11.756367  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62231.8us
I20260709 13:03:11.757069  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.757720  5820 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.758258  5820 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.759229  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.759827  1680 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:11.760702  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.761270  1680 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:11.762065  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.762498  2175 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.755693  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.764571  1676 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.765618  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:11.749620  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:11.750479  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.767194  1526 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:11.750983  5810 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:03:11.707509  5706 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.769155  1534 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.774904  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.776237  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.777688  1676 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:11.744505  5691 raft_consensus.cc:2764] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:11.784759  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.781512  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.782394  1531 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:11.782292  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.783159  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.783880  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.787148  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.787940  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:11.788277  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97748.5us
I20260709 13:03:11.790973  1676 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.787940  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.787861  1532 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:11.792714  5777 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:11.792961  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.793159  5777 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.793883  5777 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.794356  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.794973  1684 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:11.795828  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.796578  1684 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:11.797360  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.799161  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.801568  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:11.802337  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.802763  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.803288  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.803486  1610 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.803907  1683 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:11.804386  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.803851  1609 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:11.769151  5993 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:11.810174  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.766789  5720 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:11.843782  5720 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.844244  5820 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.811415  5777 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.846138  5720 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:11.846410  5777 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.846732  5938 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.780606  5920 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:11.821552  1682 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:11.772176  5921 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.806185  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.859483  1534 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:11.793077  1680 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:11.847604  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62911.5us
I20260709 13:03:11.835968  1678 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:11.725273  5950 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:11.776213  5755 raft_consensus.cc:2804] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:11.806291  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.842571  1531 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:11.862493  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.815325  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.854205  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.857570  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:11.860996  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:11.853040  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65174.6us
I20260709 13:03:11.865157  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.865338  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.866191  1609 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:11.853462  5976 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.852689  5993 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:11.871912  5976 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.872332  5976 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.872517  5993 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.873984  5950 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:11.874297  5820 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:11.874902  5820 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.875972  1527 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 7: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:11.772660  5805 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:03:11.877007  5820 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:11.877406  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.877815  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:11.872973  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.878093  5920 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:11.878634  1604 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:11.879096  5920 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.879736  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:11.879987  1606 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:11.867172  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.879738  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.869910  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.878026  1527 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:11.885890  1610 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:11.888597  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.890390  1676 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:11.891834  1678 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.891932  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.893849  1531 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:11.891000  5755 raft_consensus.cc:697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:11.897784  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:11.840525  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.882215  5921 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.902297  1607 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.922597  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:11.923720  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.928485  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.947888  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.809552  5706 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:11.948688  1609 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:11.949824  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:11.882510  5777 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.950604  1676 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:03:11.951992  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80454.1us
I20260709 13:03:11.952502  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.952786  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.959122  1527 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:11.955821  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.960497  1534 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:11.956781  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.951470  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:11.896944  5959 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.890000  5805 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.923017  5950 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:11.993680  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:11.991966  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.056070  1526 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:12.057873  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 200416us
I20260709 13:03:12.059173  1678 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:03:12.064839  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 71259.4us
I20260709 13:03:12.065340  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:12.053913  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:12.067304  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:12.068764  1531 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:03:11.985520  5810 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:12.071062  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.065595  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:12.074935  1604 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:12.076215  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:11.956468  5820 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.070282  5795 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:12.083318  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 218677us
I20260709 13:03:12.091240  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.091367  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:11.984256  5777 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.052825  5852 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.087265  5672 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:12.061065  5950 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.089695  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:12.053264  5959 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.078509  5787 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:12.114368  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.085891  1606 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:12.097808  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:12.116277  1530 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.053535  5805 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:12.102415  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.088297  5740 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.094689  1607 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:12.051748  5923 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.113309  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:12.119064  1529 raft_consensus.cc:2368] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14.
I20260709 13:03:12.100015  5777 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:12.122579  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.122594  1534 raft_consensus.cc:2368] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:03:12.131788  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.112802  5950 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.132226  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.132620  1526 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:12.133646  1527 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:12.116693  5959 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.114853  5787 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.121659  5805 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.118172  5672 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:12.096769  5820 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.143522  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:12.072136  5755 consensus_queue.cc:237] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:12.148125  1527 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:03:12.153373  1527 pending_rounds.cc:85] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:03:12.153708  1527 pending_rounds.cc:107] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:03:12.153985  1527 raft_consensus.cc:2889] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.149685  1532 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:12.111219  5691 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:12.110559  5852 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.157145  1526 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:12.160565  1529 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:12.127188  5740 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.169278  1534 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:12.147023  5787 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.167654  1530 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:12.175808  1531 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:03:12.189312  1601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.021s	sys 0.045s
W20260709 13:03:12.189821  1601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.021s	sys 0.045s
I20260709 13:03:12.169109  5938 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:12.202101  5840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.027s	sys 0.028s
I20260709 13:03:12.199154  5722 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:12.213864  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 468213us
I20260709 13:03:12.235059  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:12.245831  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.216172  5840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.027s	sys 0.028s
I20260709 13:03:12.220325  5993 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:12.214561  5706 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.268218  5884 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.268726  5884 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.269294  5884 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.278234  5740 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.278954  5884 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.280171  5672 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.281059  5820 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.281643  5884 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.251107  5795 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:12.283783  6003 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:03:12.284696  6006 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:03:12.284842  6005 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:03:12.288899  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81769.9us
I20260709 13:03:12.290920  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:12.291962  5884 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:12.251930  5956 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.292645  5884 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.293119  5884 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:12.294641  5956 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.302345  5976 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.309072  5805 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:12.309864  6004 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:03:12.317615  5722 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:12.235886  5921 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.318197  5722 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:12.317862  5825 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.000s
W20260709 13:03:12.326138  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73443us
I20260709 13:03:12.330054  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:12.302501  5884 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.256001  5993 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.311699  5805 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:12.265035  5810 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:12.332104  5882 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.026s	sys 0.030s
I20260709 13:03:12.354043  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.355748  1681 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:12.347924  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.358939  1684 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:03:12.360765  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:12.395601  1679 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:12.401121  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80486.6us
W20260709 13:03:12.402748  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 311468us
I20260709 13:03:12.403821  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.406173  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:12.411201  5921 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.412142  5795 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:12.413596  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.413776  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.341738  5993 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.342337  5852 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:12.361865  5882 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.027s	sys 0.030s
W20260709 13:03:12.417140  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 297090us
I20260709 13:03:12.331758  5825 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.425354  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:12.355563  5976 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.360348  6020 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.436187  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:12.435596  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 370048us
I20260709 13:03:12.445313  1684 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:12.439551  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:12.455484  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:12.461971  1682 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:12.431252  5795 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.431910  5921 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:12.473798  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.474937  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:12.468132  5720 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:03:12.470569  5868 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:12.460224  5976 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:12.437170  5787 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.480819  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.488569  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:12.476716  5923 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.508807  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:12.483883  5868 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.484997  5810 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.546936  5921 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:12.522243  6035 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:12.549232  5921 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.549674  5921 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:12.545166  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 74869.2us
I20260709 13:03:12.552016  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.552309  6037 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:12.553267  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:12.554229  6037 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.554354  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:12.554885  6037 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.555258  6037 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.555590  6037 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.556291  5852 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.556716  5852 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.557034  5852 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.558681  5722 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.545763  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:12.564020  5706 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:12.565315  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43752.4us
I20260709 13:03:12.500715  5916 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.548177  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 1973) took 1035 ms. Trace:
I20260709 13:03:12.526043  5868 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.575345  1535 rpcz_store.cc:276] 0709 13:03:11.428622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.428745 (+   123us) service_pool.cc:224] Handling call
0709 13:03:11.435971 (+  7226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.460303 (+ 24332us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:11.460641 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.309203 (+848562us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:12.429036 (+119833us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.436365 (+  7329us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.458040 (+ 21675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.458091 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.458142 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.458219 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.463777 (+  5558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175150,"prepare.queue_time_us":360676,"prepare.run_cpu_time_us":212,"prepare.run_wall_time_us":36068,"raft.queue_time_us":25384,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6166,"spinlock_wait_cycles":5861120,"thread_start_us":843275,"threads_started":2,"wal-append.queue_time_us":684427}
I20260709 13:03:12.584756  6038 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.585279  6038 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:12.585671  5777 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.586200  6038 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.588097  6035 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:03:12.589764  6002 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:03:12.546711  6036 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.593215  6031 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.593432  6036 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:12.593755  6031 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:12.584535  5740 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:12.509452  6034 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:12.608197  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 160387us
I20260709 13:03:12.587829  5777 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:12.573832  6004 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:12.522342  5938 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:12.650305  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 94402.4us
I20260709 13:03:12.651476  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.591717  5959 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:12.715416  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.614589  6034 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.736655  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:12.737920  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 232788us
I20260709 13:03:12.647846  5884 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:12.631891  6020 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:12.738893  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 175410us
W20260709 13:03:12.717659  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66295.7us
I20260709 13:03:12.653424  5938 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:12.746125  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.798804  1684 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:12.755714  1498 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:12.794328  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 305842us
W20260709 13:03:12.819938  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.819778  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:12.826907  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:12.827663  1676 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:12.826151  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 391392us
I20260709 13:03:12.643518  5840 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:03:12.836750  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:12.842269  1679 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:12.837603  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 82006us
I20260709 13:03:12.845070  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:12.834851  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:12.852258  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.854074  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:12.745100  5950 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.003s
W20260709 13:03:12.885007  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 235277us
I20260709 13:03:12.851378  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:12.741706  6034 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.890070  1677 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:12.821712  5916 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.742332  5706 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:12.822209  5938 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:12.921063  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 290420us
I20260709 13:03:12.921335  6055 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:12.921607   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.856771  5810 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:12.996004  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 146604us
W20260709 13:03:13.389205  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.017393  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
W20260709 13:03:13.434240  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 589245us
I20260709 13:03:13.111920  1679 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:13.081964  1680 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:12.933903  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:13.100716  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 265958us
I20260709 13:03:13.490688  6068 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:13.419309  6025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.033s	sys 0.055s
I20260709 13:03:13.491617  6068 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:13.492238  6025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.039s	sys 0.057s
I20260709 13:03:13.492628  6025 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:13.493957  6058 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.495142  6066 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.855300  5720 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:12.884120  5825 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:13.511252  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 76348.6us
W20260709 13:03:13.249878  5852 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.001s
W20260709 13:03:13.413041  5868 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.829s	user 0.014s	sys 0.002s
I20260709 13:03:12.887202  5884 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.437642  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.532126  1606 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:12.925127  5959 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:13.286723  5672 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:13.092767  6053 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:13.507436  5777 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.549186  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:13.550653  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:13.549253  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:13.554720  1609 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:13.554980  1607 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:13.551369  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:13.507548  6052 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.893458  5950 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.556105  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:13.557121  1418 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3ab72f324d545a6b4ecb1025df1f7c0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:13.557976  1601 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:13.555500  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:13.000160  5722 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:13.560823  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 123305us
I20260709 13:03:13.567102  1608 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:03:13.567905  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.567152  1603 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:13.541326  5884 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.572919  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:13.532217  5852 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.575701  6060 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.576455  6060 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.577421  5852 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:13.578154  5852 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.579101  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:13.579296  6060 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:13.580188  6065 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.580473  1607 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:13.580912  6065 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.581105  5852 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.581420  6065 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.581547  5852 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.496959  5810 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.493177  6025 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:13.583905  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.519443  5720 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.594978  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:13.541580  5868 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.573770  5777 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:13.583871  5884 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.584692  5959 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:13.588744  5852 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.516671  6058 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.179759  6020 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:13.656677  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 722837us
W20260709 13:03:13.636722  2177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.018s	sys 0.039s
W20260709 13:03:13.657456  2177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.018s	sys 0.039s
I20260709 13:03:13.637005  6063 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:13.638651  5720 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:13.639138  5959 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.640630  6062 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.643108  6026 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.047s	user 0.001s	sys 0.023s
I20260709 13:03:13.645617  6069 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:13.646999  6045 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.063s	user 0.013s	sys 0.018s
I20260709 13:03:13.647814  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:13.519600  6066 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:13.652868  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57984.7us
W20260709 13:03:13.653394  6018 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.064s	user 0.018s	sys 0.026s
W20260709 13:03:13.654699  6027 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.062s	user 0.008s	sys 0.020s
I20260709 13:03:13.628271  5777 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:13.663774  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.665148  6038 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:13.558449  5672 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.599402  5722 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:13.633996  5921 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.084s	user 0.007s	sys 0.007s
I20260709 13:03:13.674808  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:13.568056  6052 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.681291  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2167) took 1942 ms. Trace:
W20260709 13:03:13.692862  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45117.4us
I20260709 13:03:13.688700  1604 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:13.696964  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:13.744663  1684 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:13.744876  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48048.6us
I20260709 13:03:13.745617  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.743806  1682 rpcz_store.cc:276] 0709 13:03:11.738787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.866127 (+127340us) service_pool.cc:224] Handling call
0709 13:03:11.885984 (+ 19857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.465337 (+579353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.680975 (+1215638us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54002e95d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:13.681213 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318843264}
I20260709 13:03:13.747488  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.747735  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:13.700281  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 413969us
I20260709 13:03:13.712230  6064 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.714144  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2110) took 1913 ms. Trace:
I20260709 13:03:13.720315  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:13.750830  1680 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:13.720952  6025 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:13.720821  5825 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:13.722551  5959 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:13.635363  5706 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.574239  6053 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:13.670693  6055 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:13.736774  1679 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:03:13.737521  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:13.689633  6062 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.738916  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:13.743310  1606 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:13.750833  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:13.835000  1677 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.755452  1681 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:13.747327  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:13.753860  1605 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:13.750635  1602 rpcz_store.cc:276] 0709 13:03:11.800612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.806435 (+  5823us) service_pool.cc:224] Handling call
0709 13:03:11.806745 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.852508 (+ 45763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.852554 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.881260 (+ 28706us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.265613 (+384353us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:12.265665 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.265748 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.642547 (+1376799us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:13.713719 (+ 71172us) raft_consensus.cc:1685] finished
0709 13:03:13.713748 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.714037 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87711,"raft.queue_time_us":49827,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4962,"spinlock_wait_cycles":38841600,"thread_start_us":375249,"threads_started":1,"wal-append.queue_time_us":706340}
I20260709 13:03:13.745697  5950 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:13.835031  1680 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.838967  1606 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:03:13.801215  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.005s	sys 0.009s
W20260709 13:03:13.844921  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.010s
I20260709 13:03:13.741133  6069 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:13.840212  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 155024us
W20260709 13:03:13.840271  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 93007.7us
I20260709 13:03:13.738844  6038 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:13.845796  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:13.745289  5921 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:13.853910  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:13.836300  6055 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.869292  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:13.841168  5959 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.851190  6063 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:13.875171  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127756us
I20260709 13:03:13.858279  6069 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.867817  5950 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.893639  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1686) took 2294 ms. Trace:
W20260709 13:03:13.879092  6037 consensus_meta.cc:287] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.323s	user 0.011s	sys 0.003s
W20260709 13:03:13.888696  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 171566us
I20260709 13:03:13.874922  6055 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.856751  5840 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:13.871399  6079 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.877868  5959 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:13.910048  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.761272  6064 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:13.927244  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58410.3us
I20260709 13:03:13.896759  1533 rpcz_store.cc:276] 0709 13:03:11.593118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.652466 (+ 59348us) service_pool.cc:224] Handling call
0709 13:03:11.652861 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:11.699055 (+ 46194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.699085 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:11.761596 (+ 62511us) log.cc:844] Serialized 52 byte log entry
0709 13:03:12.203675 (+442079us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:12.203732 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.203821 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.652554 (+1448733us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:13.870796 (+218242us) raft_consensus.cc:1685] finished
0709 13:03:13.870827 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.887561 (+ 16734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45760,"raft.queue_time_us":52405,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12897,"spinlock_wait_cycles":54437760,"thread_start_us":441675,"threads_started":1,"wal-append.queue_time_us":827630}
I20260709 13:03:13.894212  6076 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.894096  6069 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.904127  6068 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:13.990712  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43904.6us
I20260709 13:03:13.929765  5959 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.928910  5868 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:14.002429  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 92490.9us
I20260709 13:03:14.013733  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:14.015470  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:14.022373  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:13.983362  5950 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:13.922443  6060 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:03:13.997829  6020 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.910802  6037 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:14.016733  5993 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.582s	user 0.009s	sys 0.010s
I20260709 13:03:13.968199  5825 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:03:14.016290  5777 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.021306  5722 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.929610  6079 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:14.048801  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 158887us
I20260709 13:03:14.052138  1604 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:14.065912  6085 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:14.072530  6073 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:03:14.075063  6065 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.076948  6052 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.077514  1533 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:03:14.079223  5916 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.107s	user 0.009s	sys 0.000s
I20260709 13:03:14.079631  5916 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:14.081496  6067 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.591s	user 0.002s	sys 0.000s
I20260709 13:03:14.075388  5884 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.083617  6057 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.084556  6053 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.085227  5884 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.086470  6049 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:14.084192  6057 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.092398  6077 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:14.093070  6077 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:14.094326  6057 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.094081  6077 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.096084  6075 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:14.096556  6075 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:14.096905  5923 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:13.985469  6076 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:14.097642  5923 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.099449  6076 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.094964  6057 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:14.100371  5921 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.100695  6057 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:14.104554  6070 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:03:14.107043  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2182) took 1359 ms. Trace:
I20260709 13:03:14.097007  6096 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:14.107672  1678 rpcz_store.cc:276] 0709 13:03:12.747737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.747872 (+   135us) service_pool.cc:224] Handling call
0709 13:03:12.820378 (+ 72506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.927703 (+107325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.927733 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.066912 (+139179us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.595748 (+528836us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:13.595947 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.596078 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.106745 (+510667us) raft_consensus.cc:1685] finished
0709 13:03:14.106774 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.106964 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69606,"raft.queue_time_us":124686,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":46856,"thread_start_us":468748,"threads_started":1,"wal-append.queue_time_us":632946}
I20260709 13:03:14.033819  6058 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.118327  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:03:14.124893  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58815.9us
W20260709 13:03:14.126724  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 237775us
I20260709 13:03:14.137914  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.143883  1527 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:14.034811  5993 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.105890  5921 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:14.153467  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.153975  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.155814  1535 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:14.156813  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.158741  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.159034  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.096907  6075 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.159869  1532 raft_consensus.cc:2376] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16. Re-sending same reply.
I20260709 13:03:14.113132  5672 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:14.128805  6034 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.204s	user 0.013s	sys 0.000s
I20260709 13:03:14.161863  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:14.164528  6089 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:03:14.168078  6086 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:14.141835  5691 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:14.127293  5950 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:14.176518  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.184860  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.109781  6063 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:14.169250  5840 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.161648  5916 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:14.193975  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.194854  1531 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:14.197934  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.200323  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.202004  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.202716  1532 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.205108  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.205791  1529 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:14.206815  1528 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:14.176290  5777 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:14.209029  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65140us
I20260709 13:03:14.177281  5691 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:14.197010  5852 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:03:14.213250  6088 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:14.214042  6055 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.214753  6079 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.212005  6102 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:14.152881  6069 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.170158  6034 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.217110  6038 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.342350  5923 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.343470  6037 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.344259  6037 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:14.328162  2211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41286 (request call id 109) took 2424 ms (client timeout 2869 ms). Trace:
I20260709 13:03:14.328740  1535 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:03:14.370355  2211 rpcz_store.cc:269] 0709 13:03:11.876781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.877560 (+   779us) service_pool.cc:224] Handling call
0709 13:03:14.300575 (+2423015us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400600254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:14.300725 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419734400}
I20260709 13:03:14.199717  6062 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.411500  1532 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:14.196103  6031 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.257040  1526 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:14.259464  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.437273  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:14.296892  5938 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 13:03:14.442097  1610 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:14.451361  1529 raft_consensus.cc:2368] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:14.451175  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:14.344862  6037 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.201723  5921 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.452384  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.301636  6086 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:14.452380  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.454859  1527 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:14.201160  5749 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.237s
I20260709 13:03:14.453738  1530 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:14.216919  5777 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.460240  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.466195  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:14.469436  6113 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.427429  5852 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.469978  6113 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.471513  5852 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.472191  5852 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:14.430044  6102 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.474400  6102 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.474645  5777 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:14.472327  6104 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:03:14.476794  6034 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.344975  5950 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.485069  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.340330  5691 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.487290  6064 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.488821  6037 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.488925  5852 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.490482  5959 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.491103  5852 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.457257  6060 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.496973  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:14.456204  5938 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.513435  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:14.456561  5706 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.467130  6057 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.492343  6060 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.492897  5923 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.438337  6088 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.517489  6096 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:14.560703  6106 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:14.561309  6106 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.563653  6106 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.565011  6118 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:14.565614  6118 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.569108  5795 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:14.569710  5795 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:14.571060  5795 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.572137  6117 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.572672  6117 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:14.574926  6117 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.567762  6118 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.521363  5706 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.581432  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:14.582247  6060 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.558250  5749 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.559762  5959 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.589355  5938 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.620095  6115 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.620884  6115 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.622997  6069 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.594971  5795 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.587132  6086 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.624250  5749 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.636665  6055 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:14.683964  6075 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:03:14.705648  6124 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.706584  6124 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.694041  6020 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.632596  6096 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.724659  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.696991  6075 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:14.742540  6094 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:03:14.735177  6107 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:03:14.753584  6065 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.722095  6020 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:14.756819  6112 log.cc:927] Time spent T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:03:14.757089  5749 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:14.758164  6040 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 2.167s	user 0.014s	sys 0.056s
I20260709 13:03:14.747087  6088 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.748479  6134 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:14.773630  1677 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12.
W20260709 13:03:14.779398  6116 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:03:14.780505  5749 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.780759  6128 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:14.763477  6124 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.784068  6088 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.786916  6088 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.789189  6088 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.783233  5749 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.792933  5749 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:14.793707  6126 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:03:14.795805  6075 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.798194  5993 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.798925  6020 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:14.806334  5706 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.811304  5787 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.844746  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2156) took 3109 ms. Trace:
I20260709 13:03:14.845300  1675 rpcz_store.cc:276] 0709 13:03:11.735140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.735278 (+   138us) service_pool.cc:224] Handling call
0709 13:03:11.756420 (+ 21142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.846989 (+ 90569us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:12.193452 (+346463us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.508114 (+314662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.508173 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:12.508224 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.844387 (+2336163us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:14.844451 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.844634 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22677,"prepare.queue_time_us":429442,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":84062,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4110,"spinlock_wait_cycles":207659776,"thread_start_us":621718,"threads_started":2,"wal-append.queue_time_us":309118,"wal-append.run_cpu_time_us":1574,"wal-append.run_wall_time_us":1039540}
W20260709 13:03:14.853065  6043 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 2.262s	user 0.038s	sys 0.025s
I20260709 13:03:14.856108  5722 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:14.866032  5722 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:14.866207  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:14.867164  2211 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:14.839746  5840 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:14.868883  5840 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.871925  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:14.872316  6129 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.872828  6129 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.873209  5920 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:14.767132  6134 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.867128  5722 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.886118  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.886024  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.888304  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.888844  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.889529  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.889649  1678 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:14.890355  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.891067  1681 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:14.891292  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.891050  1678 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:14.897037  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.900681  1680 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:14.902019  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.902609  1683 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.905236  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.874521  6096 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:14.918130  1680 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:03:14.914265  6035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.325s	user 0.040s	sys 0.040s
I20260709 13:03:14.921886  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.923919  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.925258  6129 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.925287  6096 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:14.926793  6096 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:14.944630  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:14.945964  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.946877  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.927471  5921 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.938467  6134 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:14.942668  1676 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:14.955749  6113 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:14.959002  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:14.921955  6035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.333s	user 0.040s	sys 0.040s
I20260709 13:03:14.920485  5722 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.962075  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.963054  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.963783  1676 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.965076  1683 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:14.967444  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:14.969197  6111 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.498s	user 0.002s	sys 0.000s
I20260709 13:03:14.973410  1676 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:14.976135  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.977768  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.978729  1676 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.979051  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:14.979779  1680 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:14.980675  1683 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:14.988926  1675 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:14.993343  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:14.996331  6011 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 2.565s	user 0.024s	sys 0.050s
I20260709 13:03:14.997632  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:14.998517  1675 raft_consensus.cc:2410] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:15.009202  5795 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.010212  6039 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 2.414s	user 0.020s	sys 0.024s
I20260709 13:03:15.016067  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:15.017145  1683 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.029485  1676 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:15.035844  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:14.999788  5840 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.038825  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.016620  5795 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.101459  5840 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:15.104612  6086 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.105192  6086 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.105926  5795 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:15.107620  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.111815  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.115638  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:15.116289  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.116792  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.117522  1680 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:15.119109  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.119750  1529 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:15.114624  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.125440  1648 leader_election.cc:400] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:15.125794  1648 leader_election.cc:403] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:15.127977  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:15.130436  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.131094  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12.
I20260709 13:03:15.131762  1529 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:15.134048  1683 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:15.135504  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.133988  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.130234  5825 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:15.137964  1681 raft_consensus.cc:2410] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:03:15.121050  5795 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:15.133258  6088 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:15.133607  5776 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16.
I20260709 13:03:15.148020  6066 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:15.149230  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2200) took 1619 ms. Trace:
I20260709 13:03:15.152724  6115 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:15.154232  6125 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.590s	user 0.001s	sys 0.001s
I20260709 13:03:15.155346  1610 rpcz_store.cc:276] 0709 13:03:13.529390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.529520 (+   130us) service_pool.cc:224] Handling call
0709 13:03:13.552210 (+ 22690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.450499 (+898289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.148917 (+698418us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400309dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:15.149163 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045948672}
I20260709 13:03:15.158170  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.158859  1610 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.159225  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2136) took 1093 ms. Trace:
I20260709 13:03:15.159497  1610 rpcz_store.cc:276] 0709 13:03:14.065444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.157915 (+1092471us) service_pool.cc:224] Handling call
0709 13:03:15.159170 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.160858  6086 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:15.130991  6096 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:15.161880  6035 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:15.162410  6035 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.163616  6035 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.131795  5840 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:15.133484  6038 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.144652  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.172573  1526 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:15.173939  1529 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:15.141808  5795 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.165392  6035 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.179272  1529 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:03:15.182499  5691 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.184980  1535 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:15.189085  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2208) took 1632 ms. Trace:
I20260709 13:03:15.195304  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.137252  6139 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:03:15.189499  1601 rpcz_store.cc:276] 0709 13:03:13.557774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.570666 (+ 12892us) service_pool.cc:224] Handling call
0709 13:03:13.594095 (+ 23429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.594280 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:13.746131 (+151851us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.188587 (+1442456us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b1800435f40. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:15.188743 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.188792 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.188838 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.188919 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.189031 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111586,"prepare.queue_time_us":273239,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":5967232,"thread_start_us":233915,"threads_started":2,"wal-append.queue_time_us":255275,"wal-append.run_cpu_time_us":2196,"wal-append.run_wall_time_us":1147364}
I20260709 13:03:15.193445  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.188539  6113 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:15.203913  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.209311  6108 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:15.170979  6088 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.221683  1610 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.193914  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:15.221707  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.177382  5795 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.227506  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2141) took 1128 ms. Trace:
I20260709 13:03:15.227828  5840 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.228322  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:15.227905  1610 rpcz_store.cc:276] 0709 13:03:14.099085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.176171 (+1077086us) service_pool.cc:224] Handling call
0709 13:03:15.227443 (+ 51272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.233819  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:15.234772  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.225567  5920 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.237007  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.237598  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.245556  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.246205  1601 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:15.246682  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2129) took 1186 ms. Trace:
I20260709 13:03:15.246976  1601 rpcz_store.cc:276] 0709 13:03:14.060183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.231339 (+1171156us) service_pool.cc:224] Handling call
0709 13:03:15.246627 (+ 15288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.226462  6108 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.248678  1610 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:15.252861  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2130) took 1192 ms. Trace:
I20260709 13:03:15.253348  1610 rpcz_store.cc:276] 0709 13:03:14.060940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.229509 (+1168569us) service_pool.cc:224] Handling call
0709 13:03:15.252778 (+ 23269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.250495  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2222) took 1594 ms. Trace:
I20260709 13:03:15.254587  1602 rpcz_store.cc:276] 0709 13:03:13.655975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.900944 (+244969us) service_pool.cc:224] Handling call
0709 13:03:13.947935 (+ 46991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.951451 (+  3516us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:14.016739 (+ 65288us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.810398 (+793659us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b180036a900. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a
0709 13:03:15.249967 (+439569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.250049 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:15.250116 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.250211 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.250420 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":503027,"prepare.queue_time_us":98078,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":149329664,"thread_start_us":37270,"threads_started":1,"wal-append.queue_time_us":198331}
I20260709 13:03:15.258033  1529 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:15.235937  5840 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.243053  6115 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:15.264181  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.264947  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.265208  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.236752  5720 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:15.315774  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.321532  1602 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.316447  1601 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 10: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.311866  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.317436  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.318840  1527 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:03:15.317763  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 247) took 1569 ms. Trace:
I20260709 13:03:15.311925  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.324704  1533 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:15.318341  1610 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.306984  6115 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.307914  6108 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.331774  6108 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:15.331904  1574 connection.cc:256] RPC call timeout handler was delayed by -1.978422084999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:03:15.332579  1574 connection.cc:256] RPC call timeout handler was delayed by -1.9736934549999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:03:15.332899  1574 connection.cc:256] RPC call timeout handler was delayed by -1.954793455000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:03:15.333204  1574 connection.cc:256] RPC call timeout handler was delayed by -1.9396798639999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2779s for a response
W20260709 13:03:15.333495  1574 connection.cc:256] RPC call timeout handler was delayed by -1.9370220849999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:03:15.333968  1574 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.553s (SENT)
I20260709 13:03:15.334394  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:15.335145  5720 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:15.305783  6088 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.337721  5720 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:15.238909  5776 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:03:15.316258  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1740) took 1132 ms. Trace:
I20260709 13:03:15.339924  1530 rpcz_store.cc:276] 0709 13:03:14.184271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.184555 (+   284us) service_pool.cc:224] Handling call
0709 13:03:15.316015 (+1131460us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400319554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:15.316196 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615827328}
I20260709 13:03:15.341279  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.324252  1604 rpcz_store.cc:276] 0709 13:03:13.747922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.052969 (+305047us) service_pool.cc:224] Handling call
0709 13:03:14.065859 (+ 12890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.066076 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:14.128226 (+ 62150us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.317423 (+1189197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.317480 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:15.317526 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.317593 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.317706 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177709,"prepare.queue_time_us":79899,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":1175664,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":12954,"threads_started":1,"wal-append.queue_time_us":39888,"wal-append.run_cpu_time_us":1208,"wal-append.run_wall_time_us":1027859}
I20260709 13:03:15.343139  5810 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:15.343739  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.345216  1604 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:15.346657  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2146) took 1138 ms. Trace:
I20260709 13:03:15.347811  1604 rpcz_store.cc:276] 0709 13:03:14.208014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.343313 (+1135299us) service_pool.cc:224] Handling call
0709 13:03:15.346510 (+  3197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.343876  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.352253  5884 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:15.311292  6032 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.249670  6031 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:15.323225  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2139) took 1228 ms. Trace:
I20260709 13:03:15.323695  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2144) took 1221 ms. Trace:
W20260709 13:03:15.328540  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.325551  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.259930  6075 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:03:15.369825  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2219) took 1714 ms. Trace:
I20260709 13:03:15.381913  1602 rpcz_store.cc:276] 0709 13:03:14.094968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.266906 (+1171938us) service_pool.cc:224] Handling call
0709 13:03:15.323162 (+ 56256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.382256  1601 rpcz_store.cc:276] 0709 13:03:14.101898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.247605 (+1145707us) service_pool.cc:224] Handling call
0709 13:03:15.323621 (+ 76016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.373799  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.351583  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.385998  1533 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.386111  1604 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.384848  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.376572  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.387182  1610 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:15.387693  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2138) took 1293 ms. Trace:
I20260709 13:03:15.388319  1610 rpcz_store.cc:276] 0709 13:03:14.094128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.254265 (+1160137us) service_pool.cc:224] Handling call
0709 13:03:15.387636 (+133371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.388511  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.389377  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.389853  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.390491  1527 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:15.389930  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.390533  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2143) took 1289 ms. Trace:
I20260709 13:03:15.391413  1534 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:15.391360  1610 rpcz_store.cc:276] 0709 13:03:14.100893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.389142 (+1288249us) service_pool.cc:224] Handling call
0709 13:03:15.390480 (+  1338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.390595  1602 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:15.393352  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2142) took 1293 ms. Trace:
I20260709 13:03:15.393766  1529 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:15.393474  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67999.6us
I20260709 13:03:15.394366  1602 rpcz_store.cc:276] 0709 13:03:14.099992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.383493 (+1283501us) service_pool.cc:224] Handling call
0709 13:03:15.393291 (+  9798us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:15.354285  6082 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.546s	user 0.005s	sys 0.016s
I20260709 13:03:15.353237  6032 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.396669  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.398322  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:15.382349  1607 rpcz_store.cc:276] 0709 13:03:13.655165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.856421 (+201256us) service_pool.cc:224] Handling call
0709 13:03:13.874295 (+ 17874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.874508 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:14.041861 (+167353us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.323392 (+1281531us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.368671 (+ 45279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.368728 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.368778 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.368845 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.369764 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1253846,"prepare.queue_time_us":298811,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":1140945,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":21839,"thread_start_us":284876,"threads_started":3,"wal-append.queue_time_us":415178}
I20260709 13:03:15.354885  6115 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.401232  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:15.403914  6151 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:03:15.404528  6134 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.405009  6134 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.405239  5720 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:15.407277  6032 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.408393  6032 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.408859  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:15.410383  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:15.411139  1532 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:15.413332  6056 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.413820  6056 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:15.417711  1531 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:15.419864  6113 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.400766  5810 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:15.421283  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:15.421100  6113 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.396754  6086 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:15.422156  6086 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.422506  6086 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:15.424197  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 202556us
I20260709 13:03:15.424407  6096 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:15.425086  6096 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.426018  6096 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.426537  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.428529  5921 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.428409  6055 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:15.429109  5921 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.430079  5921 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.395480  6031 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.420164  5920 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.434636  5920 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.435218  6031 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:15.436371  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2206) took 1896 ms. Trace:
I20260709 13:03:15.427718  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.411176  2212 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:15.436789  1609 rpcz_store.cc:276] 0709 13:03:13.540243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.555480 (+ 15237us) service_pool.cc:224] Handling call
0709 13:03:13.585487 (+ 30007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.739118 (+153631us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:13.894373 (+155255us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.357560 (+1463187us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.363149 (+  5589us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.371956 (+  8807us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.372164 (+   208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:15.372205 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.372277 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.436163 (+ 63886us) raft_consensus.cc:1685] finished
0709 13:03:15.436185 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.436313 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177673,"prepare.queue_time_us":371898,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":1327708,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":16894,"spinlock_wait_cycles":3968,"thread_start_us":521422,"threads_started":4,"wal-append.queue_time_us":612689}
W20260709 13:03:15.438973  1573 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35640 dropped due to backpressure: service queue is full with 50 items [suppressed 4 similar messages]
I20260709 13:03:15.439226  6110 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:15.439847  6110 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:15.394774  6034 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:03:15.440577  6034 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.440958  6034 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:15.440764  6110 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.444213  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2131) took 1382 ms. Trace:
I20260709 13:03:15.445020  1602 rpcz_store.cc:276] 0709 13:03:14.061712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.395939 (+1334227us) service_pool.cc:224] Handling call
0709 13:03:15.444152 (+ 48213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.413880  1532 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:15.447929  1601 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:15.448836  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50606.3us
I20260709 13:03:15.401847  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2218) took 1747 ms. Trace:
I20260709 13:03:15.451471  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2132) took 1388 ms. Trace:
I20260709 13:03:15.452524  1601 rpcz_store.cc:276] 0709 13:03:14.062596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.392487 (+1329891us) service_pool.cc:224] Handling call
0709 13:03:15.451269 (+ 58782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.448927  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.454350  1604 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:15.455123  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2137) took 1364 ms. Trace:
W20260709 13:03:15.455495  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.455536  1604 rpcz_store.cc:276] 0709 13:03:14.090353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.350198 (+1259845us) service_pool.cc:224] Handling call
0709 13:03:15.455061 (+104863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.474030  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.477517  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:15.480819  1680 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:15.483775  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.486423  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:15.455724  1610 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:15.489576  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2147) took 1193 ms. Trace:
I20260709 13:03:15.490227  1610 rpcz_store.cc:276] 0709 13:03:14.296405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.392740 (+1096335us) service_pool.cc:224] Handling call
0709 13:03:15.489498 (+ 96758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.493351  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2217) took 1838 ms. Trace:
W20260709 13:03:15.493707  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 159765us
W20260709 13:03:15.494807  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.703s (SENT) [suppressed 16 similar messages]
I20260709 13:03:15.449836  1606 rpcz_store.cc:276] 0709 13:03:13.654882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.855081 (+200199us) service_pool.cc:224] Handling call
0709 13:03:13.855479 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.855735 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:14.033541 (+177806us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.401138 (+1367597us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.401487 (+   349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.401548 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:15.401595 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.401667 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.401791 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1117366,"prepare.queue_time_us":259504,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":1009297,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":16968,"spinlock_wait_cycles":8448,"thread_start_us":496050,"threads_started":3,"wal-append.queue_time_us":541965}
I20260709 13:03:15.449867  6060 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.446920  6134 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:15.498883  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.439327  1573 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35640 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2163)
I20260709 13:03:15.493768  1603 rpcz_store.cc:276] 0709 13:03:13.654591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.843100 (+188509us) service_pool.cc:224] Handling call
0709 13:03:13.866800 (+ 23700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.867132 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:13.928770 (+ 61638us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.448313 (+1519543us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.493036 (+ 44723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.493088 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:15.493130 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.493192 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.493298 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1269162,"prepare.queue_time_us":256663,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2619,"raft.queue_time_us":1292239,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":345222,"threads_started":4,"wal-append.queue_time_us":375695,"wal-append.run_cpu_time_us":1119,"wal-append.run_wall_time_us":1019179}
I20260709 13:03:15.525403  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.536796  1684 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:15.540453  1532 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:15.541488  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.542423  1603 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:15.545524  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2210) took 1976 ms. Trace:
I20260709 13:03:15.545902  1608 rpcz_store.cc:276] 0709 13:03:13.568964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.571771 (+  2807us) service_pool.cc:224] Handling call
0709 13:03:13.575695 (+  3924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.582863 (+  7168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.582899 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.589234 (+  6335us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.809396 (+1220162us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b180038eea0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1
0709 13:03:14.809568 (+   172us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:14.809630 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.809701 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.353742 (+544041us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:15.545308 (+191566us) raft_consensus.cc:1685] finished
0709 13:03:15.545328 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.545469 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184284,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":48447,"spinlock_wait_cycles":50460672,"thread_start_us":155242,"threads_started":1,"wal-append.queue_time_us":197201}
I20260709 13:03:15.508118  5976 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.548154  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68899.8us
I20260709 13:03:15.453694  5993 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:03:15.549786  1679 raft_consensus.cc:2410] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:15.508550  5884 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:15.514716  6088 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.553071  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:15.508340  6025 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:15.497355  6124 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:03:15.550544  6060 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:03:15.556088  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.494889  6129 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:15.494457  6031 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:03:15.562853  1608 raft_consensus.cc:2393] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 7: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:15.543908  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.565203  1603 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:15.565308  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.566157  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2128) took 1511 ms. Trace:
I20260709 13:03:15.566529  1608 rpcz_store.cc:276] 0709 13:03:14.055166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.553992 (+1498826us) service_pool.cc:224] Handling call
0709 13:03:15.566110 (+ 12118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.568953  6086 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.572021  6086 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:15.579656  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.580964  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 86195.3us
W20260709 13:03:15.589461  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.592453  1574 leader_election.cc:336] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.734s (SENT)
I20260709 13:03:15.544946  6095 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:03:15.593451  1533 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:15.602386  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:15.602712  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.603826  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.603856  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.604619  1533 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:15.606505  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.578230  5749 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:15.608165  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2209) took 2046 ms (client timeout 2227 ms). Trace:
I20260709 13:03:15.562177  6020 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:15.617432  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:15.618624  1605 rpcz_store.cc:269] 0709 13:03:13.561346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.568360 (+  7014us) service_pool.cc:224] Handling call
0709 13:03:15.607946 (+2039586us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400172ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:15.608097 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400287616}
I20260709 13:03:15.617395  1648 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:15.560606  5884 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.622932  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.624161  1648 leader_election.cc:403] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:15.561241  5976 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.626076  1534 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:03:15.626463  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.627760  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.619380  6163 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:15.630692  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49139.2us
W20260709 13:03:15.631249  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7966220849999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:03:15.563589  6088 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.629266  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.623749  1603 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:15.631917  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7817932169999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:03:15.636194  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7345220849999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:03:15.636550  1574 connection.cc:256] RPC call timeout handler was delayed by -1.6634220849999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:03:15.625577  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.634636  1534 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:15.632853  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.621181  5749 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.632650  1531 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:15.577412  6025 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.639289  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:15.641716  1574 connection.cc:256] RPC call timeout handler was delayed by -1.5554220849999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:03:15.642611  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:15.642872  1574 connection.cc:256] RPC call timeout handler was delayed by -1.4885238930000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 13:03:15.637512  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:15.643251  1605 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:15.643296  1574 connection.cc:256] RPC call timeout handler was delayed by -1.4203798639999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3356s for a response
I20260709 13:03:15.624675  6086 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.588397  5795 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.647115  1608 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
W20260709 13:03:15.747700  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62260.4us
W20260709 13:03:15.849153  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45189.1us
W20260709 13:03:15.719568  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.815665  1682 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:15.751276  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.827479  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.925458  1609 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.928578  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.630722  6163 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:15.743271  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0601591220000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:03:15.946153  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.947407  1605 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:15.627381  6020 consensus_queue.cc:1243] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:15.634320  6060 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:15.733068  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:15.825865  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.748317  6092 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.757674  6035 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:03:15.636088  6134 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.896955  6168 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:03:15.946775  1574 connection.cc:256] RPC call timeout handler was delayed by -1.0142591219999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:03:15.806732  6161 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:03:15.972707  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:15.847113  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.752929  6068 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.828900  5810 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.981237  5810 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:15.982177  5810 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.983122  5810 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.897084  5691 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.954126  1526 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:15.895784  5720 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.984290  5691 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.984567  5720 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.640365  6120 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.959127  1602 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:15.870658  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:15.794730  5840 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.986512  5840 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:15.986771  5691 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:15.987398  5840 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.987908  5720 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:15.988793  5840 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.991099  6034 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.991641  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:15.956733  1534 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:15.993000  1534 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:15.993755  6170 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.353s	user 0.000s	sys 0.003s
I20260709 13:03:15.994233  1534 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:15.995616  1534 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:03:16.000214  6068 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:16.002821  6167 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:03:16.002902  6068 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:16.008620  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:15.995925  1534 pending_rounds.cc:85] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:15.955497  6096 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:15.897279  6086 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.799214  6153 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:15.964960  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.810268  5884 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:15.955303  5921 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.804270  6066 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.158s
I20260709 13:03:16.024451  1605 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:16.029346  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50950 (request call id 225) took 1296 ms. Trace:
I20260709 13:03:15.978315  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:15.979007  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.644173  5749 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.016273  1534 pending_rounds.cc:107] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:03:16.031849  1534 raft_consensus.cc:2889] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.019711  1603 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:16.021910  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:16.025655  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.026417  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.029871  1677 rpcz_store.cc:276] 0709 13:03:14.724237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.724384 (+   147us) service_pool.cc:224] Handling call
0709 13:03:16.019589 (+1295205us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54002e8bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:16.019706 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110806272}
I20260709 13:03:16.041787  5921 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:16.048919  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.052747  2178 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:16.054279  5884 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.054425  6066 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:16.057448  6066 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:16.058480  6088 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.058432  6066 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.027292  6086 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.036087  6034 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.060791  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:16.063625  6066 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.973978  6134 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.053853  6060 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.262709  6060 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.264106  6134 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.056591  6110 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.264751  6110 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:16.265187  6110 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.066280  5882 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.029134  6096 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:15.985849  6120 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.032212  6153 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:15.967545  6092 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.116292  6166 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:16.118574  1684 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:16.122154  1675 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:16.123471  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 329227us
I20260709 13:03:16.043215  6163 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.101778  6025 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.271201  6110 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.271350  5882 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.292136  5882 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.293215  6110 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:16.294155  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 315936us
I20260709 13:03:16.295559  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.264775  6060 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.105361  6020 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.296840  6020 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:16.299033  6020 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.273002  6096 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.274574  6120 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.277374  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:16.301538  1609 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:16.301620  6025 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:16.302073  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.286778  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.279163  6153 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:16.303159  6153 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.303478  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.303880  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.287564  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.304828  1675 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:16.305168  1574 leader_election.cc:400] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 6 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 6. Current term is 7.
I20260709 13:03:16.305757  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.305976  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.306459  1675 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:16.307265  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.308245  6034 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.308327  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:16.309592  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.309671  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.310729  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.311290  1675 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 10.
I20260709 13:03:16.280848  6092 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.244652  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.165499  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:16.410797  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 245400us
I20260709 13:03:16.411648  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:16.238765  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:16.412483  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 173772us
I20260709 13:03:16.413781  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:16.414980  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:16.241839  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:16.416368  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:16.416903  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2150) took 1159 ms. Trace:
I20260709 13:03:16.417240  1601 rpcz_store.cc:276] 0709 13:03:15.257466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.241510 (+984044us) service_pool.cc:224] Handling call
0709 13:03:16.416840 (+175330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.418452  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:15.956737  1575 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35646 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2252)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2174)
I20260709 13:03:16.421561  1575 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35646 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2252)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2174)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2256)
W20260709 13:03:16.165778  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.197081  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:17.474828  1676 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:17.475322  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1824) took 1352 ms (client timeout 1632 ms). Trace:
I20260709 13:03:16.255615  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.477317  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1832) took 1351 ms. Trace:
I20260709 13:03:17.477679  1679 rpcz_store.cc:276] 0709 13:03:16.125839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.255233 (+129394us) service_pool.cc:224] Handling call
0709 13:03:17.477257 (+1222024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.479053  1679 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:16.147943  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:16.302060  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2240) took 1098 ms. Trace:
I20260709 13:03:17.481144  1609 rpcz_store.cc:276] 0709 13:03:15.204135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.277045 (+1072910us) service_pool.cc:224] Handling call
0709 13:03:16.301999 (+ 24954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.481165  1681 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:17.482090  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1825) took 1358 ms (client timeout 1542 ms). Trace:
W20260709 13:03:17.482368  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2250) took 1682 ms (client timeout 1543 ms). Trace:
I20260709 13:03:16.147696  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:16.326094  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:17.475687  1676 rpcz_store.cc:269] 0709 13:03:16.123267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.196807 (+ 73540us) service_pool.cc:224] Handling call
0709 13:03:17.475259 (+1278452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.484344  1677 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
W20260709 13:03:17.484395  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 1.15831e+06us
W20260709 13:03:17.484941  1648 connection.cc:256] RPC call timeout handler was delayed by -1.2057263059999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:03:17.485019  1677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1828) took 1360 ms (client timeout 1524 ms). Trace:
I20260709 13:03:16.135219  5795 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:16.302062  6025 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:16.151901  6032 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.003s
W20260709 13:03:16.169906  6115 consensus_meta.cc:287] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.675s	user 0.016s	sys 0.001s
I20260709 13:03:17.611908  6115 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.613317  1680 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:17.614454  6115 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.171973  5749 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.618186  5749 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.319797  6034 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.167218  6086 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:17.630903  6086 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:16.308245  6066 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.632989  1682 raft_consensus.cc:2368] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13.
W20260709 13:03:17.634488  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1823) took 1511 ms (client timeout 1765 ms). Trace:
W20260709 13:03:17.634899  1682 rpcz_store.cc:269] 0709 13:03:16.122956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.244418 (+121462us) service_pool.cc:224] Handling call
0709 13:03:17.634250 (+1389832us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002e8bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:17.634420 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811706624}
I20260709 13:03:16.303493  6153 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.637217  6153 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:16.258832  6158 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.681s	user 0.002s	sys 0.000s
W20260709 13:03:16.149935  6172 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:03:16.240281  6176 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.644984  6176 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.647260  6176 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:16.285812  6166 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.650046  6166 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:17.650868  1676 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:03:16.419653  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.652318  1601 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.426716  1575 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35646 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2224)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2228)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 249)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2252)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2174)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2256)
I20260709 13:03:16.433436  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:16.444833  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2013) took 1218 ms (client timeout 1573 ms). Trace:
I20260709 13:03:16.473896  6088 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.662037  6088 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.489208  6139 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.555294  6091 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:17.661953  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 1.22848e+06us
I20260709 13:03:17.663174  6091 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:17.663862  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1833) took 1537 ms. Trace:
I20260709 13:03:17.664541  1676 rpcz_store.cc:276] 0709 13:03:16.126098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.484189 (+1358091us) service_pool.cc:224] Handling call
0709 13:03:17.484492 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.651269 (+166777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.663620 (+ 12351us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:17.663801 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381764992}
I20260709 13:03:17.664469  6091 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:16.624691  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.625252  6184 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.670377  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:16.979542  6171 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:17.227192  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.729s	user 0.017s	sys 0.030s
W20260709 13:03:17.671552  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.174s	user 0.017s	sys 0.031s
I20260709 13:03:17.671479  6171 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:17.672235  6171 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:17.238421  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2229) took 2044 ms (client timeout 1546 ms). Trace:
W20260709 13:03:17.253208  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 962549us
W20260709 13:03:17.335083  1631 debug-util.cc:398] Leaking SignalData structure 0x7b0800212a60 after lost signal to thread 431
I20260709 13:03:17.384016  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.675269  1604 rpcz_store.cc:269] 0709 13:03:15.193928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.238184 (+2044256us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.238328 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:17.433069  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2153) took 2106 ms (client timeout 1744 ms). Trace:
W20260709 13:03:17.446516  6180 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.323s	user 0.000s	sys 0.019s
I20260709 13:03:17.675990  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1835) took 1549 ms. Trace:
I20260709 13:03:17.676927  6184 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.677064  1675 rpcz_store.cc:276] 0709 13:03:16.126746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.311862 (+185116us) service_pool.cc:224] Handling call
0709 13:03:17.675913 (+1364051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.677474  6139 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:17.677754  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3597059679999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:03:17.678074  6139 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.678501  1675 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:17.457087  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.009s	sys 0.017s
I20260709 13:03:17.679217  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1838) took 1550 ms. Trace:
W20260709 13:03:17.679584  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.009s	sys 0.017s
W20260709 13:03:17.661573  1526 rpcz_store.cc:269] 0709 13:03:15.226225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.226337 (+   112us) service_pool.cc:224] Handling call
0709 13:03:16.444637 (+1218300us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54000f7154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:16.444775 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652365184}
W20260709 13:03:17.458875  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2246) took 2250 ms (client timeout 2090 ms). Trace:
W20260709 13:03:17.680814  1605 rpcz_store.cc:269] 0709 13:03:15.208150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.458666 (+2250516us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.458801 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.681293  6034 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.681595  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2164) took 2243 ms (client timeout 1982 ms). Trace:
W20260709 13:03:17.681983  1605 rpcz_store.cc:269] 0709 13:03:15.438080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.681438 (+2243358us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.681529 (+    91us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.681856  6034 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:17.682883  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2152) took 2380 ms (client timeout 2124 ms). Trace:
W20260709 13:03:17.683207  1605 rpcz_store.cc:269] 0709 13:03:15.302839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.682748 (+2379909us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.682836 (+    88us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.683590  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:17.461160  5882 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 1.169s	user 0.021s	sys 0.001s
W20260709 13:03:17.462893  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.482625  1681 rpcz_store.cc:269] 0709 13:03:16.123502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.147706 (+ 24204us) service_pool.cc:224] Handling call
0709 13:03:17.482028 (+1334322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.684274  5882 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:17.479847  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1831) took 1354 ms. Trace:
W20260709 13:03:17.684973  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.685178  1679 rpcz_store.cc:276] 0709 13:03:16.125505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.478527 (+1353022us) service_pool.cc:224] Handling call
0709 13:03:17.478866 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.479404 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.479778 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.686322  1679 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.687117  6088 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:17.687359  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.485781  1648 connection.cc:256] RPC call timeout handler was delayed by -1.0032263059999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:03:17.687706  6088 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.689898  6066 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:17.690380  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.690537  6066 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:17.690802  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.690966  6066 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:17.691435  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.485594  1677 rpcz_store.cc:269] 0709 13:03:16.124259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.138977 (+ 14718us) service_pool.cc:224] Handling call
0709 13:03:17.484954 (+1345977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.692268  6134 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.691368  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.692689  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.692812  6134 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.693341  1677 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:03:17.678109  1647 connection.cc:256] RPC call timeout handler was delayed by -1.3048493739999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:03:17.487895  6092 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.693843  6166 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:17.683933  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2157) took 2247 ms (client timeout 2165 ms). Trace:
I20260709 13:03:17.489957  5884 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:17.676399  1602 rpcz_store.cc:269] 0709 13:03:15.326821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.432826 (+2106005us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.432996 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.694499  6166 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:16.290814  6129 consensus_queue.cc:1175] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 15 status { last_received { term: 15 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 15 index: 7 } }
W20260709 13:03:17.496510  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.695199  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2166) took 2150 ms (client timeout 2086 ms). Trace:
I20260709 13:03:17.684932  1681 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:17.509470  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2127) took 3455 ms (client timeout 2741 ms). Trace:
W20260709 13:03:17.513866  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2225) took 2322 ms (client timeout 1505 ms). Trace:
W20260709 13:03:17.696214  1610 rpcz_store.cc:269] 0709 13:03:14.053886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.509169 (+3455283us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.509364 (+   195us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:17.696628  1606 rpcz_store.cc:269] 0709 13:03:15.191410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.513606 (+2322196us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.513779 (+   173us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:17.697201  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2223) took 2506 ms (client timeout 2479 ms). Trace:
I20260709 13:03:17.512665  6118 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.697902  1605 rpcz_store.cc:269] 0709 13:03:15.436302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.683796 (+2247494us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.683886 (+    90us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:17.549510  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.500s	user 0.004s	sys 0.008s
I20260709 13:03:17.552403  6068 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:17.554468  6173 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.557113  6165 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.723457  6165 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.690023  5882 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:17.724606  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:17.576485  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2236) took 2378 ms (client timeout 1805 ms). Trace:
I20260709 13:03:17.725014  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.579188  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.725626  6165 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:17.587447  5921 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:17.574462  6178 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.453s	user 0.013s	sys 0.001s
W20260709 13:03:17.591207  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 55) took 11751 ms (client timeout 15000 ms). Trace:
I20260709 13:03:17.725885  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.592829  6025 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.726718  1528 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:17.601272  1432 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.615914  1678 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:17.615324  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1821) took 2132 ms (client timeout 2528 ms). Trace:
I20260709 13:03:17.643749  6056 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:17.675606  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab3e0 after lost signal to thread 434
W20260709 13:03:17.394994  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2239) took 2192 ms (client timeout 1580 ms). Trace:
I20260709 13:03:17.690069  6088 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:17.482803  1609 rpcz_store.cc:269] 0709 13:03:15.800563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.482191 (+1681628us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.482307 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.485852  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:17.694918  6134 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:17.514974  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2162) took 2077 ms (client timeout 1782 ms). Trace:
W20260709 13:03:17.697563  1610 rpcz_store.cc:269] 0709 13:03:15.191059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.697057 (+2505998us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.697151 (+    94us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:17.693931  1647 connection.cc:256] RPC call timeout handler was delayed by -1.2877059679999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:03:17.530467  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2023) took 2217 ms (client timeout 1580 ms). Trace:
I20260709 13:03:17.664405  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:17.676260  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2168) took 2119 ms (client timeout 1845 ms). Trace:
W20260709 13:03:17.695583  1602 rpcz_store.cc:269] 0709 13:03:15.544611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.695030 (+2150419us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.695140 (+   110us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.697597  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.696223  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1839) took 1564 ms. Trace:
I20260709 13:03:17.679594  1675 rpcz_store.cc:276] 0709 13:03:16.128798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.677949 (+1549151us) service_pool.cc:224] Handling call
0709 13:03:17.678281 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.678973 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.679163 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:17.707388  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.658s	user 0.004s	sys 0.008s
I20260709 13:03:17.696477  6129 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.721648  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:17.799126  1532 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.710031  5776 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:03:17.626266  5976 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:17.671072  1601 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:03:17.804121  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2149) took 2559 ms (client timeout 1906 ms). Trace:
I20260709 13:03:17.804343  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:17.804620  1601 rpcz_store.cc:269] 0709 13:03:15.245141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.419398 (+1174257us) service_pool.cc:224] Handling call
0709 13:03:17.804048 (+1384650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.805377  1610 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:17.729291  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2226) took 1625 ms. Trace:
I20260709 13:03:17.725709  1605 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
W20260709 13:03:17.806051  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.806558  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2170) took 2249 ms (client timeout 2282 ms). Trace:
W20260709 13:03:17.806964  1605 rpcz_store.cc:269] 0709 13:03:15.557349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.724738 (+2167389us) service_pool.cc:224] Handling call
0709 13:03:17.806503 (+ 81765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.732681  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:17.808167  1677 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:17.809134  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.809315  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1885805739999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:03:17.809718  1647 connection.cc:256] RPC call timeout handler was delayed by -1.1570313020000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 13:03:17.809866  1677 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:17.740073  1680 rpcz_store.cc:269] 0709 13:03:15.483295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.483482 (+   187us) service_pool.cc:224] Handling call
0709 13:03:17.615023 (+2131541us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54003cd2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:17.615249 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4894987648}
I20260709 13:03:17.811652  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.812465  1609 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:03:17.725960  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1760) took 2290 ms (client timeout 2165 ms). Trace:
W20260709 13:03:17.813863  1527 rpcz_store.cc:269] 0709 13:03:15.435770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.578817 (+2143047us) service_pool.cc:224] Handling call
0709 13:03:17.725881 (+147064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.814575  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:17.815064  1527 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:17.725268  1608 rpcz_store.cc:269] 0709 13:03:15.198246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.619090 (+420844us) service_pool.cc:224] Handling call
0709 13:03:17.576252 (+1957162us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b5400171bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:17.576391 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18292480}
W20260709 13:03:17.780809  1603 rpcz_store.cc:269] 0709 13:03:15.437569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.514770 (+2077201us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.514899 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.816275  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.817189  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.806185  1678 rpcz_store.cc:276] 0709 13:03:16.104053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.104188 (+   135us) service_pool.cc:224] Handling call
0709 13:03:17.615724 (+1511536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.728108 (+112384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.729098 (+   990us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003cd2d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:17.729225 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3475263744}
I20260709 13:03:17.818336  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.781031  1535 rpcz_store.cc:269] 0709 13:03:15.312599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.317211 (+  4612us) service_pool.cc:224] Handling call
0709 13:03:17.530209 (+2212998us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54000ddc54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:17.530345 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481507072}
I20260709 13:03:17.781745  1606 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
W20260709 13:03:17.820200  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2158) took 2383 ms (client timeout 2344 ms). Trace:
W20260709 13:03:17.726413  1433 rpcz_store.cc:269] 0709 13:03:05.840269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.840425 (+   156us) service_pool.cc:224] Handling call
0709 13:03:17.591104 (+11750679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:12.070740 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:12.209553 (+138813us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:12.222192 (+ 12639us) write_op.cc:435] Acquired schema lock
0709 13:03:12.229211 (+  7019us) tablet.cc:662] Decoding operations
0709 13:03:12.276765 (+ 47554us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:12.276839 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:12.276876 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:12.277274 (+   398us) tablet.cc:701] Row locks acquired
0709 13:03:12.277326 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:03:12.277582 (+   256us) write_op.cc:270] Start()
0709 13:03:12.277719 (+   137us) write_op.cc:276] Timestamp: P: 1783602192277463 usec, L: 0
0709 13:03:12.277742 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:12.278519 (+   777us) log.cc:844] Serialized 1364 byte log entry
0709 13:03:14.851781 (+2573262us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:15.002611 (+150830us) op_driver.cc:464] REPLICATION: finished
0709 13:03:15.162766 (+160155us) write_op.cc:301] APPLY: starting
0709 13:03:15.162889 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:15.163252 (+   363us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:15.163288 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:15.163653 (+   365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:15.163908 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:03:15.163981 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:15.164307 (+   326us) log.cc:844] Serialized 34 byte log entry
0709 13:03:15.164497 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.164598 (+   101us) write_op.cc:454] Released schema lock
0709 13:03:15.164664 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:15.165096 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.165122 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":193866,"reported_tablets":5,"spinlock_wait_cycles":372480,"child_traces":[["op",{"apply.queue_time_us":140005,"apply.run_cpu_time_us":2316,"apply.run_wall_time_us":2317,"num_ops":3,"prepare.queue_time_us":628442,"prepare.run_cpu_time_us":17705,"prepare.run_wall_time_us":400583,"raft.queue_time_us":147778,"raft.run_cpu_time_us":55754,"raft.run_wall_time_us":110734,"replication_time_us":2724645,"spinlock_wait_cycles":129198976,"thread_start_us":864831,"threads_started":4,"wal-append.queue_time_us":311480,"wal-append.run_cpu_time_us":87865,"wal-append.run_wall_time_us":3590103}]]}
I20260709 13:03:17.808252  1432 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.821395  1679 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:03:17.782364  1604 rpcz_store.cc:269] 0709 13:03:15.556780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.676104 (+2119324us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.676204 (+   100us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.782596  1681 rpcz_store.cc:276] 0709 13:03:16.132258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.684515 (+1552257us) service_pool.cc:224] Handling call
0709 13:03:17.684775 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.695822 (+ 11047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.696166 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.708321  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:17.823150  2212 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
W20260709 13:03:17.782052  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117722us
W20260709 13:03:17.823457  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2238) took 2622 ms (client timeout 2700 ms). Trace:
I20260709 13:03:17.824170  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:17.825817  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:17.784914  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 299111us
I20260709 13:03:17.828087  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:17.792074  1607 rpcz_store.cc:269] 0709 13:03:15.202736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.394740 (+2192004us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:17.394890 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:17.796911  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.797006  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.829712  1531 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:17.797206  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2224) took 2339 ms. Trace:
I20260709 13:03:17.830884  1683 rpcz_store.cc:276] 0709 13:03:15.457878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.458037 (+   159us) service_pool.cc:224] Handling call
0709 13:03:15.509092 (+ 51055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.633326 (+124234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.633356 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.636240 (+  2884us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.081747 (+445507us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:16.081803 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.081911 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.568413 (+1486502us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:17.729884 (+161471us) raft_consensus.cc:1685] finished
0709 13:03:17.729902 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.797121 (+ 67219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5776,"raft.queue_time_us":30445,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6278,"spinlock_wait_cycles":17694976,"thread_start_us":452482,"threads_started":2,"wal-append.queue_time_us":419563}
I20260709 13:03:17.722676  1529 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:17.727782  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.833576  1528 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:17.819145  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.806212  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2155) took 2411 ms (client timeout 2479 ms). Trace:
W20260709 13:03:17.835085  1610 rpcz_store.cc:269] 0709 13:03:15.395140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.783552 (+2388412us) service_pool.cc:224] Handling call
0709 13:03:17.806081 (+ 22529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.711879  6166 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:17.857717  1678 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:17.857780  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.796593  5921 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.712834  6034 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:17.820580  1606 rpcz_store.cc:269] 0709 13:03:15.436562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.697329 (+2260767us) service_pool.cc:224] Handling call
0709 13:03:17.820130 (+122801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.863392  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:17.836592  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.842332  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:17.852340  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:17.863654  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:17.868382  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 198063us
I20260709 13:03:17.869441  1683 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:17.783962  1631 debug-util.cc:398] Leaking SignalData structure 0x7b0800163a80 after lost signal to thread 1467
I20260709 13:03:17.854835  6110 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:17.824003  1609 rpcz_store.cc:269] 0709 13:03:15.201398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.785720 (+2584322us) service_pool.cc:224] Handling call
0709 13:03:17.823402 (+ 37682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.729928  6106 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:03:17.800217  6068 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.708287  6139 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:17.796998  6184 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.791792  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.885587  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:17.860986  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.886761  1604 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:03:17.887359  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2259) took 1463 ms (client timeout 1813 ms). Trace:
I20260709 13:03:17.865295  1535 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:17.888891  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:17.889576  1535 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.853667  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:17.890708  1680 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.870060  1678 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:17.820063  6056 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.708588  6118 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:17.871855  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2900 after lost signal to thread 1559
I20260709 13:03:17.871920  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:17.780066  6086 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:03:17.873456  1681 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:17.867604  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.897794  1602 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
W20260709 13:03:17.886220  1501 connection.cc:256] RPC call timeout handler was delayed by -1.1886933480000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:03:17.898193  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2243) took 2691 ms (client timeout 2827 ms). Trace:
W20260709 13:03:17.898598  1602 rpcz_store.cc:269] 0709 13:03:15.206547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.821908 (+2615361us) service_pool.cc:224] Handling call
0709 13:03:17.898141 (+ 76233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:17.874486  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161653us
I20260709 13:03:17.875593  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.899299  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.899700  1608 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.861065  6088 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.796666  6115 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:03:17.887781  1604 rpcz_store.cc:269] 0709 13:03:16.423949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.860721 (+1436772us) service_pool.cc:224] Handling call
0709 13:03:17.887198 (+ 26477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.906723  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.910123  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.911036  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
I20260709 13:03:17.913378  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:17.895088  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4ec0 after lost signal to thread 1634
I20260709 13:03:17.865759  5921 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:17.742815  6173 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.901628  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:17.916868  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4cc0 after lost signal to thread 1635
I20260709 13:03:17.926214  1528 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:17.926421  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:17.875319  5776 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.899936  1607 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 11.
I20260709 13:03:17.930676  1528 pending_rounds.cc:85] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:17.931183  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56314 (request call id 250) took 2137 ms. Trace:
I20260709 13:03:17.917681  1532 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:17.931389  1528 pending_rounds.cc:107] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:17.806509  6129 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.883538  6068 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.914330  1529 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:17.924211  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52410.2us
W20260709 13:03:17.926959  1631 debug-util.cc:398] Leaking SignalData structure 0x7b080034ada0 after lost signal to thread 1708
W20260709 13:03:17.935743  1631 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0c40 after lost signal to thread 1709
W20260709 13:03:17.936980  1631 debug-util.cc:398] Leaking SignalData structure 0x7b080032e280 after lost signal to thread 2236
I20260709 13:03:17.907665  1601 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:17.903064  1432 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 11, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:17.933393  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:17.922349  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.937682  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2258) took 1516 ms. Trace:
I20260709 13:03:17.938362  1610 raft_consensus.cc:2410] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:17.938175  1601 rpcz_store.cc:276] 0709 13:03:16.421311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.906391 (+1485080us) service_pool.cc:224] Handling call
0709 13:03:17.937626 (+ 31235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:17.937265  1631 debug-util.cc:398] Leaking SignalData structure 0x7b080029afa0 after lost signal to thread 2237
I20260709 13:03:17.939056  1607 rpcz_store.cc:276] 0709 13:03:15.793773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.899047 (+2105274us) service_pool.cc:224] Handling call
0709 13:03:17.931128 (+ 32081us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:17.940630  1631 debug-util.cc:398] Leaking SignalData structure 0x7b0800265e20 after lost signal to thread 6133
I20260709 13:03:17.937171  1530 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:17.942572  1528 raft_consensus.cc:2889] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.944434  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.945118  1609 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:17.945736  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2232) took 2748 ms. Trace:
I20260709 13:03:17.946098  1610 rpcz_store.cc:276] 0709 13:03:15.196993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.922096 (+2725103us) service_pool.cc:224] Handling call
0709 13:03:17.945676 (+ 23580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.896894  6139 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.903360  6166 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.952180  1535 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:03:17.949016  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93640.5us
I20260709 13:03:17.953634  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:17.955987  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2151) took 2692 ms (client timeout 3290 ms). Trace:
W20260709 13:03:17.956843  1609 rpcz_store.cc:269] 0709 13:03:15.263986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.918493 (+2654507us) service_pool.cc:224] Handling call
0709 13:03:17.955904 (+ 37411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.956401  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.958520  1532 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:17.959002  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:17.960393  1608 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:17.956453  1605 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 9.
I20260709 13:03:17.918874  5976 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.918645  6088 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:17.904139  6120 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:17.933589  6162 raft_consensus.cc:2764] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:03:17.958863  1607 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:17.963083  1676 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:17.968350  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2254) took 1547 ms (client timeout 1859 ms). Trace:
I20260709 13:03:17.967820  1680 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:17.971092  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.878847  6153 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.925334  5921 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.902985  6184 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:17.941443  6068 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:17.981494  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45544.4us
I20260709 13:03:17.994577  1606 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:17.994927  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.977710  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.983736  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:17.944244  5776 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.050963  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.993095  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:17.991948  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:18.056906  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2167) took 2502 ms. Trace:
I20260709 13:03:18.057607  1605 rpcz_store.cc:276] 0709 13:03:15.554283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.991625 (+2437342us) service_pool.cc:224] Handling call
0709 13:03:18.056821 (+ 65196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.059885  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:17.984145  1608 rpcz_store.cc:269] 0709 13:03:16.420593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.861280 (+1440687us) service_pool.cc:224] Handling call
0709 13:03:17.968281 (+107001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.984543  1602 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.985242  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1836) took 1858 ms. Trace:
I20260709 13:03:18.063635  1676 rpcz_store.cc:276] 0709 13:03:16.126919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.665909 (+1538990us) service_pool.cc:224] Handling call
0709 13:03:17.666236 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.984204 (+317968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.984966 (+   762us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002ea4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:17.985176 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681925376}
I20260709 13:03:18.028234  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:18.066036  1604 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:18.069564  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 170121us
W20260709 13:03:18.072912  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.012393  2176 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.034499  1432 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.079843  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 248) took 4321 ms. Trace:
I20260709 13:03:18.080583  1610 rpcz_store.cc:276] 0709 13:03:13.758695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.079056 (+4320361us) service_pool.cc:224] Handling call
0709 13:03:18.079365 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.079528 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.079567 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.079613 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:18.079642 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.079692 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.079791 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.071342  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:17.975741  6088 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.083380  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 85688us
W20260709 13:03:18.083820  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.087677  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.037606  6035 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:18.050976  5884 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:17.973436  5795 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:03:18.094283  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:17.981971  6199 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.013042  6163 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.090057  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:18.098160  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 126475us
I20260709 13:03:18.106091  1603 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:18.106727  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2145) took 4003 ms. Trace:
I20260709 13:03:18.107029  1603 rpcz_store.cc:276] 0709 13:03:14.103155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.105355 (+4002200us) service_pool.cc:224] Handling call
0709 13:03:18.105860 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.106498 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.106679 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.095009  1610 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:18.108891  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2134) took 4044 ms. Trace:
I20260709 13:03:18.109225  1610 rpcz_store.cc:276] 0709 13:03:14.064152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.084215 (+4020063us) service_pool.cc:224] Handling call
0709 13:03:18.084630 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.108645 (+ 24015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.108838 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:17.972458  6166 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:18.100660  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 175096us
I20260709 13:03:17.970472  6139 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.113431  1605 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:03:18.036921  6118 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.112864  1527 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:18.114341  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2140) took 4018 ms. Trace:
I20260709 13:03:18.130087  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2148) took 3833 ms. Trace:
W20260709 13:03:18.119516  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.132987  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2224) took 2941 ms. Trace:
W20260709 13:03:18.121642  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 198672us
I20260709 13:03:18.046039  6177 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:03:18.139532  1605 rpcz_store.cc:276] 0709 13:03:14.098209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.092179 (+3993970us) service_pool.cc:224] Handling call
0709 13:03:18.113169 (+ 20990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.113999 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.114268 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.085105  5882 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:18.141606  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70351us
I20260709 13:03:18.085207  6034 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.995635  6120 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:18.143778  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2169) took 2586 ms (client timeout 2883 ms). Trace:
I20260709 13:03:18.140640  1610 rpcz_store.cc:276] 0709 13:03:15.191245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.132002 (+2940757us) service_pool.cc:224] Handling call
0709 13:03:18.132318 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.132676 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.132706 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.132746 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:18.132774 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.132829 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.132938 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.140331  1603 rpcz_store.cc:276] 0709 13:03:14.296878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.128830 (+3831952us) service_pool.cc:224] Handling call
0709 13:03:18.129364 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.129608 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.129667 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.129714 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:18.129767 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.129840 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.130009 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.122993  1604 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:03:18.149152  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.174014  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2227) took 2982 ms. Trace:
I20260709 13:03:18.175695  1609 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:18.205549  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:18.206455  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2228) took 3014 ms. Trace:
I20260709 13:03:18.206940  1603 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:03:18.204979  1608 rpcz_store.cc:276] 0709 13:03:15.191705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.172964 (+2981259us) service_pool.cc:224] Handling call
0709 13:03:18.173358 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.173580 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.173619 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.173673 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:18.173719 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.173787 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.173930 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.207911  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2235) took 3010 ms. Trace:
I20260709 13:03:18.206993  1609 rpcz_store.cc:276] 0709 13:03:15.192478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.174898 (+2982420us) service_pool.cc:224] Handling call
0709 13:03:18.175385 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.206114 (+ 30729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.206388 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.208431  1603 rpcz_store.cc:276] 0709 13:03:15.197947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.206401 (+3008454us) service_pool.cc:224] Handling call
0709 13:03:18.206732 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.207674 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.207860 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.095398  6092 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:18.210187  1606 rpcz_store.cc:269] 0709 13:03:15.557085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.863344 (+2306259us) service_pool.cc:224] Handling call
0709 13:03:18.143606 (+280262us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540003d9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:18.143725 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293979392}
I20260709 13:03:18.145947  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
W20260709 13:03:18.211261  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 117057us
I20260709 13:03:18.097836  6035 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:18.097167  5884 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:18.213930  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:18.212708  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47102.8us
I20260709 13:03:18.222579  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:18.192590  6106 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.163403  1432 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 4 to 7, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 7 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.218369  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2241) took 3007 ms. Trace:
I20260709 13:03:18.236143  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.236577  1608 rpcz_store.cc:276] 0709 13:03:15.205272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.209894 (+3004622us) service_pool.cc:224] Handling call
0709 13:03:18.211480 (+  1586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.211704 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.211741 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.211795 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:18.211839 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.211910 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.212086 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.238637  1608 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.237128  1432 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 13, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 13 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:18.247381  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 106634us
W20260709 13:03:18.250209  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 291258us
I20260709 13:03:18.251240  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.218396  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2247) took 2956 ms. Trace:
I20260709 13:03:18.214761  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2226) took 3023 ms. Trace:
I20260709 13:03:18.253710  1605 rpcz_store.cc:276] 0709 13:03:15.191562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.167326 (+2975764us) service_pool.cc:224] Handling call
0709 13:03:18.214172 (+ 46846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.214355 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.214392 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.214451 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.214492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.214564 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.214690 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.233431  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:18.097664  6025 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.257507  1605 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:18.258265  6025 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.258559  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2163) took 2820 ms. Trace:
I20260709 13:03:18.259142  1605 rpcz_store.cc:276] 0709 13:03:15.437823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.255229 (+2817406us) service_pool.cc:224] Handling call
0709 13:03:18.255699 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.258026 (+  2327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.258468 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.261968  1605 raft_consensus.cc:1275] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:18.265822  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 249) took 2765 ms. Trace:
I20260709 13:03:18.268357  1605 rpcz_store.cc:276] 0709 13:03:15.500392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.261050 (+2760658us) service_pool.cc:224] Handling call
0709 13:03:18.261507 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.265450 (+  3943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.265744 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.269887  1606 rpcz_store.cc:276] 0709 13:03:15.262357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.215814 (+2953457us) service_pool.cc:224] Handling call
0709 13:03:18.216189 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.218095 (+  1906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.218122 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.218165 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.218195 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.218248 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.218344 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.191501  6166 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.192752  6129 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.277948  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.146478  6192 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.279701  6210 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.280476  6210 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:18.280831  6210 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:18.281141  1606 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:18.281862  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2160) took 2844 ms. Trace:
I20260709 13:03:18.282672  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2173) took 2717 ms. Trace:
I20260709 13:03:18.283293  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2133) took 4219 ms. Trace:
I20260709 13:03:18.282388  1608 rpcz_store.cc:276] 0709 13:03:15.437027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.238082 (+2801055us) service_pool.cc:224] Handling call
0709 13:03:18.238493 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.281497 (+ 43004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.281527 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.281579 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.281616 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.281693 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.281812 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32323,"raft.queue_time_us":33847,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75}
I20260709 13:03:18.283895  1607 rpcz_store.cc:276] 0709 13:03:14.063421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.084889 (+4021468us) service_pool.cc:224] Handling call
0709 13:03:18.085191 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.085771 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.085799 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.096578 (+ 10779us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.253872 (+157294us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.276319 (+ 22447us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.283000 (+  6681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.283070 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.283109 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:18.283123 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.283242 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6413,"prepare.queue_time_us":21514,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":10896,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":17343,"thread_start_us":115936,"threads_started":2,"wal-append.queue_time_us":126640}
I20260709 13:03:18.193775  6202 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:18.283021  1606 rpcz_store.cc:276] 0709 13:03:15.565095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.276430 (+2711335us) service_pool.cc:224] Handling call
0709 13:03:18.280558 (+  4128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.282399 (+  1841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.282618 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.286895  1609 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:03:18.286885  1432 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 8 to 13, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 13 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.298951  1609 pending_rounds.cc:85] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 8
I20260709 13:03:18.299320  1609 pending_rounds.cc:107] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:03:18.297521  1607 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:18.299719  1607 pending_rounds.cc:85] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 5
I20260709 13:03:18.222846  6035 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.222096  6197 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:18.299996  1607 pending_rounds.cc:107] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:18.160660  6134 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:18.300619  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67260.3us
I20260709 13:03:18.237978  6118 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.300380  6197 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.179384  5976 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:03:18.321966  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.017s	sys 0.046s
I20260709 13:03:18.322041  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:18.301816  1607 raft_consensus.cc:2889] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.302253  1609 raft_consensus.cc:2889] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.235399  6106 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:18.337159  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 85968.6us
I20260709 13:03:18.188339  6203 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
W20260709 13:03:18.331007  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.017s	sys 0.046s
I20260709 13:03:18.292608  6184 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:18.338943  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61068.3us
I20260709 13:03:18.339226  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2251) took 2532 ms. Trace:
I20260709 13:03:18.125849  6199 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.342126  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.342670  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2156) took 2906 ms. Trace:
I20260709 13:03:18.342535  1432 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.296610  6153 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.277130  6034 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:03:18.281279  6210 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:18.411655  6208 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:03:18.410910  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.008s	sys 0.008s
W20260709 13:03:18.432798  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.012s
I20260709 13:03:18.361366  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:18.331857  6118 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:18.417071  6106 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.329514  6214 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.393369  6066 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:03:18.330556  5884 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.399839  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.402743  1432 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 12, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.416306  6068 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:18.396570  6171 consensus_meta.cc:287] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:03:18.391641  5776 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.395998  5921 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.291606  6202 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.291199  6129 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:18.491678  1610 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:18.343061  1607 rpcz_store.cc:276] 0709 13:03:15.806387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.285798 (+2479411us) service_pool.cc:224] Handling call
0709 13:03:18.286040 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.338978 (+ 52938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.339169 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.344458  1604 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:03:18.502345  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2174) took 2655 ms. Trace:
I20260709 13:03:18.332100  6197 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.322350  6134 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:18.483318  6184 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:18.422755  6086 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:18.482859  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 83122.2us
I20260709 13:03:18.375489  6096 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:18.509233  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.509826  6096 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:18.489342  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 147315us
I20260709 13:03:18.470932  6118 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.488497  6171 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.511027  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:18.512157  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:18.390367  1609 rpcz_store.cc:276] 0709 13:03:15.435959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.224417 (+2788458us) service_pool.cc:224] Handling call
0709 13:03:18.286579 (+ 62162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.342423 (+ 55844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.342615 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.513034  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:18.513878  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2256) took 2092 ms. Trace:
I20260709 13:03:18.514035  6162 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.478984  6153 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:18.511340  6092 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:18.514648  6153 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:18.323207  6207 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 13:03:18.235692  1421 maintenance_manager.cc:643] P 0d9f4d25497a4ade8ff13a53360853c8: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.957s	user 0.221s	sys 0.144s Metrics: {"bytes_written":30224,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":162683,"dirs.run_cpu_time_us":396,"dirs.run_wall_time_us":1927,"drs_written":1,"lbm_read_time_us":431,"lbm_reads_lt_1ms":4,"lbm_write_time_us":446812,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":9,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":195617,"threads_started":2,"update_count":10,"wal-append.queue_time_us":38818}
I20260709 13:03:18.515275  5795 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:18.474769  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 113506us
I20260709 13:03:18.515712  6153 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.516669  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:18.504721  5776 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:18.514281  1609 rpcz_store.cc:276] 0709 13:03:16.420980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.512875 (+2091895us) service_pool.cc:224] Handling call
0709 13:03:18.513189 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.513369 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.513393 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.513435 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.513649 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.513713 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.513820 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.497216  6202 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:18.504338  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 278063us
I20260709 13:03:18.512257  1526 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:18.492187  6223 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.514730  6162 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:18.497021  5884 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.509001  6106 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.510288  6096 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.518280  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:18.501317  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2255) took 2080 ms. Trace:
I20260709 13:03:18.548673  1607 rpcz_store.cc:276] 0709 13:03:16.420796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.492845 (+2072049us) service_pool.cc:224] Handling call
0709 13:03:18.500787 (+  7942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.500961 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.500987 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.501027 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.501060 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.501123 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.501244 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.503311  1604 rpcz_store.cc:276] 0709 13:03:15.846569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.324609 (+2478040us) service_pool.cc:224] Handling call
0709 13:03:18.344163 (+ 19554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.502086 (+157923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.502288 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.501264  6032 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:18.503726  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2172) took 2945 ms. Trace:
I20260709 13:03:18.503674  1432 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.563326  6216 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:18.564314  1432 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.566316  1432 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.504946  6139 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.481966  6066 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.571322  6066 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.482177  6214 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.575194  6068 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.562302  6032 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:18.581411  6032 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.581849  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2248) took 2782 ms. Trace:
I20260709 13:03:18.582238  1608 rpcz_store.cc:276] 0709 13:03:15.799535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.284708 (+2485173us) service_pool.cc:224] Handling call
0709 13:03:18.285298 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.286861 (+  1563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.286891 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.296860 (+  9969us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.470589 (+173729us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.470652 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.470760 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.581618 (+110858us) raft_consensus.cc:1685] finished
0709 13:03:18.581639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.581784 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":396,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":101121,"threads_started":1,"wal-append.queue_time_us":169581}
I20260709 13:03:18.586237  6192 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.588634  6134 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.590237  6134 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.541081  1648 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:18.517112  6025 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:03:18.544898  1647 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14.
I20260709 13:03:18.482617  6201 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.506698  6184 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:18.508801  6086 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.552220  5921 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:18.556908  6056 consensus_meta.cc:287] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.654s	user 0.002s	sys 0.009s
I20260709 13:03:18.557291  6173 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.521183  5776 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.558066  6171 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.548743  6165 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.548902  6092 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:18.587870  6223 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:18.594234  6206 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:03:18.591528  6226 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.624473  6201 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:18.634948  6086 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.639220  6176 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.641045  5776 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:18.641851  6091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.011s	sys 0.009s
I20260709 13:03:18.650359  6201 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.654717  6091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.011s	sys 0.010s
W20260709 13:03:18.721704  6227 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:03:18.722019  6199 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:18.727348  6088 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.627s	user 0.004s	sys 0.004s
W20260709 13:03:18.658110  6204 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:03:18.713979  6206 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:18.652104  6176 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.734167  6032 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.652410  6184 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.738674  6096 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.739532  5776 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.721705  6092 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.771936  6096 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.767675  6184 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.776834  5776 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:18.781955  6237 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:18.731621  6088 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:18.788494  6088 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:18.755463  6197 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.793737  6197 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.794519  6032 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.798951  6226 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.801908  1432 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 12, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.808590  6086 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.809818  1432 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.811503  6086 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.806891  1422 maintenance_manager.cc:419] P 0d9f4d25497a4ade8ff13a53360853c8: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7720 bytes on disk
I20260709 13:03:18.811872  1432 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.814286  1421 maintenance_manager.cc:643] P 0d9f4d25497a4ade8ff13a53360853c8: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":283,"lbm_reads_lt_1ms":4}
W20260709 13:03:18.805919  6163 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.000s
I20260709 13:03:18.815124  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2049) took 1094 ms. Trace:
W20260709 13:03:18.815620  6234 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:03:18.774824  6035 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.816784  6202 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.818127  6035 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.812208  6210 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.818989  6202 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.819567  6201 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.820255  6210 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.820950  5749 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.821748  6201 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.821485  5749 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.815496  1526 rpcz_store.cc:276] 0709 13:03:17.720247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.928249 (+208002us) service_pool.cc:224] Handling call
0709 13:03:17.928529 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.540321 (+611792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.814884 (+274563us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54000f7b54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:18.815062 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341965568}
W20260709 13:03:18.826879  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.829627  1533 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:18.807075  6118 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.837963  6118 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.814754  1432 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 8, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 8 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:18.842188  1432 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 1 to 10, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 10 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.843921  6210 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.844515  6210 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.845479  6092 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.846043  6092 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.846715  6210 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.848201  6092 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.594056  1648 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:18.851735  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 310785us
I20260709 13:03:18.851845  6118 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:18.852736  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:18.853529  6118 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.853716  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:18.854012  6118 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.854444  6118 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.856834  6163 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:18.857259  6163 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.857659  6163 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.858482  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1834) took 2732 ms. Trace:
I20260709 13:03:18.858839  1682 rpcz_store.cc:276] 0709 13:03:16.126375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.635826 (+1509451us) service_pool.cc:224] Handling call
0709 13:03:17.646088 (+ 10262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.646531 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:17.875204 (+228673us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.215721 (+340517us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.216177 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.216301 (+   124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.216330 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.216409 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.858258 (+641849us) raft_consensus.cc:1685] finished
0709 13:03:18.858278 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.858416 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":328716,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":695,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":5932,"thread_start_us":505933,"threads_started":2,"wal-append.queue_time_us":375602}
I20260709 13:03:18.864161  1675 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:18.864069  6118 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:18.866334  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2233) took 1078 ms. Trace:
I20260709 13:03:18.866597  6118 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:18.873143  1684 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:18.874387  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1837) took 2747 ms (client timeout 2012 ms). Trace:
W20260709 13:03:18.874783  1684 rpcz_store.cc:269] 0709 13:03:16.127063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.303218 (+176155us) service_pool.cc:224] Handling call
0709 13:03:18.874192 (+2570974us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b540041ad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:18.874312 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5908150144}
I20260709 13:03:18.893357  6120 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:18.866870  1675 rpcz_store.cc:276] 0709 13:03:17.787982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.796620 (+  8638us) service_pool.cc:224] Handling call
0709 13:03:18.866076 (+1069456us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000befd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:18.866264 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378888064}
W20260709 13:03:18.904650  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51015us
I20260709 13:03:18.905942  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:18.937529  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.010s	sys 0.011s
W20260709 13:03:18.937904  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.011s	sys 0.012s
W20260709 13:03:18.938143  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 684861us
I20260709 13:03:18.951474  6226 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:18.953217  6226 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:18.954704  6226 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:18.955973  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:18.961903  1606 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:18.962913  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2252) took 3156 ms. Trace:
I20260709 13:03:18.963291  1606 rpcz_store.cc:276] 0709 13:03:15.806853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.321841 (+2514988us) service_pool.cc:224] Handling call
0709 13:03:18.961637 (+639796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.962570 (+   933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.962828 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.965608  6226 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:19.001025  6226 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:19.002362  6226 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.007566  6219 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:19.011449  6219 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:19.012492  6219 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.013468  6219 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.020452  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.021140  1526 raft_consensus.cc:2376] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16. Re-sending same reply.
I20260709 13:03:19.021155  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.024355  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.024637  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.025471  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.025651  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.026069  1533 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:19.026194  1529 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:19.026896  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.027454  1533 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:19.029872  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.033411  6218 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.034066  6218 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.041711  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.043193  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.046325  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.048095  6221 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.048633  6221 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.049867  6176 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.050480  6176 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:19.050817  6176 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.051841  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.052665  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.065877  1532 raft_consensus.cc:2376] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17. Re-sending same reply.
I20260709 13:03:19.067168  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.068372  6229 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:19.051682  6176 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.071873  6176 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.053783  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.077183  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.077843  1533 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:18.603149  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.080765  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.081470  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.082077  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.082849  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.025s	sys 0.049s
I20260709 13:03:19.050761  6221 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:19.083355  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.026s	sys 0.050s
I20260709 13:03:19.083753  6221 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:19.083961  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 570948us
I20260709 13:03:19.084388  6221 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.085671  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.085420  6221 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.086977  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:19.089214  1603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.004s
W20260709 13:03:19.097565  1603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.005s
I20260709 13:03:19.098290  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.044991  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.045784  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.094075  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2135) took 5029 ms. Trace:
I20260709 13:03:19.092437  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.064638  6163 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.100544  1526 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.100802  1601 rpcz_store.cc:276] 0709 13:03:14.064823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.090231 (+4025408us) service_pool.cc:224] Handling call
0709 13:03:18.125030 (+ 34799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.235175 (+110145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.235213 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.286631 (+ 51418us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.481394 (+194763us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:18.481436 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.093167 (+611731us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003be7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:19.093213 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.093268 (+    55us) raft_consensus.cc:1685] finished
0709 13:03:19.093281 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.093999 (+   718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622,"raft.queue_time_us":44890,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":250839424,"thread_start_us":137363,"threads_started":1,"wal-append.queue_time_us":175336}
I20260709 13:03:19.101322  1648 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.105507  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.106734  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:19.100788  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:19.110751  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.111853  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.113327  6235 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.114164  6235 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:19.114513  6235 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.114670  6163 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.114914  6235 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:19.115862  6163 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:19.119683  6163 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.119179  6218 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.120720  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.121694  6230 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.104566  6210 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:19.116472  1420 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c6031790cc44edfba5c3964e6f27c6e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:19.124483  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.125767  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.129621  1529 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.133894  6223 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:19.160723  6223 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:19.161144  6223 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.138113  6214 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:18.602615  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.182376  6226 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:19.182988  6226 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:19.183769  6096 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.185297  6226 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:19.185555  6096 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:19.147151  6230 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.151677  6231 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.149066  5776 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:19.148183  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.192174  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.192344  1527 raft_consensus.cc:2376] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14. Re-sending same reply.
I20260709 13:03:19.192883  1531 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:19.193470  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.150158  6218 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:19.134775  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.134754  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:19.133548  1526 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:19.156716  6202 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.156862  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 251) took 2742 ms. Trace:
I20260709 13:03:19.160017  1533 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:03:19.204260  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70540.9us
I20260709 13:03:19.205343  1533 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:19.205346  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.180433  1529 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:19.142585  6115 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:19.201263  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66636.2us
I20260709 13:03:19.201609  1527 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 18. Ops: [16.10-16.10]
I20260709 13:03:19.201877  1526 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.213006  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.213604  1526 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:19.201871  6218 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.214352  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.203107  1603 rpcz_store.cc:276] 0709 13:03:16.414664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.417862 (+2003198us) service_pool.cc:224] Handling call
0709 13:03:18.418204 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.471341 (+ 53137us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:18.491390 (+ 20049us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.097947 (+606557us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.098456 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.098612 (+   156us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:19.133421 (+ 34809us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.156549 (+ 23128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.156624 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.156660 (+    36us) raft_consensus.cc:1685] finished
0709 13:03:19.156671 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.156798 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54595,"prepare.queue_time_us":25312,"prepare.run_cpu_time_us":713,"prepare.run_wall_time_us":4448,"raft.queue_time_us":88170,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":186,"thread_start_us":611648,"threads_started":2,"wal-append.queue_time_us":123974}
I20260709 13:03:19.159142  6199 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:19.215875  1526 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.215857  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.224223  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:19.188541  5776 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.227576  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.231513  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.232758  1603 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:19.235574  1606 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:19.236367  1607 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:19.238595  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.239161  1608 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.240353  1526 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:19.209028  6219 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:19.208763  6115 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.242506  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.261435  1608 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:19.243184  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.259191  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.216392  6218 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.216585  6230 raft_consensus.cc:2764] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:19.218406  6231 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.257261  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.259104  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.270033  1604 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:19.268361  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.270963  1606 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.271039  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.271905  1603 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:19.269950  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.229581  5776 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.215329  6163 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.276664  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:19.280648  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.280843  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.272588  1607 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:19.286646  1601 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:19.234993  6199 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.287643  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.287672  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.288564  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.293045  1604 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:19.286113  1606 raft_consensus.cc:2410] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:03:19.289249  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.293908  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.291272  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.294818  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.258930  6219 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.263918  6115 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.301492  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.302069  1608 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:19.302819  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.303699  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.304322  1608 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:19.306514  6199 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.311072  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.312256  1529 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:03:19.296298  1574 connection.cc:256] RPC call timeout handler was delayed by -2.4071192640000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:03:19.327198  1574 connection.cc:256] RPC call timeout handler was delayed by -2.2010192640000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:03:19.293203  1607 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
W20260709 13:03:19.327543  1574 connection.cc:256] RPC call timeout handler was delayed by -1.7078192640000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
I20260709 13:03:19.328425  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.328676  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.298803  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.299461  1603 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:19.295572  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:19.331895  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.329972  6231 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:19.326788  6223 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:19.305784  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:19.343047  6223 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:19.372085  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.300666  6163 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.363653  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.423488  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.472514  1601 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.472927  1529 raft_consensus.cc:2368] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:19.474598  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.451627  1604 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:19.415036  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:19.477198  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.477547  1607 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:19.300943  6219 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.476218  1603 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.478292  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.478885  1529 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:19.479499  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 150870us
I20260709 13:03:19.479667  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.480463  1529 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:19.481925  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.482750  1529 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:19.486145  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:19.343848  6223 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:19.335521  6235 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.305015  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:03:19.500147  1608 raft_consensus.cc:606] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:19.343710  6025 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:03:19.506234  1603 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:19.490067  6231 consensus_queue.cc:1243] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:03:19.547583  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.548573  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.548970  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.550181  1604 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:19.344259  5884 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.355930  6068 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:19.565464  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76025.1us
I20260709 13:03:19.552174  6223 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:19.569650  5882 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:19.570313  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.570933  1535 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:19.571810  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.572373  1535 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:19.573150  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.574113  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.574761  1535 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:19.575505  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.578315  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.579330  1535 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:19.550931  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.497378  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.585454  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.586622  1535 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:19.583335  1529 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:19.589385  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:19.596839  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 46031.3us
I20260709 13:03:19.598006  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.558523  5884 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.609704  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.613190  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.629588  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:19.607751  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:19.623944  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:19.630862  1675 raft_consensus.cc:606] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:19.630677  1529 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:19.631296  1675 raft_consensus.cc:614] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.633846  5884 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:19.634966  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2234) took 4437 ms. Trace:
W20260709 13:03:19.639595  6244 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.478s	user 0.002s	sys 0.011s
I20260709 13:03:19.642611  1527 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:03:19.584834  6210 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.635386  1610 rpcz_store.cc:276] 0709 13:03:15.197647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.203407 (+3005760us) service_pool.cc:224] Handling call
0709 13:03:18.203791 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.492348 (+288557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.634735 (+1142387us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54001716d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:19.634905 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661525248}
I20260709 13:03:19.633881  1529 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:19.647710  1527 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 16. Ops: [14.8-14.8]
W20260709 13:03:19.648919  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81171.4us
I20260709 13:03:19.609016  6068 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.618906  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 158036us
W20260709 13:03:19.651630  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.656759  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.623906  1601 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:19.614670  6231 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.658778  1606 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:19.659134  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.647114  6253 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:19.663209  6253 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:19.679215  6235 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:19.678918  6253 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:19.680347  6253 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:19.683459  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.533s	user 0.006s	sys 0.006s
W20260709 13:03:18.602520  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57763.3us
I20260709 13:03:19.688329  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:19.688705  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.689208  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.008s	sys 0.020s
W20260709 13:03:19.689635  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.008s	sys 0.020s
I20260709 13:03:19.691354  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:19.691959  1675 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:03:19.692301  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.692348  1675 raft_consensus.cc:614] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.694422  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:03:19.683924  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.006s	sys 0.006s
W20260709 13:03:19.695889  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 1.54555e+06us
I20260709 13:03:19.691633  6218 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.689608  1647 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:19.706015  6231 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.706588  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:19.706943  6231 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:19.707351  6231 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:19.707913  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:19.708173  6134 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:19.708602  6134 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:19.708956  6134 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:19.711742  6163 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:19.712244  6163 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:19.712636  6163 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.712440  6231 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.714859  6231 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.716150  6115 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.712404  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:03:19.696957  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.697710  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.650903  5776 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.727511  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:19.737972  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.730063  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:19.758334  1606 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:18.593473  1605 rpcz_store.cc:276] 0709 13:03:15.557881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.272272 (+2714391us) service_pool.cc:224] Handling call
0709 13:03:18.272715 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.273036 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:18.298284 (+ 25248us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.503281 (+204997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.503337 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.503387 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.503557 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.503674 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2672,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":1195,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3084,"thread_start_us":228107,"threads_started":2,"wal-append.queue_time_us":262025}
I20260709 13:03:19.728631  6068 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:19.729713  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:19.770587  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:19.729027  6106 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.724634  6056 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:19.755501  6035 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.757243  1675 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:19.718870  6218 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.728971  5976 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:19.827675  6086 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:19.852917  6115 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.763327  6134 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.881912  6134 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:19.774336  6118 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:19.816300  5976 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:19.785982  6129 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:19.764478  6173 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:03:19.789749  6056 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.765945  6253 consensus_queue.cc:1048] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:03:19.868682  6210 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:19.907742  6256 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:03:19.906590  5976 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.867188  6035 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:19.911921  6254 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:19.910472  6056 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.926242  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8501e8317ed348cca428d77d106f937c"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:19.927811  1675 raft_consensus.cc:606] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:19.928402  1675 raft_consensus.cc:614] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.911707  6118 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:19.917145  6199 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:19.933236  1705 debug-util.cc:398] Leaking SignalData structure 0x7b0800082cc0 after lost signal to thread 431
W20260709 13:03:19.934686  1705 debug-util.cc:398] Leaking SignalData structure 0x7b0800340b00 after lost signal to thread 434
W20260709 13:03:19.931806  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 163401us
I20260709 13:03:19.917342  6129 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:19.932435  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 316404us
I20260709 13:03:19.936877  6219 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.948590  6118 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:19.924774  2209 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:19.919020  6210 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.162041  1609 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:20.146091  1535 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:03:19.999092  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:19.999413  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:19.996608  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.174602  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.174688  1675 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
W20260709 13:03:19.997493  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.175463  1680 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:20.175736  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.020174  1683 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:03:19.996670  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.033433  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2068) took 1010 ms. Trace:
I20260709 13:03:19.996951  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.176134  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.173725  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:20.140491  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:20.206081  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:19.998039  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.195601  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:20.204541  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.182950  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.208448  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.177140  1684 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:20.205782  1574 leader_election.cc:400] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:20.209859  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.177116  1530 rpcz_store.cc:276] 0709 13:03:19.022693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.707936 (+685243us) service_pool.cc:224] Handling call
0709 13:03:19.720340 (+ 12404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.720711 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.720742 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.721236 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.929648 (+208412us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:19.929722 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.929815 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.033159 (+103344us) raft_consensus.cc:1685] finished
0709 13:03:20.033181 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.033350 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392,"raft.queue_time_us":1066,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6521,"thread_start_us":207955,"threads_started":1,"wal-append.queue_time_us":273317}
I20260709 13:03:20.118785  1605 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:20.215096  6212 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.221726  1532 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.222678  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.212353  6120 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:03:20.224792  6120 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:20.225138  6120 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:19.972612  5776 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:20.176189  5882 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.225968  6120 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.226963  5882 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:20.212226  6235 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.218143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.228945  1683 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:20.229892  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.227402  6120 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:19.986024  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.018535  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.247901  1677 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 11: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:20.223809  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:19.973860  6035 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.210222  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:20.198127  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.251860  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.252396  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.213038  6231 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.210156  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.212532  1676 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:20.211114  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.195930  6092 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.258749  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9a84223e947489c829c528c860660d1"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:20.259522  1676 raft_consensus.cc:606] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:20.259987  1676 raft_consensus.cc:614] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:20.174484  6184 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:03:19.934533  6199 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:20.000181  1681 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:20.051120  6056 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.155603  6153 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:20.066444  6251 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:03:20.148329  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:20.231745  1535 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:20.114442  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.234596  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.271744  1679 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.249954  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.249871  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.273419  1684 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:19.973856  6219 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:20.211968  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.254771  1608 raft_consensus.cc:2393] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:20.213323  1682 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:20.213743  1531 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:20.274688  1680 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:20.137454  6163 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:20.169437  6088 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.281787  1680 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:20.265576  1681 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:03:20.265569  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 55405.5us
I20260709 13:03:20.274012  1532 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:20.109304  5976 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:20.260005  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2048) took 2540 ms. Trace:
I20260709 13:03:20.221608  6210 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.300817  6088 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.301932  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.303387  1576 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:20.303692  1576 leader_election.cc:403] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:20.304802  1682 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:03:20.268167  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:20.263971  6271 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.047981  6129 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:20.270701   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:20.308745  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.285259  1675 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:20.284246  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:20.259528  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49451.7us
I20260709 13:03:20.311254  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.311498  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.312706  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.289754  6199 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.262009  6231 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.292112  5882 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.269230  6235 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:20.324977  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.264138  6092 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.306831  1683 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:20.312749  1679 raft_consensus.cc:2410] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:20.336184  1679 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:20.336174  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:20.334671  6235 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.313761  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.313926  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.300817  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.314796  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:20.346102  1529 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:03:20.289088  6163 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:20.315860  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.310633   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:20.303861  6088 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.325929  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.324329  6210 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.307747  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.298353  6056 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:20.326153  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:20.333963  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:20.346024  1675 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:20.362852  1684 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:20.285297  1528 rpcz_store.cc:276] 0709 13:03:17.719872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.927126 (+207254us) service_pool.cc:224] Handling call
0709 13:03:17.930383 (+  3257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:17.959733 (+ 29350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.959764 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:17.972885 (+ 13121us) log.cc:844] Serialized 52 byte log entry
0709 13:03:18.214833 (+241948us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:18.235948 (+ 21115us) log.cc:844] Serialized 14 byte log entry
0709 13:03:18.565743 (+329795us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b18000abca0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:20.227478 (+1661735us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b18000abca0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:20.259686 (+ 32208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.259761 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.259802 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:20.259812 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.259951 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30507,"prepare.queue_time_us":20893,"prepare.run_cpu_time_us":1115,"prepare.run_wall_time_us":10417,"raft.queue_time_us":109307,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":2911,"spinlock_wait_cycles":168690944,"thread_start_us":211013,"threads_started":2,"wal-append.queue_time_us":345844,"wal-append.run_cpu_time_us":3207,"wal-append.run_wall_time_us":1121746}
I20260709 13:03:20.331229  6035 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.331413  6184 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.331634  6091 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.353338  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.347534  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.339720  6271 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.367470  6271 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:20.370827  6163 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.371423  6163 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.374250  6163 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:20.378530  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52716.8us
I20260709 13:03:20.380182  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:20.380762  6271 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:20.380946  6279 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.382505  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:20.381429  6279 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.380050  6280 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:20.350261  6235 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.351369  6212 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.387210  6279 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.352131  6032 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:20.457892  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77783.7us
I20260709 13:03:20.458997  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.366073  6035 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:20.386209  6210 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.352630  6162 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:03:20.491601  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 144013us
I20260709 13:03:20.364910  6088 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:03:20.493315  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.457049  6032 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.505647  5976 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:20.507364  1680 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:20.511643  6253 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:20.513006  6253 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:20.513474  6253 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:20.514693  6253 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:20.466024  6035 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.540539  6032 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.490797  6210 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:20.614289  1705 debug-util.cc:398] Leaking SignalData structure 0x7b08000823c0 after lost signal to thread 1467
W20260709 13:03:20.778707  1705 debug-util.cc:398] Leaking SignalData structure 0x7b0800082de0 after lost signal to thread 1559
W20260709 13:03:20.779016  1705 debug-util.cc:398] Leaking SignalData structure 0x7b080014e240 after lost signal to thread 1560
I20260709 13:03:20.753774  6199 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.754086  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:20.754393  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2265) took 3053 ms. Trace:
I20260709 13:03:20.783051  1609 rpcz_store.cc:276] 0709 13:03:17.701034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.542784 (+841750us) service_pool.cc:224] Handling call
0709 13:03:18.595178 (+ 52394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.174729 (+1579551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.565089 (+390360us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540003cad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:20.754308 (+189219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3602926976}
W20260709 13:03:20.755257  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 262013us
I20260709 13:03:20.784242  6092 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.784786  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:20.784895  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.785597  5795 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.785432  5976 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:20.786159  5795 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.786598  5795 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.786566  5976 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.787611  5976 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.789698  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.791929  6068 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:20.756592  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.794292  6253 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.796963  6282 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:20.797420  6282 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:20.798179  6282 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.799409  6282 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.467408  6278 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.800549  6278 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.803335  6278 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:20.759816  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.760865  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.804508  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.805675  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:20.806524  1610 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:20.806721  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:20.807472  6192 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.807665  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.808004  6192 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.809429  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.803879  6219 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:03:20.757627  6088 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.810806  1527 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:03:20.810736  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.811091  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.811453  1608 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:20.812069  1603 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:20.812304  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1784) took 1518 ms. Trace:
I20260709 13:03:20.812762  1527 rpcz_store.cc:276] 0709 13:03:19.294023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.648891 (+354868us) service_pool.cc:224] Handling call
0709 13:03:20.810545 (+1161654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:20.811298 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.812126 (+   828us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540032f0d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:20.812232 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641159424}
I20260709 13:03:20.813511  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.814317  1605 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.814496  6200 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:20.815121  6200 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:20.793030  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.816545  6086 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:20.816465  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.817230  6086 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:20.817839  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.763386  1607 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:03:20.818840  1607 pending_rounds.cc:85] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 6
I20260709 13:03:20.819171  1607 pending_rounds.cc:107] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:03:20.820822  1607 raft_consensus.cc:2889] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.460815  6273 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:03:20.770237  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2213) took 1419 ms. Trace:
I20260709 13:03:20.822006  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.501979  6162 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:03:20.466084  6271 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.792903  6068 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:20.758260  2209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41286 (request call id 111) took 1064 ms. Trace:
I20260709 13:03:20.845727  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2187) took 1609 ms. Trace:
I20260709 13:03:20.846153  1607 rpcz_store.cc:276] 0709 13:03:19.236686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.483666 (+246980us) service_pool.cc:224] Handling call
0709 13:03:19.484089 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.821386 (+1337297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.845491 (+ 24105us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400086954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:20.845671 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2940971776}
I20260709 13:03:20.847296  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.848438  6273 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:20.849326  6273 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:20.850121  6273 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.850382  2209 rpcz_store.cc:276] 0709 13:03:19.693618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.694112 (+   494us) service_pool.cc:224] Handling call
0709 13:03:20.568258 (+874146us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400690d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:20.758174 (+189916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41086208}
I20260709 13:03:20.851555  6273 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.853010  6284 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:20.803627  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2086) took 1763 ms (client timeout 2090 ms). Trace:
W20260709 13:03:20.853664  1532 rpcz_store.cc:269] 0709 13:03:19.041220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.066715 (+ 25495us) service_pool.cc:224] Handling call
0709 13:03:20.803450 (+1736735us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540032f0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:20.803566 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653809536}
W20260709 13:03:20.804780  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.854580  6284 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:20.855011  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.855262  6284 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:20.855638  6284 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.861791  6201 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:20.862354  6201 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:20.810168  6192 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:20.817420  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.823122  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.865607  1499 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:20.819139  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.768159  5921 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:20.771391  6230 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.766971  6276 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.765488  5749 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:20.825028  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.816313  6278 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:20.818179  6086 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.810708  6088 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:20.816283  6217 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:20.827646  1609 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:20.828485  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.828230  6200 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.822151  1604 rpcz_store.cc:276] 0709 13:03:19.350863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.553684 (+202821us) service_pool.cc:224] Handling call
0709 13:03:19.554106 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.599107 (+ 45001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.599163 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.608839 (+  9676us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.981273 (+372434us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:19.981330 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.769849 (+788519us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b5400249d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:20.769896 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.769939 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:20.769954 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.770178 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102743936,"thread_start_us":361096,"threads_started":1,"wal-append.queue_time_us":468091}
I20260709 13:03:20.819844  1648 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:20.833577  1705 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8e40 after lost signal to thread 1634
W20260709 13:03:20.948568  1705 debug-util.cc:398] Leaking SignalData structure 0x7b08003486c0 after lost signal to thread 1635
W20260709 13:03:20.948693  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 128942us
W20260709 13:03:20.950146  1705 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb4c0 after lost signal to thread 1708
W20260709 13:03:20.950556  1705 debug-util.cc:398] Leaking SignalData structure 0x7b0800089e80 after lost signal to thread 1709
I20260709 13:03:20.951835  1610 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:20.952273  1705 debug-util.cc:398] Leaking SignalData structure 0x7b080030ef60 after lost signal to thread 2236
W20260709 13:03:20.952791  1705 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa880 after lost signal to thread 2237
I20260709 13:03:20.791206  6231 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:20.866616  1601 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:20.955386  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.956161  1601 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 11: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:20.956991  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.863209  6201 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.868917  1647 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.869030  1605 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:20.870636  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 488243us
I20260709 13:03:20.871374  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.777099  6120 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.960898  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.824175  6210 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.915962  1608 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:20.872573  6270 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.372s	user 0.000s	sys 0.005s
I20260709 13:03:20.867226  5795 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:20.937285  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.030s	sys 0.027s
W20260709 13:03:20.985023  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.030s	sys 0.027s
W20260709 13:03:20.985354  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 659220us
W20260709 13:03:20.938426  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 479393us
I20260709 13:03:20.986402  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.943220  6217 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.944438  1602 raft_consensus.cc:2376] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17. Re-sending same reply.
I20260709 13:03:20.872277  5921 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:20.961617  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:20.961971  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93128.2us
I20260709 13:03:20.994490  1647 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17.
I20260709 13:03:20.995280  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:20.935741  6278 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:20.962715  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:20.950991  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:21.001722  1601 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.966820  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.002347  1607 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.968557  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.867281  6068 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.941743  6088 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.987511  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.014925  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.016078  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:20.989653  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:20.855988  6284 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.964996  6176 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.996441  6201 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.003356  1608 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:20.903847  6219 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:03:21.008634  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.011529  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.996670  6217 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.022392  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.027642  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.051743  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.053903  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:21.057653  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.058771  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.060238  6223 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:21.060997  6223 raft_consensus.cc:2764] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:21.061949  6223 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.062620  6223 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:21.063195  6223 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:21.066752  1680 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:21.067675  6277 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:21.030269  6230 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:03:21.068678  6230 consensus_queue.cc:1243] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:21.030087  6231 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.069098  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.029867  5884 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.069715  1610 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.069962  5884 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.070338  5884 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.048894  6192 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:21.072414  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:21.073874  1684 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:21.063536  6223 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:21.076013  6223 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.069118  6230 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:21.080525  6230 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:21.081357  6230 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.082541  6230 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:21.085570  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.087308  5921 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.088498  5921 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.089354  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:21.090516  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:21.091602  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:21.092422  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:21.093065  1681 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:21.088430  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:21.092566  6092 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:21.094075  6092 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.095268  6035 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.001s
I20260709 13:03:21.095659  6035 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.097419  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:21.097687  6035 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.098270  6035 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:21.098742  6035 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:21.099614  6231 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:21.100162  6231 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.107667  1610 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:21.109300  1602 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:21.086839  6032 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:03:21.004484  6056 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.050319  6165 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.026108  6276 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:21.129187  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.003s	sys 0.039s
W20260709 13:03:21.131551  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.003s	sys 0.039s
I20260709 13:03:20.961799  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.136161  1605 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:21.138664  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:20.962126  5749 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:21.122303  6199 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.145869  6212 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 13:03:21.118333  6032 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.148804  6091 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.005s
I20260709 13:03:21.133311  6153 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.131700  6165 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.156229  5749 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.196913  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.199923  1609 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:21.162957  6276 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.203763  6272 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.433s	user 0.000s	sys 0.005s
I20260709 13:03:21.203672  6276 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.205896  6276 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.202961  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.206593  1609 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.157196  6199 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.165728  6212 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.239672  6212 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.240247  6276 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:21.241930  6276 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.243995  6276 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.244597  6276 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.176141  6091 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
W20260709 13:03:21.256181  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.255699  1609 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:03:21.257814  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.258598  1609 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.244998  6276 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.191854  6231 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.269009  6276 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.272496  6278 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.273936  5795 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.277715  6231 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:21.275439  6199 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:21.276110  6165 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.279006  1603 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:21.280215  6279 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
I20260709 13:03:21.280721  6279 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.282963  6279 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.278475  6231 consensus_queue.cc:1243] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:21.327095  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.329094  6176 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.329649  6176 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.330765  6176 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.334649  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.340731  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.341655  1610 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:21.342787  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:21.344575  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.345453  1610 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:03:21.346836  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:21.349450  1610 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:21.354529  6092 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.348343  6176 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.347940  6091 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:21.362200  6282 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:03:21.367945  6032 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.181530  6153 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.372432  5749 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.177909  6035 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:21.385082  2209 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:03:21.389223  6235 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.932s	user 0.014s	sys 0.003s
I20260709 13:03:21.392109  6284 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.412283  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.423039  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.027s	sys 0.094s
W20260709 13:03:21.457937  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.027s	sys 0.094s
W20260709 13:03:21.426061  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.425251  1610 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:21.409976  6162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.028s	sys 0.084s
W20260709 13:03:21.425845  6034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.065s	sys 0.149s
I20260709 13:03:21.425414  6192 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:21.423614  6280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.041s	sys 0.139s
W20260709 13:03:21.461635  6162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.028s	sys 0.084s
I20260709 13:03:21.423739  6091 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:21.464478  6034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.066s	sys 0.149s
W20260709 13:03:21.481860  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.053s	sys 0.123s
W20260709 13:03:21.482406  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.053s	sys 0.123s
W20260709 13:03:21.474371  6280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.047s	sys 0.143s
I20260709 13:03:21.425340  6088 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.462401  6235 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.508327  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.006s
W20260709 13:03:21.677672  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.007s	sys 0.007s
W20260709 13:03:21.678454  1648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.013s	sys 0.005s
I20260709 13:03:21.678195  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2249) took 1640 ms. Trace:
W20260709 13:03:21.678917  1648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.013s	sys 0.005s
W20260709 13:03:21.679714  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 728780us
I20260709 13:03:21.661476  1602 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:21.681998  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:21.663012  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:21.519968  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.045s	sys 0.105s
I20260709 13:03:21.685700  1605 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:21.686151  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.046s	sys 0.105s
I20260709 13:03:21.687515  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2270) took 1393 ms. Trace:
I20260709 13:03:21.663829  1608 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:21.688881  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2268) took 1410 ms. Trace:
I20260709 13:03:21.691056  1608 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:21.691511  1608 pending_rounds.cc:85] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 7
I20260709 13:03:21.632678  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 218) took 3130 ms. Trace:
W20260709 13:03:21.678195  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 678524us
W20260709 13:03:21.620903  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.002s
I20260709 13:03:21.689340  1683 rpcz_store.cc:276] 0709 13:03:20.278855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.342680 (+ 63825us) service_pool.cc:224] Handling call
0709 13:03:20.342943 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.345830 (+  2887us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:20.345860 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.350131 (+  4271us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.609327 (+259196us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b48000e0358. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:03:21.458481 (+849154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:21.458550 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.458646 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.688245 (+229599us) raft_consensus.cc:1685] finished
0709 13:03:21.688279 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.688675 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49776,"raft.queue_time_us":2551,"raft.run_cpu_time_us":4891,"raft.run_wall_time_us":409695,"spinlock_wait_cycles":6990080,"thread_start_us":1055540,"threads_started":1,"wal-append.queue_time_us":1147526}
W20260709 13:03:21.697028  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.007s	sys 0.002s
I20260709 13:03:21.678992  1676 rpcz_store.cc:276] 0709 13:03:20.037606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.260656 (+223050us) service_pool.cc:224] Handling call
0709 13:03:20.261056 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.261259 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.261282 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.771874 (+510592us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:20.772384 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.482976 (+710592us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:21.483033 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.483130 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.677285 (+194155us) raft_consensus.cc:1685] finished
0709 13:03:21.677341 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.677843 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5072256,"thread_start_us":710174,"threads_started":1,"wal-append.queue_time_us":759246}
I20260709 13:03:21.602476   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.700060  1574 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:21.701562  1534 rpcz_store.cc:276] 0709 13:03:18.502241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.503757 (+  1516us) service_pool.cc:224] Handling call
0709 13:03:20.598227 (+2094470us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:20.767664 (+169437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.989067 (+221403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.989189 (+   122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.989231 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:20.989267 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.623829 (+634562us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540017ff54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:21.623940 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.632378 (+  8438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498645632}
W20260709 13:03:21.604300  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.687927  1682 rpcz_store.cc:276] 0709 13:03:20.293847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.353566 (+ 59719us) service_pool.cc:224] Handling call
0709 13:03:20.354595 (+  1029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.354888 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.354926 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.355656 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.686867 (+1331211us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:21.686957 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.687135 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.687203 (+    68us) raft_consensus.cc:1685] finished
0709 13:03:21.687216 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.687455 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1330494,"threads_started":1,"wal-append.queue_time_us":1191343}
W20260709 13:03:21.704718  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.696691  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:21.708925  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:21.712352  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:21.691946  1608 pending_rounds.cc:107] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:21.716276  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:21.716974  1608 raft_consensus.cc:2889] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.718147  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:21.672948  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.008s	sys 0.006s
W20260709 13:03:21.730281  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.008s	sys 0.006s
W20260709 13:03:21.668123  1601 consensus_meta.cc:287] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.002s
I20260709 13:03:21.731930  5921 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.531327  5976 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.743s	user 0.003s	sys 0.008s
I20260709 13:03:21.719383  1608 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:03:21.572149  6210 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 13:03:21.735184  6210 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.738059  1608 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:03:21.732048  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 914065us
I20260709 13:03:21.739038  6210 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.739797  1606 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:21.572566  6235 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:21.733242  5884 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.003s
I20260709 13:03:21.733536  1601 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:21.516326  6217 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.527915  6120 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:21.758531  6120 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:21.531278  6153 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.733273  5921 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.760473  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:21.523437  6091 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.534111  6184 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.764469  6285 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.764660  6165 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:21.525985  6273 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.007s
I20260709 13:03:21.765848  6199 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.733464  5976 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.766182  5884 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.766970  6199 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:21.767850  1604 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:21.768573  6200 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.769037  5976 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.769147  5884 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.769609  5749 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:21.770515  5749 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.770831  1603 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:21.763659  6184 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:21.773814  1603 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:21.774201  6219 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:21.572623  6201 consensus_meta.cc:287] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.008s
I20260709 13:03:21.774789  6296 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:21.783744  1609 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.011s
I20260709 13:03:21.775902  1603 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:21.761878  6192 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.789880  6192 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.776511  6153 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:21.790930  6056 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:21.791100  6153 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.792491  6056 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.792806  6192 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.765358  6165 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.765367  6285 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.777762  6120 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.777768  1607 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.775s	user 0.015s	sys 0.007s
I20260709 13:03:21.763644  5921 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.781903  6217 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:21.773999  6184 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.782970  1605 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:21.568459  6284 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.793007  6056 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.769047  6200 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:21.762811  6230 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:21.783789  6219 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.793933  6153 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:21.789091  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.010s
I20260709 13:03:21.886649  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2305) took 1016 ms. Trace:
I20260709 13:03:21.806748  1601 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:03:21.828533  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68347us
W20260709 13:03:21.866173  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.006s	sys 0.009s
I20260709 13:03:21.815019  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:21.764714  6235 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.867379  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2291) took 1024 ms. Trace:
W20260709 13:03:21.894737  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.010s	sys 0.010s
W20260709 13:03:21.525940  6271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.007s
I20260709 13:03:21.894996  1605 rpcz_store.cc:276] 0709 13:03:20.842735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.137183 (+294448us) service_pool.cc:224] Handling call
0709 13:03:21.862664 (+725481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:21.820420  6285 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:21.896086  6271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.022s	sys 0.008s
I20260709 13:03:21.817420  6300 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.914512  6300 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:21.916543  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49909us
I20260709 13:03:21.896425  6184 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.896831  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2287) took 1065 ms. Trace:
I20260709 13:03:21.897081  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:21.897841  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 925563us
W20260709 13:03:21.900270  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.657s (SENT) [suppressed 41 similar messages]
I20260709 13:03:21.892365  1609 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:21.901244  6056 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.891646  1602 rpcz_store.cc:276] 0709 13:03:20.846758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.720416 (+873658us) service_pool.cc:224] Handling call
0709 13:03:21.724177 (+  3761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.724700 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:21.725202 (+   502us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.796503 (+ 71301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:21.796689 (+   186us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:21.796997 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.797713 (+   716us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.863451 (+ 65738us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30717,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":14961,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":9057,"thread_start_us":59264,"threads_started":1}
I20260709 13:03:21.909713  6235 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:21.808753  6299 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:21.799837  1607 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:21.894028  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.007s	sys 0.010s
I20260709 13:03:21.796860  6165 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.925371  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:21.820101  6088 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.932567  6287 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.933225  5921 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:21.934015  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:21.917326  1610 rpcz_store.cc:276] 0709 13:03:20.830973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.459489 (+628516us) service_pool.cc:224] Handling call
0709 13:03:21.459811 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.460023 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:21.655314 (+195291us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.895966 (+240652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:21.896106 (+   140us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:21.896240 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.896343 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.896617 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96275,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":6789,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":366135,"threads_started":2}
I20260709 13:03:21.944479  6253 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.948443  6300 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.949144  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2318) took 1097 ms. Trace:
I20260709 13:03:21.926030  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2303) took 1079 ms. Trace:
I20260709 13:03:21.890787  6219 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.801824  6295 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.892760  6200 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.959239  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2296) took 1115 ms. Trace:
I20260709 13:03:21.965572  1601 rpcz_store.cc:276] 0709 13:03:20.851322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.770819 (+919497us) service_pool.cc:224] Handling call
0709 13:03:21.771354 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.892227 (+120873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.948879 (+ 56652us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400172fd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:21.949086 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79847296}
I20260709 13:03:21.965710  1609 rpcz_store.cc:276] 0709 13:03:20.846188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.257481 (+411293us) service_pool.cc:224] Handling call
0709 13:03:21.919872 (+662391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:21.921171  6230 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:21.967379  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 861539us
I20260709 13:03:21.822302  6034 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:21.979422  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45597.1us
I20260709 13:03:21.978983  1607 rpcz_store.cc:276] 0709 13:03:20.844254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.966488 (+122234us) service_pool.cc:224] Handling call
0709 13:03:21.956260 (+989772us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:21.984619  6197 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.985064  6056 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.985913  6176 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:21.985431  6230 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:21.986482  6176 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:21.990213  6120 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:21.992069  6235 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:21.957316  6287 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:21.521255  6223 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.002225  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:22.003674  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 103446us
I20260709 13:03:21.977608  6295 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.005693  6295 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.797549  5749 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.017941  6299 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:21.998901  6287 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.031105  6299 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:22.020819  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 206024us
I20260709 13:03:22.033646  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 9 to 11, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.031872  6300 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.034364  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:21.987591  6176 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.004370  6034 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.035256  6197 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:22.054793  6283 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.998690  6253 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:22.037109  6300 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.060787  6300 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.062019  6223 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.062165  6253 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:22.062881  6068 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.995s	user 0.009s	sys 0.012s
I20260709 13:03:22.063387  6068 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.065821  6068 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:22.067644  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.068325  1604 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:22.070240  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2317) took 1219 ms. Trace:
I20260709 13:03:22.070636  1604 rpcz_store.cc:276] 0709 13:03:20.851034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.769298 (+918264us) service_pool.cc:224] Handling call
0709 13:03:21.769853 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.068779 (+298926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.069987 (+  1208us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400085554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:22.070176 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653964032}
I20260709 13:03:22.077884  2175 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:22.083639  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.080647  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52465.2us
W20260709 13:03:22.086889  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 161657us
I20260709 13:03:22.090205  6201 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.090754  6201 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.091142  6201 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.091293  6034 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:22.091969  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.093746  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:22.094406  1433 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.096649  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.097371  1677 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:22.097579  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.098625  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.099332  1676 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:22.101001  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.037968  6235 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:03:22.101867  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.110376  1684 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:22.111876  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.112823  1681 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:22.113965  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:22.116535  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 82298.4us
I20260709 13:03:22.119022  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.119771  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.119976  6056 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.120362  6235 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.120455  6056 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.120749  1534 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:22.120908  6235 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:22.123158  1682 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:22.123658  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.124225  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:22.125104  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.125353  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.124249  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.125921  1677 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:22.122749  6056 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.126590  1682 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:22.123879  6235 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.130745  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.126077  1529 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.094051  6217 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:22.115711  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.140465  1535 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:22.141340  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.141861  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.143513  1533 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:22.140470  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:22.145051  2209 raft_consensus.cc:2393] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:22.145690  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.144867  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.146502  1528 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.148547  1680 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:22.149220  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71771.2us
I20260709 13:03:22.151523  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:22.145648  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.146613  1532 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.152604  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.153505  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.154981  6235 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.169711  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.170969  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.158471  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.172386  6200 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.162326  6295 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.137669  1433 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 10 to 15, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.173928  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.174381  1607 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
I20260709 13:03:22.174739  6295 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.152457  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.175043  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.167660  1684 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.177527  5921 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:22.179081  1527 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:22.179425  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:22.167898  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.134279  6217 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.131575  6253 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:22.168744  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.188428  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:22.172921  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.198923  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:22.187922  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.172931  1681 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.159343  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.190429  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.180550  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:22.183382  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.219017  1433 catalog_manager.cc:5697] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.188674  6091 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.182725  6056 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.226339  6056 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:22.227551  1678 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.182657  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.228940  1675 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.229126  1531 raft_consensus.cc:2410] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:03:22.187748  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:22.230979  1530 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:22.216789  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.233611  1527 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:22.233918  6034 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.234604  6034 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.236879  1535 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:22.238498  1533 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:22.240311  6217 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.241991  6217 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.244590  6287 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.247222  6287 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.232772  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.248425  1681 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.242404  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.257663  1526 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 10.
I20260709 13:03:22.214677  6253 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.267321  1603 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:22.250097  6120 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.277189  1531 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.261152  6235 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.276064  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.283325  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:22.197880  6165 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.295578  1528 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:22.275369  6253 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.303299  1530 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.286569  6230 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.286942  6235 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.304435  1529 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:22.317330  6280 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.294847  6295 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.319257  1677 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.321803  1534 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.323169  1535 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:22.326476  1533 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:03:22.329731  1675 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.331050  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:22.332297  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.333663  6280 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.334419  6280 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.336851  6318 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:22.336932  6280 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.332297  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.340216  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 259) took 1234 ms. Trace:
I20260709 13:03:22.340633  1603 rpcz_store.cc:276] 0709 13:03:21.105371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.858772 (+753401us) service_pool.cc:224] Handling call
0709 13:03:21.944361 (+ 85589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.276160 (+331799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.339923 (+ 63763us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540003d4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:22.340125 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739382528}
I20260709 13:03:22.350930  2212 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:22.354502  1526 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:22.355373  1528 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:22.355836  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.356814  1526 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.357093  1528 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:22.359169  6287 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:22.360158  6034 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.360940  1531 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:22.311573  6120 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.364487  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.365547  6295 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.324265  6235 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.367774  6219 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.369429  6165 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:22.312216  6230 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.369958  6201 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.326920  1533 pending_rounds.cc:85] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 8
I20260709 13:03:22.375365  1526 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:22.379074  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 195784us
W20260709 13:03:22.388856  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60031.7us
I20260709 13:03:22.393566  1678 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:22.397567  1532 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:22.398463  1529 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:22.337148  6200 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:22.399416  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87918.9us
I20260709 13:03:22.414093  1533 pending_rounds.cc:107] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:03:22.414495  1533 raft_consensus.cc:2889] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.416333  1679 raft_consensus.cc:2368] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
W20260709 13:03:22.423779  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 150559us
I20260709 13:03:22.404682  6230 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.428481  1534 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:22.417928  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.430047  1683 raft_consensus.cc:2393] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:22.409787  6034 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.440290  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.419831  6068 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.455006  1576 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.457746  6032 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:22.459991  6201 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:22.469214  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:03:22.470861  2176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.472869  6223 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.473412  6223 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.473834  6223 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.464149  6032 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:03:22.473045  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.461386  6285 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.453831  6068 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.502319  6068 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.508929  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.510296  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.511855  5749 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.512120  6199 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:22.512665  6199 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.512876  5749 raft_consensus.cc:993] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:03:22.513049  6199 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:22.513747  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.485383  6200 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.514437  6200 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.514864  6200 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:22.516932  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 65395.3us
I20260709 13:03:22.518095  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.519100  6219 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:22.519908  6219 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.520298  6201 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:22.489905  6217 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:22.522035  6201 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:22.522475  6201 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.497967  6035 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:03:22.524066  6035 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:22.528234  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.529289  5921 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.493836  6120 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:22.497407  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 147) took 31143 ms (client timeout 15000 ms). Trace:
I20260709 13:03:22.483628  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.513715  5749 raft_consensus.cc:1081] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:03:22.497917  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.449019  6034 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.536492  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.537279  1676 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:22.523392  6201 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.541276  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.486513  6285 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:22.526188  6035 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.554325  1683 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:22.541123  6091 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.550159  6285 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.550835  6035 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:22.567317  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80979.4us
I20260709 13:03:22.569278  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.558357  6091 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.534898  6253 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:22.557973  6287 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.575956  6280 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:03:22.579088  2209 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:22.545214  6219 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:22.600521  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.601650  6219 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.602167  6219 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.602463  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.603080  6219 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.603434  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.603495  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.604187  1683 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:22.599911  6199 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.605284  6068 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.604219  6296 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:03:22.606694  6296 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.607035  6296 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.607125  6199 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:22.586385  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 88683.4us
I20260709 13:03:22.553719  6300 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.588204  6162 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:22.533566  1432 rpcz_store.cc:269] 0709 13:02:51.354145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.354522 (+   377us) service_pool.cc:224] Handling call
0709 13:03:22.497136 (+31142614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:18.868793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:18.869435 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:18.869471 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:03:18.869491 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:18.871102 (+  1611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:18.871190 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:18.871224 (+    34us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:03:18.872847 (+  1623us) tablet.cc:701] Row locks acquired
0709 13:03:18.872870 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:03:18.873035 (+   165us) write_op.cc:270] Start()
0709 13:03:18.873159 (+   124us) write_op.cc:276] Timestamp: P: 1783602198872983 usec, L: 0
0709 13:03:18.873182 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:18.873947 (+   765us) log.cc:844] Serialized 6745 byte log entry
0709 13:03:18.949137 (+ 75190us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.005702 (+ 56565us) write_op.cc:301] APPLY: starting
0709 13:03:19.005795 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.894889 (+889094us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b18002664a0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697afc6cf 00007f4697db83b6 00007f4697daf7ec 00007f469bacff13 00007f469bad0532 00007f469bb17b93 00007f469b9c4de3 00007f469b9c46ab 00007f469b9c5e77
0709 13:03:20.128698 (+233809us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:20.128734 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:21.062410 (+933676us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5c00209b8c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469e26b331 00007f469e26b221 00007f469e265f6c 00007f469b9c630b 00007f469b9c5fd3 00007f469bac4e34 00007f469bab097c 00007f469bab4d61 00007f469bab4d19 00007f469bab4ca9 00007f469bab4c71
0709 13:03:21.364559 (+302149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:21.364930 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:03:21.364998 (+    68us) write_op.cc:312] APPLY: finished
0709 13:03:21.365938 (+   940us) log.cc:844] Serialized 155 byte log entry
0709 13:03:21.805081 (+439143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:21.805994 (+   913us) write_op.cc:454] Released schema lock
0709 13:03:21.806203 (+   209us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:21.807259 (+  1056us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:21.807328 (+    69us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":56271,"apply.run_cpu_time_us":97867,"apply.run_wall_time_us":2801340,"cfile_cache_hit":66,"cfile_cache_hit_bytes":68937,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":9695,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":17,"prepare.queue_time_us":19045,"prepare.run_cpu_time_us":55041,"prepare.run_wall_time_us":64647,"raft.queue_time_us":12868,"raft.run_cpu_time_us":29311,"raft.run_wall_time_us":108129,"replication_time_us":75799,"spinlock_wait_cycles":94683648,"thread_start_us":613419,"threads_started":5,"wal-append.queue_time_us":250331,"wal-append.run_cpu_time_us":11121,"wal-append.run_wall_time_us":1051340}]]}
I20260709 13:03:22.571455  6295 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.615085  1647 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:22.612952  6162 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.616186  6162 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.612937  5749 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:03:22.616762  6285 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.617830  6217 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.618330  6217 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.562011  6165 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:03:22.592962  6308 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:22.593564  6235 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.570960  6201 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.594147  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.597087  6230 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.622458  6235 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.623632  6230 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.623781  2209 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:22.597756  6034 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.574796  6091 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.574263  6056 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:22.605922  6176 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:22.609478  6035 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.609302  6296 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.610927  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:22.605443  6197 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.608469  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.599437  6200 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.607379  6068 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.618129  6223 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.620767  6308 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.619640  6165 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:22.619372  6217 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.627712  6300 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.587704  6253 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.632824  6285 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.639360  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:22.674413  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.640612  6056 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:22.612427  6299 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.644366  6035 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.647300  6197 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.648995  5921 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.639268  6165 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.646111  6176 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.651662  6200 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:22.635568  6034 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:03:22.638096  6308 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.693760  6308 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.695176  6308 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.639403  6295 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.696653  6295 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.697039  6295 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.687958  6162 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.654032  6091 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.704950  6091 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.655648  6283 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:22.657292  6280 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.706858  6280 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:22.659554  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.665691  6223 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.674355  1527 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:22.636523  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 164010us
I20260709 13:03:22.647218  6296 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.696453  6176 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.655115  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:22.700688  6162 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.676296  6056 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.684230  6299 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.714387  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.714640  6299 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.715451  6299 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.718135  6165 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.723783  6056 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.725525  6056 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.689009  5749 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:03:22.689601  6285 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.727795  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.728173  6285 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.731083  6285 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.735136  6197 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.738677  6212 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.739373  6212 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.741739  6212 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.742894  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.743705  1683 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:22.745378  1576 leader_election.cc:400] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
W20260709 13:03:22.745354  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.744915  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:22.748908  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93915.3us
I20260709 13:03:22.750244  6184 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:22.746227  1576 leader_election.cc:403] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.719894  6165 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:22.741631  6299 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:22.764176  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48370.6us
I20260709 13:03:22.765221  2175 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:22.778159  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.778818  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:22.774864  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.759603  6285 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.760262  6162 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:22.707906  6280 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.784538  1527 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:22.786442  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.784606  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.788888  1681 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:22.766316  6223 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.792451  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.786749  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.755913  6283 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:22.797039  1675 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:22.798519  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 195081us
I20260709 13:03:22.801565  6200 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:22.803295  6201 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:22.803746  6201 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:22.804677  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.804874  1683 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:03:22.804728  6199 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:22.806411  6034 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:22.806978  6034 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.784487  6162 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.808362  6162 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.809403  6034 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.809942  6034 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.810427  6034 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.805173  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.800272  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.817535  1675 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:22.824724  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.825640  1677 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.829782  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.833003  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.833283  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:22.836292  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 90636.4us
I20260709 13:03:22.792071  6120 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:03:22.849146  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.842430  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:22.852340  1604 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.835714  6212 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.845031  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.846213  6201 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.856413  6212 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.857311  6201 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.840739  6199 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:03:22.858839  6212 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.848096  6200 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:22.848649  6340 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:03:22.861778  1676 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:22.866955  1682 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
W20260709 13:03:22.887341  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.864868  1604 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:22.866773  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.791368  6285 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.898084  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.899858  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.900799  1682 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:22.904307  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:22.907438  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 248783us
I20260709 13:03:22.905762  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.867913  6283 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:22.912274  2175 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:22.913046  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:22.867012  6184 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:22.916924  1682 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:22.855749  6162 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.915972  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.812492  6299 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.926206  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 147508us
I20260709 13:03:22.905087  6034 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.866539  6091 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:03:22.913694  6300 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.914781  6217 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:22.937882  6217 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.932350  6230 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.938784  6217 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.939350  6230 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.940263  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.941421  6162 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.942106  6219 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:22.915532  6337 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.943171  6337 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:22.944221  6337 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:22.935385  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68690.5us
I20260709 13:03:22.923617  6032 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:22.948395  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:22.916483  6283 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.928176  6068 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.951471  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 188059us
I20260709 13:03:22.926679  6199 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.963372  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:22.936303  5921 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:22.973946  6095 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:22.974079  6034 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.974961  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:22.962973  6283 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.941454  6230 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.985471  6219 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.994239  6199 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:22.996203  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:22.950457  6300 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:22.999490  6300 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:22.988866  6032 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:23.001464  6197 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.001205  6032 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.004413  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.008416  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.009891  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:22.974858  5921 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.959903  6295 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.019162  1527 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:23.072851  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.076269  1526 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.962719  6287 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:03:23.073997  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 98232.4us
W20260709 13:03:23.074584  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102287us
I20260709 13:03:23.077838  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:23.079402  6091 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.974663  6034 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.080686  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.081629  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:22.970184  6068 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.089141  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.079638  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:23.079842  6091 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.086295  1675 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.088642  1532 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.040750  6230 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.107939  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.008527  6346 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:23.109447  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.077711  5921 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.174147  1677 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:22.985292  6200 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:03:23.073787  6095 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
W20260709 13:03:23.184132  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.167292  1531 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:23.168573  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 183657us
W20260709 13:03:23.107671  6336 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:23.185894  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:23.114786  1533 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:03:23.085258  6219 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.182178  1675 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:23.182327  1526 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:23.106617  6091 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.183144  1680 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:23.109251  6299 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.089016  6184 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.186893  6223 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:23.247748  1684 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:23.247805  1535 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:23.194432  6359 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.089181  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:03:23.278172  1529 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:23.264389  6056 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.291903  1534 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.296698  1534 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:23.298748  6356 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:23.298122  6095 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:23.299891  6235 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.300642  6235 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.303311  6235 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:23.312685  6354 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:23.269716  6285 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.186594  6199 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.249287  6197 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:23.272547  6280 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.289980  6360 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.295200  6162 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.344369  1534 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.319398  6359 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:23.303874  6235 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.355834  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.330143  6223 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.325937  6056 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.361445  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.343093  6230 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:23.359324  6360 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:23.371042  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.380502  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:23.292065  6299 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.388321  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.394744  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.395529  1535 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:23.395713  6361 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:03:23.388125  6340 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:03:23.358654  6280 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:23.398792  6355 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:23.384441  6223 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.401762  6368 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.407366  6201 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.005s
I20260709 13:03:23.410493  6034 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.413461  6359 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.414573  6230 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.379793  6235 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.369716  6285 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.432457  1534 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:23.434791  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54378.8us
I20260709 13:03:23.436558  1529 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.472448  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.424449  6068 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.391392  6162 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.481833  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.483860  1529 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:23.485281  1604 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:23.486647  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:23.492224  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 306418us
I20260709 13:03:23.526845  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.527328  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.528213  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.448670  6367 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.355742  6219 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.531253  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.550758  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:23.547205  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.553258  1675 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
W20260709 13:03:23.559408  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.561614  1528 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.479440  6285 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:23.588843  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44077.5us
W20260709 13:03:23.589051  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 106441us
I20260709 13:03:23.591615  1675 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:23.593261  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.474471  6368 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.544831  6068 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.593638  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.594761  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:23.598850  1677 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.594036  1603 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:23.590030  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:23.601413  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.602718  1535 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.603742  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:23.564201  6212 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:23.609781  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.611591  6366 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.612164  6334 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:23.612666  6299 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.605445  6068 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.613533  6162 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.614253  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:23.620081  6370 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:03:23.621760  6339 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:23.622821  6235 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.623229  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.669545  1607 raft_consensus.cc:2368] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:23.611591  1533 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:23.622874  1531 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:23.625789  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.672000  1604 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.626045  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.626541  1608 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:23.627135  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.627218  6280 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.627709  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:23.674510  1682 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:23.674892  1682 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.628368  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.676041  1605 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.628422  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.629181  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.677726  1601 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.629494  6285 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.629595  6360 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.629859  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.630581  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.691243  1610 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:23.691560  1602 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:23.631724  6368 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.488677  6056 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:23.634786  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44835.2us
I20260709 13:03:23.636420  1529 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:03:23.636785  1677 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:23.588920  6367 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.700806  6367 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.688890  1682 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.673261  1606 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.679325  1603 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:23.646824  6283 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 13:03:23.694298  6378 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.698884  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 101942us
I20260709 13:03:23.699646  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:23.696127  1529 pending_rounds.cc:85] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:23.706523  1529 pending_rounds.cc:107] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:23.706827  1529 raft_consensus.cc:2889] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:23.669373  6199 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:23.647987  6212 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:23.634799  6340 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 13:03:23.705145  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81799us
I20260709 13:03:23.714973  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.715732  1610 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:23.702375  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95105.6us
I20260709 13:03:23.675082  6300 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:23.718540  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.719295  1605 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:23.719348  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.720708  1602 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:23.714164  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.717820  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.723232  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:23.725956  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:23.726692  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:23.728305  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.649493  6366 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.723838  6300 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.714723  6346 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:23.733734  6350 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.773191  1535 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:23.737908  6344 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.739760  6235 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:23.741679  6388 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.722528  6199 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.743871  6340 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.724897  6360 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.798381  6035 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.798501  6360 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:23.799013  6035 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.799530  6360 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.800642  6223 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.749089  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.801268  6035 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.752746  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.801811  1527 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 10: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.802251  1529 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.802806  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.803262  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.803777  1527 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.804366  1682 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.804491  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.805245  1529 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:23.753767  6295 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.769181  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.820204  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.821251  1527 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:23.821915  6334 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:23.822088  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.822402  6334 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.822947  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.824081  6390 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.824252  6340 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.824622  6390 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.825378  6340 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.826164  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.826792  1529 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:23.826915  6390 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:23.827608  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.771694  1606 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:23.771826  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.828351  1605 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.814057  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.829025  1533 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.733616  6379 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:03:23.773581  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.709335  6283 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.830871  6366 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.830157  6295 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.832060  6295 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.832719  6283 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.742226  6299 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.780855  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.833529  6299 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.780938  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.755280  6091 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.834196  6295 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.834199  1531 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.835616  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.782001  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:23.775573  5921 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.001s
I20260709 13:03:23.829834  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:23.784667  6308 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.089s	user 0.001s	sys 0.012s
I20260709 13:03:23.772861  6212 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.836279  1530 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:03:23.845672  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.846899  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.847196  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.847316  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.841236  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.848174  1530 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:23.852605  1682 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:23.796620  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.856871  1602 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:23.712142  6378 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.798126  6199 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.864310  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.865098  1535 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.865895  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.866628  1535 raft_consensus.cc:2393] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.773970  6300 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:23.809553  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.867600  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:23.811102  6176 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:23.813992  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.869648  1532 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.823309  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.763042  1609 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:23.870877  1682 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:23.766685  1604 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:23.769750  1601 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:23.847517  1677 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:23.778528  6235 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.777844  6350 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.830883  1526 raft_consensus.cc:2368] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:23.877245  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.878486  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.877851  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.879164  1677 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:23.879706  1607 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:23.877393  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.848624  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.849145  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.884370  1606 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.849320  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:23.850675  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.852662  1605 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:23.795523  6388 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.837457  1531 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.843099  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.835860  6299 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.836107  6068 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.861560  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.861773  1684 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:03:23.844486  5921 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.835980  6091 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.862612  1680 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:23.862857  6349 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.863597  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.875892  6176 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:23.876639  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.888181  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.907316  1602 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:23.859819  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 89189.4us
I20260709 13:03:23.896801  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.908342  1683 raft_consensus.cc:2410] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:23.908604  1526 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:23.909668  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.876945  6368 raft_consensus.cc:2764] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:23.914041  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.914613  1602 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.898305  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.898463  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.919901  1604 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.899291  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.899392  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.900359  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.900568  1678 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:23.931385  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:23.902053  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.933823  1609 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.904949  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.934772  1532 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.906013  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.906080  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.936533  1607 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.897719  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.937486  1530 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.878283  6235 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.910888  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.912403  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:23.940222  1675 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.922911  6388 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.913473  1533 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:23.877923  6283 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:23.912618  6176 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:23.920529  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.921115  6035 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:23.924402  1526 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.898525  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:23.900121  5749 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.932480  1601 raft_consensus.cc:2393] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:23.964112  1606 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:23.967432  1528 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:03:23.950825  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.971516  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:23.972324  1605 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:23.974890  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.938802  1682 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:23.942957  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:23.947042  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 223927us
I20260709 13:03:23.901185  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.981007  1604 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:23.977744  1433 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 56) took 5847 ms. Trace:
I20260709 13:03:23.978693  1679 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:23.983385  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:23.987550  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:23.997884  1609 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:24.000002  1675 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:24.005666  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.002395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:24.004662  1683 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:24.003383  1604 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:24.013707  1678 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:23.971796  5921 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:23.977427  6283 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.020867  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:24.019672  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:24.026571  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:24.029565  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:24.030081  6280 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:24.030383  6162 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:24.030565  6280 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.030949  6162 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.031824  6162 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.034875  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:24.019559  1609 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.026271  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.020066  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:24.002029  6378 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.037181  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:24.085857  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 64419.3us
W20260709 13:03:24.088465  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50931.3us
I20260709 13:03:24.089273  1602 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:24.091370  6120 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.090008  6308 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:24.091830  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.089630  6360 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.021386  6176 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.983326  6035 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:23.978427  5749 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.096392  1605 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [10.7-14.9]
I20260709 13:03:24.099525  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:24.108772  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:24.108985  1683 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.982663  1433 rpcz_store.cc:276] 0709 13:03:18.124212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.142121 (+ 17909us) service_pool.cc:224] Handling call
0709 13:03:23.971391 (+5829270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:22.480866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:22.481593 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:22.481648 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:03:22.481682 (+    34us) tablet.cc:662] Decoding operations
0709 13:03:22.482420 (+   738us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:22.538385 (+ 55965us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:22.539871 (+  1486us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:22.595303 (+ 55432us) tablet.cc:701] Row locks acquired
0709 13:03:22.595352 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:03:22.595534 (+   182us) write_op.cc:270] Start()
0709 13:03:22.595677 (+   143us) write_op.cc:276] Timestamp: P: 1783602202595461 usec, L: 0
0709 13:03:22.595712 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:03:22.596366 (+   654us) log.cc:844] Serialized 1685 byte log entry
0709 13:03:23.008527 (+412161us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.390540 (+382013us) write_op.cc:301] APPLY: starting
0709 13:03:23.402156 (+ 11616us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.405222 (+  3066us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.405345 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.407746 (+  2401us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.407985 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:03:23.409242 (+  1257us) write_op.cc:312] APPLY: finished
0709 13:03:23.464493 (+ 55251us) log.cc:844] Serialized 48 byte log entry
0709 13:03:23.475975 (+ 11482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.480407 (+  4432us) write_op.cc:454] Released schema lock
0709 13:03:23.484588 (+  4181us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.563991 (+ 79403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.575390 (+ 11399us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":148077,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":340942,"apply.run_cpu_time_us":7617,"apply.run_wall_time_us":155268,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":237461,"prepare.run_cpu_time_us":31882,"prepare.run_wall_time_us":322649,"raft.queue_time_us":218176,"raft.run_cpu_time_us":11295,"raft.run_wall_time_us":256493,"replication_time_us":412629,"thread_start_us":712937,"threads_started":4,"wal-append.queue_time_us":190893}]]}
W20260709 13:03:24.102015  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67215.4us
I20260709 13:03:24.110309  1647 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:24.104275  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:24.111900  1607 raft_consensus.cc:2410] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:03:24.107270  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.114624  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.112653  6379 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:24.087669  5921 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.116473  5921 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.116586  1528 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:24.116887  5921 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.117069  1607 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:24.118848  1527 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:03:24.119112  1607 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:24.087917  6367 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:24.120265  1607 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:24.121585  1607 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:24.121975  5749 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:24.122535  1607 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:24.112171  6388 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:03:24.123958  1607 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:24.124698  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.122550  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.031536  6280 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.128327  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 90782.5us
I20260709 13:03:24.123795  6230 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:24.129452  1607 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.036535  6199 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:03:24.129750  1532 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:24.108268  6378 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.140210  1607 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:24.140511  6369 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:24.144004  1647 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:24.148130  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.136569  6184 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.136008  6230 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.142585  6308 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:24.105053  6120 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.151767  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.137676  6359 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:24.153409  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61690.6us
I20260709 13:03:24.153348  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.141386  6068 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:24.146651  6280 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.150745  6396 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.186695  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:24.148950  5749 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.151779  6184 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.154539  6091 raft_consensus.cc:2764] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:24.150866  6385 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:03:24.155854  6230 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.186952  6295 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.196414  1498 leader_election.cc:400] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:24.196126  1576 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.196878  6337 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.196453  1533 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:24.182228  6068 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:24.212965  6399 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 13:03:24.212636  6390 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:24.195195  6299 raft_consensus.cc:2764] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:03:24.213752  6395 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:03:24.214062  6120 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.191805  6396 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:24.215411  6392 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:03:24.216471  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 72505.3us
I20260709 13:03:24.149878  6388 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:03:24.217741  6389 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.146026  6378 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.213703  6386 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:24.220113  6212 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.181622  6343 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:03:24.223991  6035 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:24.216364  6398 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:03:24.231416  1531 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:24.288172  6377 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:24.262512  1498 leader_election.cc:403] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:24.232801  6184 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.269570  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:24.272162  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 118920us
W20260709 13:03:24.273200  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77174us
I20260709 13:03:24.192157  6349 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:03:24.294688  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:24.182139  6283 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.286811  6068 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.294334  6396 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:24.329804  6391 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:03:24.335126  6068 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.347020  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 150713us
I20260709 13:03:24.347396  6212 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:24.347908  1498 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:24.348275  1498 leader_election.cc:403] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:24.349341  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:24.350548  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.352216  6385 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:24.353092  1601 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:24.154996  6308 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:24.270762  6295 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.352414  6035 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.310068  6389 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:24.356281  6201 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.357549  6120 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:24.369117  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:24.414743  1601 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:24.370494  1607 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:24.357836  6199 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:24.375908  6396 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.377054  6334 consensus_meta.cc:287] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:03:24.382429  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.386996  1683 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:24.390486  6230 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.395426  6308 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.356638  6068 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.397114  1679 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:03:24.444730  1679 pending_rounds.cc:85] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 9
I20260709 13:03:24.444978  1679 pending_rounds.cc:107] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:03:24.445201  1679 raft_consensus.cc:2889] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:24.399251  6386 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:24.360818  6379 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:03:24.402487  6397 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 13:03:24.355805  1498 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.357916  6377 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:24.403865  6360 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:24.404452  6401 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:03:24.382017  6350 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.430913  1533 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:24.382788  6300 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.458901  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 103149us
I20260709 13:03:24.389581  5921 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.464231  6393 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.422s	user 0.000s	sys 0.002s
I20260709 13:03:24.473142  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:24.444440  6120 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.450754  6386 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.495649  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.500025  1601 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:24.465785  6385 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:24.500716  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:24.506839  1610 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:24.509328  1533 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:24.445461  6334 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:24.521093  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.500010  6035 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.523167  1533 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:24.498521  6378 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.502271  6308 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.516703  6280 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:24.560705  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 200828us
I20260709 13:03:24.566641  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:24.524974  6162 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.522442  6385 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.526695  6201 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:24.577322  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56326.5us
I20260709 13:03:24.577702  1601 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:24.578117  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.558807  6379 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:24.559674  6032 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:24.580885  6068 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.580698  6201 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.581365  6068 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.582258  1574 leader_election.cc:336] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.657s (SENT)
I20260709 13:03:24.582693  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:24.584017  1574 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.714s (SENT)
I20260709 13:03:24.584335  6068 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.584453  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.584848  5921 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.585041  6334 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:24.585266  6068 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:24.587306  1574 leader_election.cc:336] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.916s (SENT)
W20260709 13:03:24.587963  6413 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:24.587867  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:24.588922  6068 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:24.577013  6120 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.595934  6230 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:24.597447  6235 consensus_meta.cc:287] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.004s
I20260709 13:03:24.597887  6235 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.495222  6389 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.564560  6377 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.566745  6280 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.660590  1601 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:24.613094  1603 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:24.671442  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 93368.9us
I20260709 13:03:24.601660  6379 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.584017  6360 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.599303  6295 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.676968  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:24.667759  5921 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:24.575771  6162 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.666186  6032 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.675588  6344 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:24.657883  6184 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.669962  6380 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:24.694890  6386 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.675446  6379 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:24.687048  6385 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.696165  1601 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.579031  6217 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:03:24.695710  6396 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:24.723259  6416 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:03:24.695957  6344 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.709039  5921 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.734236  6344 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.708163  6280 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.738977  1532 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:24.739157  1601 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:03:24.745092  1532 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:24.726930  6032 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.750875  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 183743us
I20260709 13:03:24.716312  6351 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:24.721529  6287 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:03:24.722807  6295 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:24.754592  6035 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:24.761693  6287 consensus_queue.cc:1243] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:24.784957  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:24.790727  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 274132us
I20260709 13:03:24.803488  1605 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:24.807466  1605 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:24.788870  6235 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.790351  5921 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.788378  6162 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.824241  1605 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:24.832412  6217 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:24.844724  6217 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:24.846679  6423 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:24.847051  6217 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:24.847777  6414 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:03:24.848433  6424 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:03:24.839211  6432 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:24.811995  6351 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:03:24.840735  6334 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:03:24.823709  6420 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:03:24.838184  1605 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:03:24.855822  6400 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.764s	user 0.006s	sys 0.000s
I20260709 13:03:24.869632   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.873999  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:24.874794  1605 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:24.882578  6035 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:24.883226  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.885090  1605 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:24.883116  6035 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:24.886389  1605 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:24.887094  6035 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:24.868435  6217 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.890254  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.841023  6439 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:03:24.880594  6032 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.901659  6032 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.903723  6032 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:24.896837  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.906333  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.907407  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.881827  6162 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:24.908193  6162 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.909034  6162 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.910238  6162 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.900409  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.912572  1528 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:24.912357  6428 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:24.913466  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.900652  1609 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:24.914587  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.894646  6217 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.915856  6442 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.916558  6442 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:24.917297  6217 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:24.919175  6442 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:24.904670  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.896070  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.919772  6433 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.924434  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.879812  6199 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:24.936702  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.939225  1533 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:24.969004  1533 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.940212  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.940832  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1841) took 1148 ms. Trace:
I20260709 13:03:24.942117  6343 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.969822  1530 rpcz_store.cc:276] 0709 13:03:23.792667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.938168 (+145501us) service_pool.cc:224] Handling call
0709 13:03:24.940597 (+1002429us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540003eb54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:24.940748 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146493824}
I20260709 13:03:24.887605  6035 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.949507  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2245) took 1311 ms. Trace:
I20260709 13:03:24.969921  1528 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:24.981665  1610 rpcz_store.cc:276] 0709 13:03:23.632749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.780642 (+147893us) service_pool.cc:224] Handling call
0709 13:03:24.944120 (+1163478us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54003b2754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:24.944253 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545617280}
I20260709 13:03:24.944017  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:25.002285  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.002962  1610 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:25.006203  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.008721  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.012573  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.013407  1610 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:24.994799  6343 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.019078  2212 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:25.020442  6343 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.021751  6440 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:25.022722  6440 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:25.023047  6440 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:24.999366  6035 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.029835  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:24.994248  6433 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.033432  1610 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:03:25.039968  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.040627  1530 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:25.041891  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.045449  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2243) took 1413 ms. Trace:
I20260709 13:03:25.045593  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2244) took 1413 ms. Trace:
I20260709 13:03:25.039789  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:25.046027  1602 rpcz_store.cc:276] 0709 13:03:23.632432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.101340 (+468908us) service_pool.cc:224] Handling call
0709 13:03:24.111203 (+  9863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:24.124245 (+ 13042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.124275 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:24.124806 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:03:24.307162 (+182356us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:24.433344 (+126182us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.045188 (+611844us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.045353 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.045409 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.045443 (+    34us) raft_consensus.cc:1685] finished
0709 13:03:25.045452 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.045538 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":618069,"prepare.queue_time_us":731585,"raft.queue_time_us":9123,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":8553,"thread_start_us":294710,"threads_started":2,"wal-append.queue_time_us":274888}
I20260709 13:03:25.045894  1604 rpcz_store.cc:276] 0709 13:03:23.632155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.089980 (+457825us) service_pool.cc:224] Handling call
0709 13:03:24.090336 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.095408 (+  5072us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:24.155659 (+ 60251us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.311799 (+156140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.356329 (+ 44530us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.356846 (+   517us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:24.397419 (+ 40573us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18003c9820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:25.035698 (+638279us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b18003c9820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f469bf4d58f 00007f4694f8c571 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd
0709 13:03:25.044854 (+  9156us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.045144 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.045217 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.045256 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:25.045267 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.045394 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698675,"prepare.queue_time_us":187609,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2821,"raft.queue_time_us":10227,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":5255,"spinlock_wait_cycles":11430912,"thread_start_us":98123,"threads_started":2,"wal-append.queue_time_us":269955}
I20260709 13:03:25.045603  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2241) took 1414 ms. Trace:
I20260709 13:03:25.054157  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.060604  1684 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:25.061889  1677 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:25.061916  1681 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:25.056986  6433 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.023837  6440 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:25.064536  1675 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:25.060370  1610 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:25.067399  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.068548  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.063915  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.056639  5749 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:25.076020  1677 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.056281  6056 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.077047  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.078265  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.095448  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.064226  5921 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:25.098563  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.101303  1604 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:03:25.072718  6428 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.102402  1604 pending_rounds.cc:85] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 7
I20260709 13:03:25.109368  1604 pending_rounds.cc:107] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:03:25.109702  1604 raft_consensus.cc:2889] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.111044  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:25.111778  1604 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:25.116882  5921 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.118000  5921 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.119282  1677 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:25.050506  6283 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:03:25.120187  6035 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:25.120410  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.120638  6283 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:25.120805  1681 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:25.121120  6283 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.122187  1681 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:25.121955  6283 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.123076  6283 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.078812  6447 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.126763  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.129133  1530 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:25.123811  6447 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:25.102021  6448 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:25.098172  6440 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.134177  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.053957  6344 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.134836  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.137265  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.136351  6295 consensus_queue.cc:1243] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:25.147948  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.152832  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.092599  5749 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.158881  1675 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:25.099275  6056 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.163499  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:25.168284  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.172233  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.173216  1680 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:25.173908  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.175836  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.174688  1604 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:25.176929  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:25.133064  6379 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.190552  1682 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:25.198721  6162 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:25.199245  6162 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.205732  1533 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.206810  1533 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.209880  6056 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.211699  6386 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:25.214095  6385 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:25.219264  6385 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:25.219700  6344 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.220623  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.221336  1534 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:25.134639  6428 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.222124  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.223273  6428 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.214824  1532 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:25.214740  6441 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.224342  6441 consensus_queue.cc:1243] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:25.215562  6295 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:25.225052  1530 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:03:25.225162  1684 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.216125  6280 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:25.216421  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.226035  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.226293  1532 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.226395  1528 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:25.227196  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.227111  1532 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.227814  1679 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:25.228658  1532 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.228715  6351 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:25.229166  6351 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.230034  6351 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.230607  6462 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:25.231232  6351 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:25.232906  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2238) took 1605 ms (client timeout 2020 ms). Trace:
W20260709 13:03:25.233278  1603 rpcz_store.cc:269] 0709 13:03:23.627827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.724679 (+ 96852us) service_pool.cc:224] Handling call
0709 13:03:25.232732 (+1508053us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400171bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:25.232852 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790834048}
I20260709 13:03:25.217336  6447 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:25.219650  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.235174  1677 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:25.215751  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:25.253850  1532 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:03:25.240562  5749 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.200104  6162 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.254220  6447 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:25.274443  6447 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:25.275794  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.276682  1682 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:25.277524  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.279273  6379 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:25.285564  1533 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:25.258852  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.284924  1679 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:25.289458  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.259132  1527 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:25.273759  6300 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:25.262259  6287 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:25.264672  6452 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.271901  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.257045  1528 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:25.302085  1529 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:25.282738  6447 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:25.292619  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:25.299342  6165 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.293282  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.296862  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.305503  1609 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:25.255617  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:25.306437  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50881us
I20260709 13:03:25.300233  5749 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.219673  6385 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.307862  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:25.308921  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:25.329365  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 140115us
W20260709 13:03:25.333837  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.340330  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:25.343989  1682 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:25.329599  6437 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:25.355196  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:25.336318  6377 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:25.360433  2175 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:25.341040  6441 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:25.374708  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:25.375197  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.364761  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.377290  1682 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:25.379077  1532 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:25.329489  6447 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:25.345393  6380 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:25.416960  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.418774  1601 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:25.336685  6452 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:03:25.378193  6441 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.373950  6437 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:25.384944  5921 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.432535  1607 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:25.443094  1607 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:25.444388  1607 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:25.384258  6377 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:25.446992  1607 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:25.416560  6385 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.450141  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.454424  1601 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:25.465269  1607 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:03:25.439738  6441 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.543581  1607 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:03:25.544917  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.563361  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.425369  6380 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:25.584992  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:25.585956  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 225648us
I20260709 13:03:25.600373  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:25.601924  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:25.605777  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.606781  1531 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:25.613646  1527 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:25.051806  1606 rpcz_store.cc:276] 0709 13:03:23.631610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.022903 (+391293us) service_pool.cc:224] Handling call
0709 13:03:24.086467 (+ 63564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.104007 (+ 17540us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:24.273520 (+169513us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.361460 (+ 87940us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.388881 (+ 27421us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.389057 (+   176us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:25.045132 (+656075us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.045323 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.045388 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.045423 (+    35us) raft_consensus.cc:1685] finished
0709 13:03:25.045433 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.045538 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1388868,"prepare.queue_time_us":861949,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2250,"raft.queue_time_us":13192,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":15166,"thread_start_us":185724,"threads_started":2,"wal-append.queue_time_us":457146}
I20260709 13:03:25.638772  6184 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:25.640554  6468 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:03:25.643568  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.644181  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.644734  1528 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.644944  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.646059  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.646714  1529 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:25.647830  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:25.647408  6377 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.648407  1533 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:25.649505  1533 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:25.651597  1528 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:25.653607  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.654192  1604 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 11.
W20260709 13:03:25.657522  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 55712.4us
I20260709 13:03:25.658324  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:25.659303  1604 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:25.462518  5921 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:25.704803  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46555us
W20260709 13:03:25.664772  6427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.027s	sys 0.035s
I20260709 13:03:25.705853  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:25.661550  6447 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:25.712720  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 125620us
I20260709 13:03:25.723493  1530 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:25.657852  6471 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:25.709309  6427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.027s	sys 0.035s
I20260709 13:03:25.731778  6300 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.724594  6474 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:25.756876  1530 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:25.735932  6473 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:25.678392  6475 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:25.767174  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:25.677688  6437 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:25.805681  1601 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:25.806819  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.758267  6300 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:25.804809  6283 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.007s
I20260709 13:03:25.843926  1534 raft_consensus.cc:2410] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:25.843968  6380 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:25.845208  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 160464us
I20260709 13:03:25.848218  6389 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:25.848634  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.859400  1602 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:25.850149  6442 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:25.850984  1530 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:03:25.851363  6346 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:25.857100  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:25.864573  1682 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 12.
I20260709 13:03:25.849434  6197 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:25.873540  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:25.878904  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:25.880113  1602 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:25.882005  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:25.882843  1604 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:25.862895  6466 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:25.868944  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:03:25.926597  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 160272us
W20260709 13:03:25.926223  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58883.2us
I20260709 13:03:25.931006  1606 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:03:25.934059  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60617.4us
I20260709 13:03:25.935009  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:25.938891  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:25.979828  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 237795us
I20260709 13:03:25.974442  6380 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:25.865403  6176 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:03:25.999010  6380 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:25.979715  6476 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:03:26.017046  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.200377  6493 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:26.201525  1606 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:26.128470  6475 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
W20260709 13:03:26.133236  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 198328us
I20260709 13:03:26.188406  6496 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:25.930789  6344 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:03:26.190894  6441 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.009s
I20260709 13:03:25.923705  6219 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:03:25.868407  6367 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:03:26.202358  1604 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:26.244627  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1930) took 1110 ms. Trace:
I20260709 13:03:26.245219  1602 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:26.248152  1606 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:26.203110  6380 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.202433  6176 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.247236  1675 rpcz_store.cc:276] 0709 13:03:25.138233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.175915 (+ 37682us) service_pool.cc:224] Handling call
0709 13:03:25.176330 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.186376 (+ 10046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.186493 (+   117us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.187659 (+  1166us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.385613 (+197954us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:25.385652 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.385717 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.244382 (+858665us) raft_consensus.cc:1685] finished
0709 13:03:26.244401 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.244554 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":281,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6556,"thread_start_us":146706,"threads_started":1,"wal-append.queue_time_us":544811}
I20260709 13:03:26.203728  6056 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.233989  6340 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:26.238444  6478 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.382s	user 0.000s	sys 0.010s
W20260709 13:03:26.244287  6351 consensus_meta.cc:287] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.013s	user 0.023s	sys 0.001s
I20260709 13:03:26.233000  6496 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:26.256822  6488 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.388s	user 0.002s	sys 0.008s
I20260709 13:03:26.256693  5921 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:26.284564  1529 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:26.265825  6056 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.246469  6441 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:26.292634  6486 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:26.278563  6496 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.272996  6176 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.286991  6056 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.309387  1531 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:26.278431  6340 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.264559  6197 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:03:26.313910  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 66555.9us
I20260709 13:03:26.315672  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:26.326341  6120 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:03:26.334543  6426 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.335331  6426 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.334703  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2337) took 1272 ms. Trace:
I20260709 13:03:26.336395  6380 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:26.336303  1676 rpcz_store.cc:276] 0709 13:03:25.061973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.064868 (+  2895us) service_pool.cc:224] Handling call
0709 13:03:25.065108 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.185043 (+119935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.185075 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.185121 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:25.185152 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.334467 (+1149315us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000be0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:26.334517 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.334646 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275383168}
I20260709 13:03:26.339116  6426 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.340969  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1929) took 1232 ms. Trace:
I20260709 13:03:26.349176  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:26.350088  1675 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:26.352672  1675 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.356520  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:26.359124  1683 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:26.361761  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2272) took 1184 ms. Trace:
I20260709 13:03:26.346423  1677 rpcz_store.cc:276] 0709 13:03:25.108771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.120087 (+ 11316us) service_pool.cc:224] Handling call
0709 13:03:26.340713 (+1220626us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000bead4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:26.340877 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262330624}
I20260709 13:03:26.313445  6300 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.368450  1679 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:26.362311  1607 rpcz_store.cc:276] 0709 13:03:25.177921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.568826 (+390905us) service_pool.cc:224] Handling call
0709 13:03:25.578822 (+  9996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.596236 (+ 17414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.596289 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.617750 (+ 21461us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.803456 (+185706us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:25.812221 (+  8765us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.812437 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.812508 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.361502 (+548994us) raft_consensus.cc:1685] finished
0709 13:03:26.361532 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.361686 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2117,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":7502,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":27677,"spinlock_wait_cycles":14720,"thread_start_us":95330,"threads_started":1,"wal-append.queue_time_us":186642}
I20260709 13:03:26.373415  1676 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:03:26.305996  6475 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:26.361166  6497 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.366735  6426 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:26.396763  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 179425us
I20260709 13:03:26.399057  6340 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.399765  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.401372  5749 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.402005  5749 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.402545  5749 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.394320  6426 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:26.404824  6441 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.406363  6426 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:26.407022  6426 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:26.410420  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1858) took 1469 ms. Trace:
I20260709 13:03:26.410893  1534 rpcz_store.cc:276] 0709 13:03:24.941401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.221851 (+280450us) service_pool.cc:224] Handling call
0709 13:03:26.410176 (+1188325us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000dc354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:26.410324 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386039040}
I20260709 13:03:26.416644  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.374322  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:26.417805  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43590.5us
I20260709 13:03:26.417690  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.387892  6497 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.433640  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.437417  6389 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:26.441046  6428 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:26.444090  6460 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.061s	user 0.002s	sys 0.001s
I20260709 13:03:26.444728  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 269) took 1584 ms. Trace:
I20260709 13:03:26.465422  1609 rpcz_store.cc:276] 0709 13:03:24.860617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.382607 (+521990us) service_pool.cc:224] Handling call
0709 13:03:25.429574 (+ 46967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.435666 (+  6092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.435695 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.442400 (+  6705us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.862745 (+420345us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:25.862794 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.862882 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.440224 (+577342us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b24002b2548. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcafb0 00007f4697c41488 00007f4697c41be8 00007f4697c19398 00007f4697c1476a 00007f4697c13bb6
0709 13:03:26.444394 (+  4170us) raft_consensus.cc:1685] finished
0709 13:03:26.444415 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.444638 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6125,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5853,"spinlock_wait_cycles":99328768,"thread_start_us":284822,"threads_started":1,"wal-append.queue_time_us":723290}
I20260709 13:03:26.445377  6176 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.432423  6219 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:03:26.432209  6340 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:26.449445  6235 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.450176  6380 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.456822  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:26.475507  1683 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.451452  6442 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:26.450996  6367 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:26.473325  6433 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:26.492846  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.501233  6496 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.491704  6367 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.490212  6442 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.483304  6502 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:03:26.492422  6176 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.476835  6235 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.512336  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.517004  1607 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:26.529940  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2341) took 2582 ms. Trace:
W20260709 13:03:26.548915  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 166629us
I20260709 13:03:26.551774  1683 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 13.
I20260709 13:03:26.555868  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:26.495162  6500 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:03:26.472992  6056 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.560022  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.504642  6442 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.504318  6367 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.512777  6235 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.544480  1608 rpcz_store.cc:276] 0709 13:03:23.947953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.460797 (+512844us) service_pool.cc:224] Handling call
0709 13:03:24.461207 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.471393 (+ 10186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:25.097861 (+626468us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.172821 (+ 74960us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.181103 (+  8282us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.181225 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:25.181258 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.181319 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.443361 (+1262042us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:26.513233 (+ 69872us) raft_consensus.cc:1685] finished
0709 13:03:26.529689 (+ 16456us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.529878 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567940,"prepare.queue_time_us":566929,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":24839,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":47009,"spinlock_wait_cycles":159806336,"thread_start_us":102370,"threads_started":2,"wal-append.queue_time_us":219429}
I20260709 13:03:26.566380  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:26.566990  1608 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.509910  6433 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:26.568696  6433 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.503769  6496 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.564186  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:26.576736  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.577714  1609 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:26.581624  6056 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.565181  6482 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:26.582780  6482 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:26.583869  6482 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:26.587208  1608 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:26.573907  6470 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.124s	user 0.000s	sys 0.004s
I20260709 13:03:26.512472  6176 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.595700  6176 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.599915  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2352) took 2074 ms. Trace:
I20260709 13:03:26.600739  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2269) took 1430 ms. Trace:
I20260709 13:03:26.601141  1603 rpcz_store.cc:276] 0709 13:03:25.170921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.544733 (+1373812us) service_pool.cc:224] Handling call
0709 13:03:26.600680 (+ 55947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:26.598546  6447 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.602284  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:26.602795  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.602890  1603 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:03:26.605762  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.606278  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.604717  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 186138us
I20260709 13:03:26.574205  6501 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:26.565666  6428 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.609807  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.600384  1605 rpcz_store.cc:276] 0709 13:03:24.525424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.887054 (+361630us) service_pool.cc:224] Handling call
0709 13:03:24.887368 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:24.937764 (+ 50396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.937795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:24.938308 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 13:03:25.052683 (+114375us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:25.100547 (+ 47864us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.151452 (+ 50905us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.213196 (+ 61744us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18003f02e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:26.272171 (+1058975us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b18003f02e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:26.599456 (+327285us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18003f02e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287
0709 13:03:26.599609 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.599680 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.599728 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:26.599740 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.599859 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87173,"prepare.queue_time_us":133786,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":10191,"raft.queue_time_us":68168,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":28665,"spinlock_wait_cycles":19600512,"thread_start_us":137694,"threads_started":2,"wal-append.queue_time_us":154097,"wal-append.run_cpu_time_us":5896,"wal-append.run_wall_time_us":1097742}
I20260709 13:03:26.571557  5749 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.614804  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:26.615482  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:26.629492  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 923657us
I20260709 13:03:26.630528  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:26.623450  6433 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.611614  6502 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.608538  6056 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.610512  6501 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.661499  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:26.665055  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.613554  6340 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.676704  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.679000  1530 raft_consensus.cc:2376] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18. Re-sending same reply.
I20260709 13:03:26.624060  6197 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:26.679894  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.679451  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:03:26.681483  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 72800.3us
I20260709 13:03:26.682832  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.623970  6504 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:26.684067  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.689445  1532 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:26.680915  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.691223  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:26.697465  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82723.3us
I20260709 13:03:26.615700  6428 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.670418  6357 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.656800  6515 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.679080  6501 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:26.708400  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.746414  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 116013us
I20260709 13:03:26.709311  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:26.748463  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:26.684170  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:26.684808  6197 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.690901  6504 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.680392  6056 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.676199  6502 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:26.755625  6469 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.090s	user 0.004s	sys 0.000s
I20260709 13:03:26.750463  6515 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.767050  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2157) took 2318 ms. Trace:
I20260709 13:03:26.749603  6351 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.755398  6522 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:03:26.767066  6428 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.767673  6351 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.767455  1535 rpcz_store.cc:276] 0709 13:03:24.448470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.448652 (+   182us) service_pool.cc:224] Handling call
0709 13:03:24.449117 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.457185 (+  8068us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:24.457215 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.457666 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.282189 (+824523us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b18002db020. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:03:25.399296 (+117107us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:25.399336 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.399461 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.605750 (+1206289us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:26.766860 (+161110us) raft_consensus.cc:1685] finished
0709 13:03:26.766882 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.766995 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19280,"raft.queue_time_us":8329,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9193,"spinlock_wait_cycles":49603712,"thread_start_us":116921,"threads_started":1,"wal-append.queue_time_us":1090730}
W20260709 13:03:26.757937  6511 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:03:26.759722  6504 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.745867  6357 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.755302  6379 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.683732  6340 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.753242  6452 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:26.761498  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2336) took 1699 ms. Trace:
W20260709 13:03:26.770860  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64390.8us
I20260709 13:03:26.757333  6197 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.772467  6521 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.767689  6515 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.772734  6349 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:26.774222  6517 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:26.773949  6176 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:26.830528  6176 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:26.831017  6176 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:26.831938  6176 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.833707  6349 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:26.834163  6349 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:26.833964  6235 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.776101  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2335) took 1714 ms. Trace:
I20260709 13:03:26.770097  6351 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:26.807507  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59146.6us
I20260709 13:03:26.836841  1684 rpcz_store.cc:276] 0709 13:03:25.061406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.064125 (+  2719us) service_pool.cc:224] Handling call
0709 13:03:25.092324 (+ 28199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.225578 (+133254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.775366 (+1549788us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:26.776002 (+   636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305043712}
I20260709 13:03:26.806732  1680 rpcz_store.cc:276] 0709 13:03:25.061694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.063654 (+  1960us) service_pool.cc:224] Handling call
0709 13:03:26.760955 (+1697301us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54002d50d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:26.761429 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222507904}
I20260709 13:03:26.764186  6497 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.838337  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:26.837105  6235 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.839598  6497 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.841161  6497 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.841845  6283 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:26.842428  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.843430  6497 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.770772  6287 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.843802  6295 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:26.823781  5921 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:26.845194  6295 raft_consensus.cc:2764] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:26.843603  6283 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:26.844300  6287 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.763288  6528 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.851148  6528 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.851924  6287 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.853528  6340 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.808555  6452 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.854197  6452 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:26.856738  6524 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:26.865271  1527 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:26.806072  6379 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:26.852730  6287 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.867408  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:26.818495  6386 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:26.879272  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:26.880194  1602 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.882532  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.877525  6283 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.886396  6283 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:26.887217  6510 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:03:26.874912  6437 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.888804  6437 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.890326  6502 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.890983  5749 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.838965  6176 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.882402  5921 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:26.904588  5921 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.906354  6385 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.907685  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.908758  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.909006  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.910176  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.911173  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.911695  1526 raft_consensus.cc:2376] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16. Re-sending same reply.
I20260709 13:03:26.912389  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.912585  6280 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.913054  6280 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.913497  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:26.918056  6458 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.471s	user 0.003s	sys 0.005s
I20260709 13:03:26.919374  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2360) took 2107 ms. Trace:
I20260709 13:03:26.919806  1610 rpcz_store.cc:276] 0709 13:03:24.812454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.077092 (+264638us) service_pool.cc:224] Handling call
0709 13:03:25.107440 (+ 30348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.109911 (+  2471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.109975 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.110544 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.304963 (+194419us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:25.305014 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.305093 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.917334 (+1612241us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:26.919073 (+  1739us) raft_consensus.cc:1685] finished
0709 13:03:26.919093 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.919314 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6362,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":12901760,"thread_start_us":194063,"threads_started":1,"wal-append.queue_time_us":267675}
I20260709 13:03:26.921697  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.922242  6162 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.922791  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.924701  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.853528  6528 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.925350  1604 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:26.926452  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.875409  6357 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.927520  1604 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:26.911458  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.923358  1610 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:26.934810  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.835467  6349 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.943660  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.936957  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.941555  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:26.876695  6379 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.950127  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.950839  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.947952  1532 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:26.959447  1527 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:26.951275  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:26.971048  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.891911  6056 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:26.972750  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.973740  1527 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:26.864516  6184 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:03:26.977000  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.979501  1532 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:26.985726  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:26.942562  6350 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.991853  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:26.942799  6502 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:27.001430  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:27.003783  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:26.968506  6357 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.881444  6287 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.822839  6521 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.009503  6521 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.011433  6442 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:26.988965  6349 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.013907  6442 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.005887  6502 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.016417  6283 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.017488  6502 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.001390  6350 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.038219  6350 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:26.982096  6386 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:26.875275  6493 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:03:27.000757  1602 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:27.018898  1610 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:27.019187  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:27.029814  6377 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:27.030753  6452 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.038021  6367 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.040000  6287 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.040747  1526 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:03:27.076335  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.999214  1532 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:03:27.012022  6519 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:03:27.066793  1610 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:27.077226  1532 pending_rounds.cc:85] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 8
I20260709 13:03:27.086241  1532 pending_rounds.cc:107] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:03:27.086764  1532 raft_consensus.cc:2889] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:27.048192  6386 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.053826  6377 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:27.099800  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.089767  6351 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:27.109416  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 319270us
W20260709 13:03:27.095320  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 97033.4us
I20260709 13:03:27.098160  6386 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.124958  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:27.160329  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46961.9us
I20260709 13:03:27.162746  6536 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:27.163240  6536 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:27.163712  6536 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.171252  6367 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.174952  6501 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.176365  6032 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.176918  6032 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.177572  6437 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.179064  6032 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:27.182057  6539 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:27.183506  6120 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.184115  6120 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.186594  6120 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.111176  6496 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:03:27.189729  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2262) took 2081 ms. Trace:
I20260709 13:03:27.190207  1601 rpcz_store.cc:276] 0709 13:03:25.108246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.455224 (+346978us) service_pool.cc:224] Handling call
0709 13:03:25.455473 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.806261 (+350788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.189358 (+1383097us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:27.189627 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804806400}
I20260709 13:03:27.191679  1530 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
W20260709 13:03:27.194339  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.560s (SENT) [suppressed 27 similar messages]
I20260709 13:03:27.207702  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2187) took 1556 ms. Trace:
I20260709 13:03:27.208882  6504 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.198263  6474 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.228796  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.220525  6512 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.214522  1529 rpcz_store.cc:276] 0709 13:03:25.644542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.647151 (+  2609us) service_pool.cc:224] Handling call
0709 13:03:25.647418 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.285828 (+638410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.200594 (+914766us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54000de154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:27.200784 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459138432}
I20260709 13:03:27.207273  6531 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:27.230166  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 117035us
I20260709 13:03:27.201557  6120 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.240521  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.256407  6541 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:03:27.257292  6379 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.238552  6512 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.260809  6512 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.244907  6120 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.263985  6120 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.155615  6377 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.265434  6452 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.266196  6377 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.243486  6437 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.268401  6437 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.269258  6504 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.241413  6531 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:27.270566  6437 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.272239  6531 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:27.237869  6474 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:27.280550  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.281376  6501 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.281232  6536 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.280609  6197 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.283885  6536 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.287339  6386 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.289677  6386 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.292474  6197 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:27.294253  1682 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:03:27.303153  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 108854us
W20260709 13:03:27.305393  1574 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.635s (SENT)
I20260709 13:03:27.305951  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.308506  6197 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.308780  6549 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:03:27.307447  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67004.3us
I20260709 13:03:27.310125  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.310708  6531 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.318322  6501 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:27.319948  6467 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.871s	user 0.003s	sys 0.015s
I20260709 13:03:27.334728  1647 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:27.338567  6541 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:27.364876  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:27.366148  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.366628  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:27.367693  1683 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.371781  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.372473  1677 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:27.373276  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.374147  1677 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:27.375020  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.376243  1675 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:27.376783  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.377884  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.351841  6541 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:27.329404  6501 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:03:27.395022  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.387394  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.430508  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:27.399353  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.385890  1683 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
W20260709 13:03:27.451999  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57072.6us
I20260709 13:03:27.387650  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.455945  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.456173  1676 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 12: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:27.397886  1680 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:27.462038  1680 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:27.457335  6300 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.462960  6527 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.469843  1683 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:27.466142  1678 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:27.466245  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.472627  1683 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:27.458242  6548 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:03:27.474360  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49079.3us
I20260709 13:03:27.397559  6512 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:27.476020  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.361280  6531 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:03:27.399724  6280 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:27.490469  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.493893  1675 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:27.485505  6512 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.501312  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.474064  6522 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:03:27.488438  6541 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.508993  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:27.517997  1675 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:27.519429  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:27.519718  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53583.7us
I20260709 13:03:27.520638  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:27.494942  1420 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8c6031790cc44edfba5c3964e6f27c6e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:03:27.524652  1420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 95027.2us
I20260709 13:03:27.524165  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:27.523571  6340 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:27.506039  6512 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.537269  6531 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:27.537873  6531 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:27.538977  6531 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.543226  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2384) took 1080 ms. Trace:
I20260709 13:03:27.543776  1602 rpcz_store.cc:276] 0709 13:03:26.462442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.050955 (+588513us) service_pool.cc:224] Handling call
0709 13:03:27.051341 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:27.067929 (+ 16588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.067977 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:27.084865 (+ 16888us) log.cc:844] Serialized 52 byte log entry
0709 13:03:27.127128 (+ 42263us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:27.127171 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.127234 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.542886 (+415652us) raft_consensus.cc:1685] finished
0709 13:03:27.542919 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.543148 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":17411,"thread_start_us":24686,"threads_started":1,"wal-append.queue_time_us":222936}
I20260709 13:03:27.547075  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2397) took 1034 ms. Trace:
I20260709 13:03:27.549866  1684 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:27.543283  6561 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:03:27.553359  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2396) took 1040 ms. Trace:
I20260709 13:03:27.553793  1608 rpcz_store.cc:276] 0709 13:03:26.512716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.330554 (+817838us) service_pool.cc:224] Handling call
0709 13:03:27.330882 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.331282 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.331312 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.331920 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.470937 (+139017us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:27.470982 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.471046 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.553134 (+ 82088us) raft_consensus.cc:1685] finished
0709 13:03:27.553162 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.553296 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":131095,"threads_started":1,"wal-append.queue_time_us":162803}
I20260709 13:03:27.547576  1602 rpcz_store.cc:276] 0709 13:03:26.513040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.546020 (+1032980us) service_pool.cc:224] Handling call
0709 13:03:27.546426 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.546633 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.546673 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:27.546729 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.546776 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.546863 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.546998 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:27.520349  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:27.557655  1683 raft_consensus.cc:606] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.558202  1683 raft_consensus.cc:614] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.522820  6300 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:27.526237  6521 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:27.568442  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46552.5us
I20260709 13:03:27.569849  1574 leader_election.cc:400] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:27.570979  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.556667  6340 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.581507  6351 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.582167  6351 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.584939  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:27.585680  1534 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.563733  6300 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.588284  6300 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.589571  6498 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:27.590008  1682 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:27.591192  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.592378  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.593725  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.595378  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:27.596390  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.597023  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.601042  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.601543  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.602579  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.602960  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:27.600162  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 74354.9us
I20260709 13:03:27.606793  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:27.601153  6554 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:03:27.585841  6558 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:27.609156  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.615741  1675 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:27.610847  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.613886  1683 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:27.617276  1677 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:27.619884  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.599505  6484 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:27.618855  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:27.608345  6162 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.591310  6351 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.647348  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:27.642999  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 117083us
I20260709 13:03:27.642961  6349 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.643944  6484 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:27.615350  6437 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:03:27.675155  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.676211  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:27.671911  6556 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:03:27.689934  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2183) took 2046 ms (client timeout 2119 ms). Trace:
I20260709 13:03:27.690074  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:27.690703  1529 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.691284  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.692425  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:27.632368  6498 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:03:27.693251  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 122362us
I20260709 13:03:27.693503  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:27.690481  1531 rpcz_store.cc:269] 0709 13:03:25.643219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.643341 (+   122us) service_pool.cc:224] Handling call
0709 13:03:27.685678 (+2042337us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54000708d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:27.689873 (+  4195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529173760}
I20260709 13:03:27.694311  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.691740  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:27.697320  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.698058  1527 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:27.699338  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:27.699985  1603 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:27.700142  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:27.701164  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:27.694273  1535 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:27.700778  1534 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:27.705868  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.708161  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.719627  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.659030  6162 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.692050  6499 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:27.733966  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:27.734666  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87449.7us
I20260709 13:03:27.738413  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.746356  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:27.747263  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:27.684219  6197 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:03:27.761634  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67444us
I20260709 13:03:27.763001  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.710803  6386 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.753216  1603 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:27.765053  1529 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:27.748435  6553 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:03:27.810132  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 47184.4us
I20260709 13:03:27.813623  1529 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:27.812453  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.818964  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:27.805137  6565 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.808749  6504 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:27.818912  6567 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:27.814225  6386 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:27.762207  6484 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.859918  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:27.862581  1603 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:27.864650  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52284.4us
I20260709 13:03:27.865566  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.867264  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:27.868091  1531 raft_consensus.cc:606] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.868520  1531 raft_consensus.cc:614] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.869374  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2383) took 1407 ms. Trace:
I20260709 13:03:27.869889  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2394) took 1359 ms. Trace:
I20260709 13:03:27.869853  1607 rpcz_store.cc:276] 0709 13:03:26.462220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.026741 (+564521us) service_pool.cc:224] Handling call
0709 13:03:27.027320 (+   579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.041177 (+ 13857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.041212 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.041725 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.347463 (+305738us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:27.347520 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.347606 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.869169 (+521563us) raft_consensus.cc:1685] finished
0709 13:03:27.869190 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.869320 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13329,"raft.queue_time_us":13464,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":305343,"threads_started":1,"wal-append.queue_time_us":443452}
I20260709 13:03:27.874450  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.870556  1609 rpcz_store.cc:276] 0709 13:03:26.510597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.259382 (+748785us) service_pool.cc:224] Handling call
0709 13:03:27.259689 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:27.279679 (+ 19990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.279723 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:27.280336 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 13:03:27.317256 (+ 36920us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:27.321034 (+  3778us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.322579 (+  1545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.322649 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.869561 (+546912us) raft_consensus.cc:1685] finished
0709 13:03:27.869592 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.869814 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4013,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":5401,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":1515,"thread_start_us":36533,"threads_started":1,"wal-append.queue_time_us":149550}
I20260709 13:03:27.838371  6504 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.844513  6498 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:27.886505  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.882418  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.891736  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:27.895347  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 161466us
I20260709 13:03:27.897696  1574 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.898605  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.903059  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:27.885993  6565 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.836640  6576 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:03:27.913456  1678 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.925489  5921 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.926597  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1875) took 1017 ms. Trace:
I20260709 13:03:27.929328  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:27.889961  6504 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:27.936605  6575 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:27.858210  6386 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:27.889477  6571 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.892866  6351 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.933126  1526 rpcz_store.cc:276] 0709 13:03:26.909633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.936728 (+ 27095us) service_pool.cc:224] Handling call
0709 13:03:27.926394 (+989666us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b540003fa54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:27.926544 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210218240}
I20260709 13:03:27.894371  6570 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.907362  6561 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.906632  6484 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.934242  1607 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:27.907276  6568 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:27.954645  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73161049b574469ea08e360e2def1aac"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:27.948851  6162 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:27.957267  1526 raft_consensus.cc:606] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.959590  1526 raft_consensus.cc:614] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.959030  1603 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:27.945573  6565 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:27.965099  6572 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:03:27.966912  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2387) took 1503 ms. Trace:
I20260709 13:03:27.967854  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:27.968546  1526 raft_consensus.cc:606] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.970034   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:27.967263  1610 rpcz_store.cc:276] 0709 13:03:26.463126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.085615 (+622489us) service_pool.cc:224] Handling call
0709 13:03:27.085963 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.092013 (+  6050us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:27.096650 (+  4637us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.605857 (+509207us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18002f4820. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:03:27.681712 (+ 75855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.682330 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.682518 (+   188us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.682766 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.682983 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.683076 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.966697 (+283621us) raft_consensus.cc:1685] finished
0709 13:03:27.966724 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.966853 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51598,"prepare.queue_time_us":6921,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":68,"raft.queue_time_us":16179,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":21915,"spinlock_wait_cycles":22835712,"thread_start_us":63261,"threads_started":1,"wal-append.queue_time_us":697509}
I20260709 13:03:27.972420   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:27.982350  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:27.983251  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:27.990257  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 250229us
I20260709 13:03:27.995112  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:27.998395  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:27.999374  1607 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.006568  6452 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:28.008054  1531 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:28.004367  6349 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:03:27.973230  6568 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:28.019472  6568 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.020848  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2391) took 1556 ms. Trace:
I20260709 13:03:28.021600  6573 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:28.017163  6580 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:28.022531  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.017984  6574 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.021250  1606 rpcz_store.cc:276] 0709 13:03:26.464015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.231668 (+767653us) service_pool.cc:224] Handling call
0709 13:03:27.242817 (+ 11149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.243151 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.243179 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.255785 (+ 12606us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.317733 (+ 61948us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.564848 (+247115us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.020367 (+455519us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54002637a0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697ff4733 00007f4698079dbf 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c
0709 13:03:28.020420 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.020498 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.020541 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:28.020650 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.020792 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3367,"prepare.queue_time_us":3779,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":25449,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":1461,"spinlock_wait_cycles":23386880,"thread_start_us":405514,"threads_started":3,"wal-append.queue_time_us":197191}
I20260709 13:03:27.957564  6571 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:28.026993  6574 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:28.064772  6574 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.065990  6574 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.066092  6474 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:28.071403  6582 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 13:03:28.078583  1682 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:28.079660  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2399) took 1500 ms. Trace:
I20260709 13:03:28.080081  1602 rpcz_store.cc:276] 0709 13:03:26.579456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.559949 (+980493us) service_pool.cc:224] Handling call
0709 13:03:27.572628 (+ 12679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.693103 (+120475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.693140 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.693605 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.814035 (+120430us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:27.814069 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.814137 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.079458 (+265321us) raft_consensus.cc:1685] finished
0709 13:03:28.079478 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.079604 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12407,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"thread_start_us":180886,"threads_started":2,"wal-append.queue_time_us":218879}
I20260709 13:03:28.080825  6300 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.081920  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.083168  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.083302  6300 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.088960  6340 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.031529  6120 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.063298  6349 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:28.091354  6512 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:03:28.094240  6379 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.063694  6585 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.095561  6386 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.096956  6521 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:28.119653  6521 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:28.107214  6349 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:28.120616  6521 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.097776  6504 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.105098  1602 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:28.116590  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:28.123644  1682 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.121201  6349 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.107336  6120 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:28.127743  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.132675  1602 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.132929  1677 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:28.135515  6504 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.123021  6512 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.139262  6512 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.140522  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:28.145260  6120 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.146703  6120 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.146909  1682 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:28.149147  6349 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.152415  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.153306  1610 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:28.154201  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.154753  1610 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:28.160812  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.171538  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 150536us
W20260709 13:03:28.159890  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 243776us
I20260709 13:03:28.062429  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.172709  1527 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:28.173090  1607 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:28.182528  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.183487  1606 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:28.183598  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 238626us
I20260709 13:03:28.173003  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.174391  1501 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:28.190450  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2398) took 1649 ms. Trace:
I20260709 13:03:28.203697  1608 rpcz_store.cc:276] 0709 13:03:26.540854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.555643 (+1014789us) service_pool.cc:224] Handling call
0709 13:03:27.555985 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.959549 (+403564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.959581 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.981614 (+ 22033us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.189999 (+208385us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:28.190055 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.190147 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.190207 (+    60us) raft_consensus.cc:1685] finished
0709 13:03:28.190226 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.190378 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32858,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":558816,"threads_started":2,"wal-append.queue_time_us":162628}
I20260709 13:03:28.205528  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.206143  1608 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:28.207012  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.219239  1602 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:28.227080  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.233213  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:28.242079  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.252450  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79527us
I20260709 13:03:28.254460  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.256135  1677 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:28.257297  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:28.254479  1682 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:28.256054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.263295  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.265455  1677 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:28.266439  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.266505  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.267719  1675 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:28.264487  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.270695  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.271239  1607 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:28.201769  6563 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.533s	user 0.004s	sys 0.000s
I20260709 13:03:28.274706  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:28.286842  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.287710  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.287014  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.291584  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.291850  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:28.287757  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 188776us
I20260709 13:03:28.297240  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.298684  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2388) took 1835 ms. Trace:
I20260709 13:03:28.292284  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:28.263053  6484 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.302680  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.301941  1607 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:28.269583  6377 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:28.303426  1602 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:28.299044  1601 rpcz_store.cc:276] 0709 13:03:26.463339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.191106 (+727767us) service_pool.cc:224] Handling call
0709 13:03:27.191442 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.195796 (+  4354us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:27.213359 (+ 17563us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.122623 (+909264us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b18003fc040. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:03:28.298294 (+175671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.298351 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:28.298409 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.298514 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.298641 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27,"prepare.queue_time_us":17365,"prepare.run_cpu_time_us":3654,"prepare.run_wall_time_us":10817,"spinlock_wait_cycles":4251392,"thread_start_us":174969,"threads_started":1}
I20260709 13:03:28.309268  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.272255  6447 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.304224  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.313681  1607 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:28.303977  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.310994  1677 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:28.272477  6504 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.317535  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 275) took 1660 ms. Trace:
I20260709 13:03:28.319657  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.320488  1607 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 10.
I20260709 13:03:28.321398  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.322852  6586 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.323505  6586 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.303287  6499 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:28.283274  6605 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:03:28.298273  6592 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.263226  6574 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:03:28.287338  6568 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.339265  6504 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:28.340467  6583 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.397s	user 0.000s	sys 0.002s
I20260709 13:03:28.268253  6032 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:03:28.341667  6500 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.283429  6300 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:03:28.342823  6547 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 1.108s	user 0.001s	sys 0.000s
I20260709 13:03:28.308557  6377 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.303165  6569 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.344250  6377 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.307569  6463 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.292615  6512 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:28.346041  1608 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:28.308805  6484 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.342312  6500 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.340122  6447 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.317981  1602 rpcz_store.cc:276] 0709 13:03:26.657622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.316736 (+1659114us) service_pool.cc:224] Handling call
0709 13:03:28.317043 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.317225 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.317251 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.317294 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:28.317329 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.317382 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.317479 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:28.357738  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.359369  1607 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.361011  1608 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:28.389079  1677 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:03:28.383076  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 85909.6us
I20260709 13:03:28.387652  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.395366  1602 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.397490  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.315068  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:28.356076  6484 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.339877  6504 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.429622  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.430845  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:28.401981  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 86971.6us
I20260709 13:03:28.362000  6500 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.432868  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:28.387506  6536 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:28.437134  1607 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:28.415426  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.431854  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.439208  6463 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:28.443492  6591 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.386s	user 0.003s	sys 0.000s
I20260709 13:03:28.436141  6512 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.447414  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:28.438570  1610 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:28.450155  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.453040  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.451786  1606 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:28.456640  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 276) took 1782 ms. Trace:
I20260709 13:03:28.456982  1606 rpcz_store.cc:276] 0709 13:03:26.674457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.455864 (+1781407us) service_pool.cc:224] Handling call
0709 13:03:28.456178 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.456328 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.456352 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.456389 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:28.456420 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.456470 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.456589 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.458472  1610 raft_consensus.cc:2410] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:28.462695  1610 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.463296  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2276) took 1605 ms. Trace:
I20260709 13:03:28.464188  1610 rpcz_store.cc:276] 0709 13:03:26.858363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.462202 (+1603839us) service_pool.cc:224] Handling call
0709 13:03:28.462510 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.463084 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.463245 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.470372  1610 raft_consensus.cc:1217] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.6->[14.7-14.7]   Dedup: 14.7->[]
I20260709 13:03:28.471866  1610 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:28.472955  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2278) took 1612 ms. Trace:
I20260709 13:03:28.475529  1610 rpcz_store.cc:276] 0709 13:03:26.860385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.469953 (+1609568us) service_pool.cc:224] Handling call
0709 13:03:28.470275 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.472724 (+  2449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.472903 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.478703  1610 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:28.433482  6426 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.405243  6586 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.479952  1602 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:28.462802  6568 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.465293  6512 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:28.445463  6300 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:28.494812  1574 connection.cc:256] RPC call timeout handler was delayed by -2.41347659500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:03:28.494558  6504 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.499627  1602 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.550532  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2283) took 1685 ms. Trace:
I20260709 13:03:28.550872  1602 rpcz_store.cc:276] 0709 13:03:26.865100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.499139 (+1634039us) service_pool.cc:224] Handling call
0709 13:03:28.499444 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.550258 (+ 50814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.550472 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.552017  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.486366  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2280) took 1624 ms. Trace:
I20260709 13:03:28.553725  1610 rpcz_store.cc:276] 0709 13:03:26.861753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.477833 (+1616080us) service_pool.cc:224] Handling call
0709 13:03:28.478253 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.485584 (+  7331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.485794 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:28.507104  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.544708  2212 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:28.545681  1606 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:28.560503  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2282) took 1696 ms. Trace:
I20260709 13:03:28.560858  1606 rpcz_store.cc:276] 0709 13:03:26.864491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.487434 (+1622943us) service_pool.cc:224] Handling call
0709 13:03:28.545502 (+ 58068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.560265 (+ 14763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.560447 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:28.546578  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45762.8us
W20260709 13:03:28.547335  1574 connection.cc:256] RPC call timeout handler was delayed by -2.1776765950000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:03:28.562865  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.487600  6426 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.568553  6426 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.569169  6504 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.571462  1675 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:28.487703  6500 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.574875  1534 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:28.575923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.576377  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.576478  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.577203  1531 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:28.577646  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.566962  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.578029  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.578388  1532 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 12: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:28.578923  6500 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.579324  1532 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.579676  1532 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:28.579802  6574 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.580382  6574 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.580739  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:28.577095  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.582218  6603 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.582753  6603 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.584914  6603 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.586531  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.587255  6389 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.587793  6389 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.593716  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.592146  1532 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.497080  6463 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:03:28.592211  6574 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.601136  6389 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.599599  1532 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.604022  6389 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:28.611416  6447 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.550379  6032 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.613433  6032 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.615056  1532 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:28.498600  6498 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:28.616828  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.567776  6340 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:28.618012  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.618963  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.615657  6032 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.623174  1532 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:28.626619  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.615644  6426 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:28.629359  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.630482  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.631155  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.637868  1531 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:28.642432  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:28.646164  1682 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:28.621739  6531 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:28.643898  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.651350  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.653782  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.652408  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:28.655212  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.642060  6351 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.660477  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.638773  6032 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:28.662081  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.656490  6603 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:28.655299  6574 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.676250  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.659018  6496 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:28.659667  6531 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:28.682166  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.668380  6350 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.654803  6389 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:28.671959  6032 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.686709  1532 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:28.673940  6603 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.674767  6351 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:28.699546  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.684405  6496 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:28.715642  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2382) took 2253 ms. Trace:
I20260709 13:03:28.716228  6351 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.716166  1605 rpcz_store.cc:276] 0709 13:03:26.461999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.634323 (+172324us) service_pool.cc:224] Handling call
0709 13:03:26.634653 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.340754 (+1706101us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b180014dee0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698071bfb 00007f469807c64b
0709 13:03:28.340903 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.340938 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.341446 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.495523 (+154077us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:28.496185 (+   662us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.496390 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.496615 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.715323 (+218708us) raft_consensus.cc:1685] finished
0709 13:03:28.715439 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.715577 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72904,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":182606,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":37316,"spinlock_wait_cycles":19497600,"thread_start_us":306446,"threads_started":2,"wal-append.queue_time_us":317740}
I20260709 13:03:28.718600  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.719245  1605 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.720418  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2400) took 2139 ms. Trace:
I20260709 13:03:28.720896  1601 rpcz_store.cc:276] 0709 13:03:26.580856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.313832 (+1732976us) service_pool.cc:224] Handling call
0709 13:03:28.314150 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.314519 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.314549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.314969 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.453064 (+138095us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:28.453120 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.453225 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.720197 (+266972us) raft_consensus.cc:1685] finished
0709 13:03:28.720217 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.720344 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26951,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":137772,"threads_started":1,"wal-append.queue_time_us":323959}
I20260709 13:03:28.722711  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:28.723263  1601 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.724643  1682 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:28.727646  1605 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
W20260709 13:03:28.738934  6120 consensus_meta.cc:287] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.592s	user 0.013s	sys 0.000s
I20260709 13:03:28.740396  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:28.698086  6603 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.744860  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.746115  1532 raft_consensus.cc:2376] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16. Re-sending same reply.
I20260709 13:03:28.698271  6032 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.743093  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.751657  1605 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:28.751657  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:28.814777  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.797904  1606 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:28.760366  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.824749  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.817876  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2288) took 1949 ms. Trace:
I20260709 13:03:28.807004  6561 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.780608  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:28.759521  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 105807us
I20260709 13:03:28.816009  1534 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:28.752804  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2284) took 1887 ms. Trace:
I20260709 13:03:28.828996  1605 rpcz_store.cc:276] 0709 13:03:26.865702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.751129 (+1885427us) service_pool.cc:224] Handling call
0709 13:03:28.751469 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.752384 (+   915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.752735 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.830658  1605 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:03:28.831470  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2291) took 1961 ms. Trace:
I20260709 13:03:28.807945  6426 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:28.831825  1605 rpcz_store.cc:276] 0709 13:03:26.870310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.829987 (+1959677us) service_pool.cc:224] Handling call
0709 13:03:28.830365 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.831088 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.831407 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.835160  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.836256  1533 raft_consensus.cc:2410] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:28.829221  1498 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.782001  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:28.827600  1606 rpcz_store.cc:276] 0709 13:03:26.868303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.797284 (+1928981us) service_pool.cc:224] Handling call
0709 13:03:28.797693 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.817617 (+ 19924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.817823 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.837077  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.826908  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.742642  6377 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.837931  1533 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:28.828302  1532 raft_consensus.cc:2410] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:28.759037  1601 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:28.839915  1601 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:28.840353  1601 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:28.841547  6437 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.840462  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.842010  6437 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.842475  6437 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.842701  1601 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:28.843756  1601 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.840974  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.845284  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.846150  1534 raft_consensus.cc:2410] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:28.846998  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.847847  1534 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:28.848196  6623 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:28.856828  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 74974.1us
W20260709 13:03:28.857515  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.848641  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2401) took 1256 ms. Trace:
I20260709 13:03:28.769070  6531 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.849197  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.862254  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.853925  1601 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:28.854354  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:28.847139  6607 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:03:28.865449  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2411) took 1244 ms. Trace:
I20260709 13:03:28.865911  1609 rpcz_store.cc:276] 0709 13:03:27.642658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.864533 (+1221875us) service_pool.cc:224] Handling call
0709 13:03:28.864899 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.865098 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.865128 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.865178 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:28.865211 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.865263 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.865392 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.867307  1526 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.867062  6484 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.867487  1609 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:28.868822  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:28.869660  1534 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:28.869844  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 279) took 1225 ms. Trace:
I20260709 13:03:28.869957  6426 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:28.870476  1609 rpcz_store.cc:276] 0709 13:03:27.644345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.866864 (+1222519us) service_pool.cc:224] Handling call
0709 13:03:28.867155 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.867982 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.869786 (+  1804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.870963  6426 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:28.838523  6561 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.872465  6426 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.875403  6561 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.872453  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2413) took 1215 ms. Trace:
I20260709 13:03:28.877581  6603 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.877038  1609 rpcz_store.cc:276] 0709 13:03:27.657248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.871655 (+1214407us) service_pool.cc:224] Handling call
0709 13:03:28.871923 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.872135 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.872162 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.872207 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:28.872237 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.872300 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.872403 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.841329  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:28.858469  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.881606  6377 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.858009  1606 rpcz_store.cc:276] 0709 13:03:27.591816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.847785 (+1255969us) service_pool.cc:224] Handling call
0709 13:03:28.848121 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.848311 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.848339 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.848388 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:28.848428 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.848484 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.848586 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.864982  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.884590  1534 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.885035  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.887494  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.896746  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:28.907905  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:28.909853  6624 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:03:28.911017  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.908782  6350 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.910938  6586 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:28.911887  6586 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:28.912210  6574 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:28.912675  6574 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:28.913111  1532 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:28.913110  6574 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:28.912868  6586 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.913678  1532 pending_rounds.cc:85] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:28.916275  1532 pending_rounds.cc:107] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:28.916589  1532 raft_consensus.cc:2889] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:28.920362  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2223) took 1217 ms (client timeout 1509 ms). Trace:
W20260709 13:03:28.920972  1529 rpcz_store.cc:269] 0709 13:03:27.703202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.719244 (+ 16042us) service_pool.cc:224] Handling call
0709 13:03:28.920148 (+1200904us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54000a3cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:28.920285 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102217984}
I20260709 13:03:28.888273  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:28.928493  1531 raft_consensus.cc:2368] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:28.807778  6496 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:28.938527  1533 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:03:28.939247  1533 pending_rounds.cc:85] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 8
I20260709 13:03:28.929397  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:28.887998  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 278) took 1671 ms. Trace:
I20260709 13:03:28.939924  1601 rpcz_store.cc:276] 0709 13:03:27.216981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.839514 (+1622533us) service_pool.cc:224] Handling call
0709 13:03:28.839800 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.864685 (+ 24885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.887941 (+ 23256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.942090  1601 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:28.942826  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2421) took 1278 ms. Trace:
I20260709 13:03:28.943214  1601 rpcz_store.cc:276] 0709 13:03:27.664645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.941480 (+1276835us) service_pool.cc:224] Handling call
0709 13:03:28.941869 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.942533 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.942755 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.885825  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.947059  6522 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:28.947292  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61525.8us
I20260709 13:03:28.948356  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:28.949330  6522 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.939651  1533 pending_rounds.cc:107] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:03:28.950374  1533 raft_consensus.cc:2889] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:28.949784  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:28.952994  6501 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:28.954519  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:28.864506  6385 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.887466  6120 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.887001  6623 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.883442  6351 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.994277  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 277) took 1782 ms. Trace:
I20260709 13:03:28.887750  6603 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:28.973735   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:29.003953  6598 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.911s	user 0.000s	sys 0.006s
I20260709 13:03:29.004215  6501 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.005180  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2218) took 1303 ms. Trace:
I20260709 13:03:29.005333  6501 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.005676  1528 rpcz_store.cc:276] 0709 13:03:27.702218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.702399 (+   181us) service_pool.cc:224] Handling call
0709 13:03:27.702846 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.703891 (+  1045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.703928 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.711255 (+  7327us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.989701 (+278446us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.989764 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.989830 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.003368 (+1013538us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:29.004867 (+  1499us) raft_consensus.cc:1685] finished
0709 13:03:29.004889 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.005120 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9792,"raft.queue_time_us":82436,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":27082,"spinlock_wait_cycles":35438976,"thread_start_us":278095,"threads_started":1,"wal-append.queue_time_us":381346}
I20260709 13:03:29.008497  6484 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:29.008808  6589 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.946s	user 0.003s	sys 0.000s
I20260709 13:03:29.012089  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2225) took 1300 ms. Trace:
I20260709 13:03:29.015115  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:29.019618  1679 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.019201  1530 rpcz_store.cc:276] 0709 13:03:27.712139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.748203 (+ 36064us) service_pool.cc:224] Handling call
0709 13:03:27.748568 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:27.768446 (+ 19878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.768493 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:27.779935 (+ 11442us) log.cc:844] Serialized 52 byte log entry
0709 13:03:27.892816 (+112881us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.937788 (+ 44972us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.938012 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.938086 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.070030 (+131944us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b18002e9d20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:29.008210 (+938180us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:29.011838 (+  3628us) raft_consensus.cc:1685] finished
0709 13:03:29.011860 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.012011 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35818,"prepare.queue_time_us":46811,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1641,"raft.queue_time_us":62425,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":6413,"spinlock_wait_cycles":56539904,"thread_start_us":72869,"threads_started":1,"wal-append.queue_time_us":192831}
W20260709 13:03:29.037988  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 83548.7us
I20260709 13:03:29.039422  1647 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:29.013083  6536 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:28.996155  6350 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:29.049615  6447 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.015161  6586 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:29.058576  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 98228.9us
I20260709 13:03:29.049006  1679 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:29.056439  6351 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.049677  6389 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:29.011495  6032 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.102128  1608 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:29.101625  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2422) took 1436 ms. Trace:
I20260709 13:03:29.015013  6573 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:03:29.104825  1607 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:29.060320  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:29.066963  6426 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.105510  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2424) took 1208 ms. Trace:
I20260709 13:03:29.107210  1607 rpcz_store.cc:276] 0709 13:03:27.897187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.104124 (+1206937us) service_pool.cc:224] Handling call
0709 13:03:29.104462 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.105260 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.105458 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.049482  1605 rpcz_store.cc:276] 0709 13:03:27.212380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.835814 (+1623434us) service_pool.cc:224] Handling call
0709 13:03:28.836119 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.836345 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:28.882234 (+ 45889us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.993825 (+111591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.993897 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:28.993950 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.994029 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.994196 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24326,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4458,"raft.queue_time_us":405,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10233,"thread_start_us":110790,"threads_started":1}
I20260709 13:03:29.068908  6536 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.110857  1605 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:29.072748  6350 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.104076  6573 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:29.116180  6573 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.117014  1605 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:29.116626  6350 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.117166  6573 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.118606  6573 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.119251  1605 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:29.113386  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53206.6us
I20260709 13:03:29.102962  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2423) took 1206 ms. Trace:
I20260709 13:03:29.105046  1601 rpcz_store.cc:276] 0709 13:03:27.664957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.944624 (+1279667us) service_pool.cc:224] Handling call
0709 13:03:28.944967 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.945225 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:28.945864 (+   639us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.100883 (+155019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.100971 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:29.101102 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.101283 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.101541 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2225,"prepare.queue_time_us":205,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":2409,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":151942,"threads_started":1}
I20260709 13:03:29.129130  1608 rpcz_store.cc:276] 0709 13:03:27.896840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.101553 (+1204713us) service_pool.cc:224] Handling call
0709 13:03:29.101910 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.102678 (+   768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.102899 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.130411  1608 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:29.140663  1601 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:29.143087  1601 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:03:29.143756  1601 pending_rounds.cc:85] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 9
I20260709 13:03:29.144305  1601 pending_rounds.cc:107] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:03:29.144847  1601 raft_consensus.cc:2889] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:29.153241  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.076303  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:29.088835  6585 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.132823  1607 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:29.185616  1601 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:03:29.187347  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58746.5us
I20260709 13:03:29.096503  6385 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:03:29.108225  6389 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.192853  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:29.074005  6447 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.094542  6351 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.201583  6351 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.202455  6427 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:29.202932  6531 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.203445  6531 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:29.204128  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.205775  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:29.205992  6531 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:29.206393  1675 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:29.207422  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:29.208241  1679 raft_consensus.cc:2410] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 20 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:29.208267  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:29.191756  6601 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:29.209033  6437 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.209450  6601 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.211197  6437 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.211930  1526 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:29.212930  6601 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:29.199566  6447 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:29.201663  6599 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.139s	user 0.000s	sys 0.004s
I20260709 13:03:29.215505  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2219) took 1513 ms. Trace:
I20260709 13:03:29.215850  1535 rpcz_store.cc:276] 0709 13:03:27.702460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.706970 (+  4510us) service_pool.cc:224] Handling call
0709 13:03:27.707356 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:27.735132 (+ 27776us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:27.813783 (+ 78651us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.009050 (+195267us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:28.009624 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 13:03:28.009834 (+   210us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:28.009868 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.009929 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.093372 (+ 83443us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b18003fb2c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:29.201052 (+1107680us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:29.215341 (+ 14289us) raft_consensus.cc:1685] finished
0709 13:03:29.215358 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.215452 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39236,"prepare.queue_time_us":96087,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":101874,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":22838,"spinlock_wait_cycles":33521792,"thread_start_us":177524,"threads_started":2,"wal-append.queue_time_us":214764}
I20260709 13:03:29.186345  6606 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:29.227401  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:29.197259  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:29.239697  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:29.250351  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 174130us
I20260709 13:03:29.252343  6056 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:29.255088  6426 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.255769  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1954) took 1456 ms. Trace:
I20260709 13:03:29.262676  1683 rpcz_store.cc:276] 0709 13:03:27.799916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.800138 (+   222us) service_pool.cc:224] Handling call
0709 13:03:27.800595 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.990012 (+189417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.990043 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.917748 (+927705us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:28.918116 (+   368us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.084137 (+166021us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:29.084195 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.084306 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.255438 (+171132us) raft_consensus.cc:1685] finished
0709 13:03:29.255462 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.255709 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19727,"spinlock_wait_cycles":26373888,"thread_start_us":354474,"threads_started":2,"wal-append.queue_time_us":333941}
I20260709 13:03:29.260262  6601 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.185822  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2292) took 1014 ms. Trace:
I20260709 13:03:29.265703  1607 rpcz_store.cc:276] 0709 13:03:28.171154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.108190 (+937036us) service_pool.cc:224] Handling call
0709 13:03:29.108552 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.185390 (+ 76838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.185717 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.262035  6437 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:29.268066  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.268682  6437 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.255796  6574 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.268796  6447 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:29.273730  6447 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:29.274075  6447 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.274801  6574 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.274649  6536 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.271056  6636 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:29.275949  6636 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.276374  6437 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.276813  6636 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.271522  6351 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:29.272315  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.272629  6573 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:29.261390  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:29.269121  6389 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:29.321138  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59800.7us
I20260709 13:03:29.230463  6606 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.326026  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:29.378989  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.381201  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.382387  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.396049  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.399034  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.400431  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:29.401170  1530 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.402253  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.402539  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:29.404636  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.406155  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.408444  1535 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:29.416976  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.420893  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.422235  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.422701  1607 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.423518  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.424605  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:29.330332  6501 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:29.458277  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.414278  6498 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:29.496054  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:29.497766  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.026s
W20260709 13:03:29.498113  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.000s	sys 0.026s
I20260709 13:03:29.274827  6447 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:29.505216  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 318275us
I20260709 13:03:29.424460  6592 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.417900  6561 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.414171  6377 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.413863  6531 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:29.523981  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.507835  1530 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:29.395119  6351 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:03:29.395635  6573 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:03:29.508168  6427 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.526348  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.497288  6498 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:29.403689  6574 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:03:29.513235  6056 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.530396  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.516299  1607 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:29.518487  6120 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:29.536913  6447 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.501719  6606 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.543890  6056 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.544984  6541 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:29.523957  6032 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.537933  6498 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.552881  1601 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:29.528796  6592 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.554126  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2432) took 1169 ms. Trace:
W20260709 13:03:29.546756  6627 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:03:29.551159  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 227996us
I20260709 13:03:29.575631  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:29.556838  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2402) took 1964 ms. Trace:
I20260709 13:03:29.542065  6635 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.557420  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:29.578459  6601 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:29.580157  6427 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.576654  1601 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:29.581538  6541 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:29.556928  6522 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.001s
I20260709 13:03:29.586763  6522 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.576213  1608 rpcz_store.cc:276] 0709 13:03:28.384791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.131962 (+747171us) service_pool.cc:224] Handling call
0709 13:03:29.154470 (+ 22508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.258111 (+103641us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:29.258445 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.553582 (+295137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.553651 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:29.553709 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.553828 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.553973 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":166,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":1011,"thread_start_us":294675,"threads_started":1}
I20260709 13:03:29.588551  6522 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:29.591853  6522 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:29.596302  6032 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:29.576545  6536 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:29.599855  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1943) took 2234 ms. Trace:
I20260709 13:03:29.600291  1684 rpcz_store.cc:276] 0709 13:03:27.365100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.365204 (+   104us) service_pool.cc:224] Handling call
0709 13:03:27.549472 (+184268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.550612 (+  1140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.599605 (+2048993us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002d4bd0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:29.599770 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349663104}
I20260709 13:03:29.601140  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2313) took 1083 ms. Trace:
I20260709 13:03:29.601517  1604 rpcz_store.cc:276] 0709 13:03:28.517326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.661776 (+144450us) service_pool.cc:224] Handling call
0709 13:03:29.600941 (+939165us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400249d54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:29.601064 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893504768}
I20260709 13:03:29.603435  6623 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:29.576195  6643 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:03:29.604490  6351 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:29.600402  6536 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:29.553654  6120 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.608080  6032 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.582795  6635 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.609376  6351 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.566079  6562 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:29.640277  6536 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.612052  6573 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:03:29.701854  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.667227  6574 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:29.691382  6562 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:29.727878  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.719794  6616 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.099s	user 0.000s	sys 0.010s
W20260709 13:03:29.730326  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 313447us
I20260709 13:03:29.756619  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.758963  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.774003  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2420) took 2109 ms. Trace:
I20260709 13:03:29.774623  1606 rpcz_store.cc:276] 0709 13:03:27.664372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.882437 (+1218065us) service_pool.cc:224] Handling call
0709 13:03:28.882838 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.883110 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:28.992778 (+109668us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.773493 (+780715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.773574 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:29.773637 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.773738 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.773917 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35929,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":47085,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":883424,"threads_started":3,"wal-append.queue_time_us":591687}
I20260709 13:03:29.779050  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:29.783234  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:29.784780  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 204430us
I20260709 13:03:29.777770  6541 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.729422  6498 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.803314  1574 leader_election.cc:400] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16.
I20260709 13:03:29.801060  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2398) took 1452 ms. Trace:
I20260709 13:03:29.806900  1676 rpcz_store.cc:276] 0709 13:03:28.348574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.349962 (+  1388us) service_pool.cc:224] Handling call
0709 13:03:28.350358 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.350732 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.350766 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.351274 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.484726 (+133452us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:28.484767 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.484837 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:29.719262 (+1234425us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:29.785220 (+ 65958us) raft_consensus.cc:1685] finished
0709 13:03:29.785249 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.800961 (+ 15712us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1128,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":3241856,"thread_start_us":132892,"threads_started":1,"wal-append.queue_time_us":268905}
I20260709 13:03:29.809077  6655 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.809975  6655 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:29.788691  1604 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:29.811285  6655 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:29.811944  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.813148  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.799099  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:29.776463  6377 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.766772  6571 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:29.729753  6574 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:29.784893  6561 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:29.801872  6568 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.782074  6635 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.851706  6635 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.732620  6351 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.747496  6032 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.870777  1606 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.814381  6437 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.800613  6501 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.786702  6541 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.803074  6531 consensus_queue.cc:1059] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:03:29.881618  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75173.3us
I20260709 13:03:29.886216  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:29.788627  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2419) took 2124 ms. Trace:
I20260709 13:03:29.782286  6536 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:29.896448  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.891698  1606 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:29.893959  1609 rpcz_store.cc:276] 0709 13:03:27.664005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.879680 (+1215675us) service_pool.cc:224] Handling call
0709 13:03:28.880011 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.880254 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:29.041619 (+161365us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.788309 (+746690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.788362 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:29.788406 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.788469 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.788573 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38623,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":47161,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":841720,"threads_started":3,"wal-append.queue_time_us":517594}
I20260709 13:03:29.815598  6562 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.934242  1531 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:29.900209  6531 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:29.932521  6452 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:29.881712  6437 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.900250  6120 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.927115  6219 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.981745  6498 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.977416  6452 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:29.965369  6651 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.985265  6651 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.935470  6536 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:29.976845  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.987383  6651 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:29.577049  1603 rpcz_store.cc:276] 0709 13:03:27.592176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.850252 (+1258076us) service_pool.cc:224] Handling call
0709 13:03:28.850541 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.850758 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:29.083386 (+232628us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.555313 (+471927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.555385 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:29.555444 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.555524 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.556764 (+  1240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9791,"prepare.queue_time_us":67919,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":829,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9940,"thread_start_us":693714,"threads_started":2}
I20260709 13:03:29.969518  6656 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:29.988574  6656 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.988994  6344 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:29.989634  6344 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:29.990082  6672 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:29.990777  6656 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:29.894327  6561 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:03:29.971560  6389 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:29.985131  6452 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:29.946336  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:29.999624  1609 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:30.001483  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:29.991444  6652 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:29.991760  6056 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:30.021487  6056 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.030057  6340 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:30.030378  6659 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:30.030689  6340 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:30.031222  6056 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:30.031919  6452 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:30.032635  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2249) took 1368 ms. Trace:
I20260709 13:03:30.033164  6340 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:30.033057  1534 rpcz_store.cc:276] 0709 13:03:28.664321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.006904 (+342583us) service_pool.cc:224] Handling call
0709 13:03:29.007169 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.057261 (+ 50092us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:29.416324 (+359063us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.604937 (+188613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.604999 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:29.605050 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.032357 (+427307us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54000a37d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:30.032411 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.032571 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524477,"prepare.run_wall_time_us":41,"raft.queue_time_us":1252,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1023,"spinlock_wait_cycles":118595200,"thread_start_us":533778,"threads_started":2,"wal-append.queue_time_us":351039}
W20260709 13:03:30.038805  6596 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.966s	user 0.011s	sys 0.014s
I20260709 13:03:30.024650  6120 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:30.042434  6344 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:30.044548  6350 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:30.045063  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.045210  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:30.059623  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71047.2us
I20260709 13:03:30.049746  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2244) took 1454 ms. Trace:
I20260709 13:03:30.060527  1526 rpcz_store.cc:276] 0709 13:03:28.595189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.868317 (+273128us) service_pool.cc:224] Handling call
0709 13:03:28.868731 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.212404 (+343673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.049507 (+837103us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400435dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:30.049683 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788838656}
I20260709 13:03:30.055189  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.055436  1683 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:30.058714  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.064178  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.063948  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:30.046458  6162 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:30.064580  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.090739  1535 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:30.084100  1526 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:30.016093  6652 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:29.999017  6219 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:30.095889  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.099257  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.113634  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:30.115805  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59414.6us
I20260709 13:03:30.115960  1531 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:30.066607  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2216) took 2351 ms (client timeout 1523 ms). Trace:
I20260709 13:03:30.120826  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.096654  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 1927) took 4987 ms. Trace:
I20260709 13:03:30.059229  6120 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.123052  1609 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:30.007615  6389 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:30.114195  6662 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:03:30.124253  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:29.997177  6501 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.141415  1530 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:30.118198  1527 rpcz_store.cc:269] 0709 13:03:27.700784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.700894 (+   110us) service_pool.cc:224] Handling call
0709 13:03:30.051690 (+2350796us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540020a654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:30.051794 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078019328}
I20260709 13:03:30.132241  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:30.135857  6675 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:03:30.140232  6600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.056s	user 0.019s	sys 0.014s
W20260709 13:03:30.146829  6600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.077s	user 0.019s	sys 0.014s
I20260709 13:03:30.094576  6162 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:30.137276  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2426) took 1885 ms. Trace:
I20260709 13:03:30.161265  1605 rpcz_store.cc:276] 0709 13:03:28.252230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.120207 (+867977us) service_pool.cc:224] Handling call
0709 13:03:29.120587 (+   380us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:03:29.121121 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:29.121449 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.547401 (+425952us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b18000e38c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9
0709 13:03:29.739221 (+191820us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:03:29.780377 (+ 41156us) log.cc:844] Serialized 104 byte log entry
0709 13:03:29.780561 (+   184us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:29.781094 (+   533us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.992150 (+211056us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.062379 (+ 70229us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.093923 (+ 31544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.094007 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.137031 (+ 43024us) raft_consensus.cc:1685] finished
0709 13:03:30.137052 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.137218 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106018,"prepare.queue_time_us":133070,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":158,"raft.queue_time_us":88487,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":39883,"spinlock_wait_cycles":576102016,"thread_start_us":368694,"threads_started":2,"wal-append.queue_time_us":734565}
I20260709 13:03:30.137985  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.163643  1528 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:30.122874  1681 rpcz_store.cc:276] 0709 13:03:25.078427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.122871 (+ 44444us) service_pool.cc:224] Handling call
0709 13:03:26.775555 (+1652684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.790247 (+ 14692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.790294 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.805909 (+ 15615us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.018469 (+1212560us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b1800261e20. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:03:28.371066 (+352597us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:28.371124 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.371247 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.603675 (+232428us) raft_consensus.cc:1685] finished
0709 13:03:28.603694 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.065445 (+1461751us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54002d46d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:30.065598 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14186,"raft.queue_time_us":26610,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":11031,"spinlock_wait_cycles":3812667008,"thread_start_us":345867,"threads_started":1,"wal-append.queue_time_us":1628143,"wal-append.run_cpu_time_us":2102,"wal-append.run_wall_time_us":1156410}
I20260709 13:03:30.064759  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:30.139894  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:30.147358  6574 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:30.147996  1530 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:30.170650  1526 raft_consensus.cc:2376] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16. Re-sending same reply.
I20260709 13:03:30.064649  6350 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:30.124321  6596 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:30.130821  6120 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:30.132179  6667 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:03:30.129577  6636 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.169250  1531 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:30.190114  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.190636  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.178864  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.186139  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:30.187704  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63613.5us
W20260709 13:03:30.189035  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 164668us
W20260709 13:03:30.196691  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.197162  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.205482  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.192683  6452 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.211716  6452 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.205787  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:30.196117  6635 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.200400  6367 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:30.213111  6219 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:30.198076  6600 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.216583  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.213495  6032 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.216718  6349 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.220233  1605 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:30.224275  1609 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:30.188344  6636 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.225610  6367 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.230532  6484 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.234052  6532 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:30.187141  6652 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.199939  6574 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:30.198839  6162 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:30.247982  6680 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:30.285892  6636 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.237076  6566 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:30.289844  6566 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:30.290372  6566 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.293375  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:30.296638  6389 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:30.296749  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45872.8us
I20260709 13:03:30.266666  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.267496  6176 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:30.270063  6350 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:30.271415  6681 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:03:30.246609  6367 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:30.273877  6120 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.243898  6684 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.304471  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:30.306352  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.307634  1526 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:30.302593  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.330447  6533 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.331082  6533 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.333249  6533 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.334568  6452 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.323328  6571 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:03:30.323594  6574 consensus_queue.cc:1175] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 14 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: [13.10-13.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:30.323695  6377 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.320441  6601 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:03:30.337608  6377 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.338337  6120 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.338904  6585 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:30.339533  6585 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.339792  6219 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:30.340242  6219 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.342067  6684 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.322153  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:30.244212  6531 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:30.300707  6682 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.346158  1528 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:30.347910  6531 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.341007  6219 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.349726  6219 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:30.350526  6639 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.826s	user 0.000s	sys 0.004s
I20260709 13:03:30.325230  6162 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.357072  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:30.358179  1605 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:30.339985  6377 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.359458  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.361904  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:30.362648  1605 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
W20260709 13:03:30.343740  6447 consensus_queue.cc:1175] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6031790cc44edfba5c3964e6f27c6e" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:30.352254  6197 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.365779  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2248) took 1720 ms. Trace:
I20260709 13:03:30.366197  1533 rpcz_store.cc:276] 0709 13:03:28.645535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.951425 (+305890us) service_pool.cc:224] Handling call
0709 13:03:28.951798 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.960225 (+  8427us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:29.008813 (+ 48588us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.985465 (+976652us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b1800023fe0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:03:29.990786 (+  5321us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b1800023fe0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:30.099335 (+108549us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.099905 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.100079 (+   174us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:30.100123 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.100205 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.365570 (+265365us) raft_consensus.cc:1685] finished
0709 13:03:30.365589 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.365715 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30237,"prepare.queue_time_us":48780,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":30899,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":40572,"spinlock_wait_cycles":122218112,"thread_start_us":85412,"threads_started":1,"wal-append.queue_time_us":1122569}
I20260709 13:03:30.291628  6566 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:30.380450  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 164284us
I20260709 13:03:30.381793  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:30.382757  6560 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.183s	user 0.004s	sys 0.000s
I20260709 13:03:30.382777  6032 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.386140  6367 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:30.386389  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.386642  6367 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:30.387095  6367 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.387511  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.388418  6032 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.388185  6197 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.388899  6056 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:30.389065  6197 consensus_queue.cc:1243] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:30.387593  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:30.390333  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.437111  6501 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:30.437700  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47481.4us
I20260709 13:03:30.437808  6501 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.439481  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.440764  6032 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:30.442189  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54668.4us
I20260709 13:03:30.441607  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.444979  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.446501  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.447965  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.396344  6056 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.443248  6566 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.443661  6120 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.441634  6032 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:30.450254  6690 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.450524  6349 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:30.446137  6350 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:30.443850  6522 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:30.465648  6522 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.467067  6522 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.455327  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:30.447127  6452 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:30.464222  6501 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.470494  6032 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.476176  6501 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:30.472162  6642 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.274s	user 0.006s	sys 0.000s
I20260709 13:03:30.471908  6056 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.472406  6452 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.478500  6452 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.473528  6521 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.484007  6385 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:30.484580  6385 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:30.490181  6385 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.491463  6385 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.493661  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:30.497373  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:03:30.505717  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53900.5us
W20260709 13:03:30.504616  6677 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.522s	user 0.006s	sys 0.007s
I20260709 13:03:30.507750  6651 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:30.508167  6651 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:30.509021  6623 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.506495  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.508960  6651 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.512459  6623 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.512929  6651 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.514701  6623 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.516950  6120 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.543092  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.561806  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.562644  1681 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:30.564476  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.565409  1680 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:30.563740  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:30.534543  1499 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:30.533875  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.521504  6636 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.576402  6636 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.579479  6636 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:30.580441  6677 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:30.587707  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.521345  6623 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.590684  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.529031  6690 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.573676  6694 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.595283  1530 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:30.533279  6665 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.553s	user 0.002s	sys 0.001s
I20260709 13:03:30.596650  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.596308  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:30.597467  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.573642  6349 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:30.601050  1534 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:30.605296  1531 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:30.590428  6636 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:30.531149  6606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.000s	sys 0.018s
W20260709 13:03:30.612599  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 78114.4us
I20260709 13:03:30.615058  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2326) took 1151 ms. Trace:
I20260709 13:03:30.615460  1607 rpcz_store.cc:276] 0709 13:03:29.464077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.556477 (+ 92400us) service_pool.cc:224] Handling call
0709 13:03:29.579619 (+ 23142us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:29.580092 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.580122 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.580704 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:03:29.894586 (+313882us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:29.894633 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.895326 (+   693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.520983 (+625657us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:30.614766 (+ 93783us) raft_consensus.cc:1685] finished
0709 13:03:30.614788 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.614999 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":25134464,"thread_start_us":313497,"threads_started":1,"wal-append.queue_time_us":393600}
I20260709 13:03:30.618845  1683 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:30.530539  6350 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:03:30.604949  6349 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.575093  6120 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.628877  6349 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.637687  6120 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.595830  6623 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.641407  1533 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:03:30.620577  6606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.000s	sys 0.019s
I20260709 13:03:30.647655  1535 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:03:30.648222  1535 pending_rounds.cc:85] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:03:30.648490  1535 pending_rounds.cc:107] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:30.648887  1535 raft_consensus.cc:2889] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.658578  6623 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:30.659008  6638 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.962s	user 0.003s	sys 0.000s
I20260709 13:03:30.660256  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1910) took 2042 ms. Trace:
I20260709 13:03:30.660624  1529 rpcz_store.cc:276] 0709 13:03:28.617438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.922299 (+304861us) service_pool.cc:224] Handling call
0709 13:03:28.922740 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.925613 (+  2873us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:28.925658 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.954037 (+ 28379us) log.cc:844] Serialized 26 byte log entry
0709 13:03:29.504915 (+550878us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:29.504957 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.505022 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.658013 (+1152991us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:30.659946 (+  1933us) raft_consensus.cc:1685] finished
0709 13:03:30.659968 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.660198 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14239,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12313,"spinlock_wait_cycles":5646208,"thread_start_us":464231,"threads_started":1,"wal-append.queue_time_us":698196}
I20260709 13:03:30.610221  6690 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.667802  6690 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.667945  1602 raft_consensus.cc:2410] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
W20260709 13:03:30.669106  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2312) took 2152 ms (client timeout 1516 ms). Trace:
W20260709 13:03:30.669488  1602 rpcz_store.cc:269] 0709 13:03:28.517083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.551746 (+ 34663us) service_pool.cc:224] Handling call
0709 13:03:30.668861 (+2117115us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400085054. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:30.668999 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4863934848}
I20260709 13:03:30.670485  6498 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.671022  6498 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.675060  6498 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.689440  6585 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.690621  1677 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:30.678644  6684 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.696130  6585 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:30.696698  6568 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:30.714535  6349 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.711501  6493 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 13:03:30.714584  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.720554  1683 raft_consensus.cc:1240] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:30.646675  6367 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.723217  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.725539  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.724653  1683 raft_consensus.cc:2410] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:30.728801  1678 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:30.709293  6568 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:30.730757  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.732108  1677 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:30.738204  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.741246  6367 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:30.742780  1576 connection.cc:256] RPC call timeout handler was delayed by -1.2393668790000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 13:03:30.743721  1576 connection.cc:256] RPC call timeout handler was delayed by -1.0754429070000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:03:30.744236  6693 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:30.744923  6693 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:30.745721  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:30.748267  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.751120  1680 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:30.751437  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.752115  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.752339  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.752533  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.738363  6571 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.756780  6571 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.758872  6571 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.759334  6571 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.693399  6032 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.785346  6574 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.786128  6690 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:30.787366  6568 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.788407  6452 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.710652  6549 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:03:30.792668  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.792721  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:30.795148  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:30.792268  6032 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.724839  6385 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:03:30.808827  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2438) took 1022 ms. Trace:
I20260709 13:03:30.794000  6655 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:30.747849  6693 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:30.802613  6568 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.759773  6571 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.796013  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.812763  1680 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.809377  1678 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:30.809278  1606 rpcz_store.cc:276] 0709 13:03:29.786166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.798526 (+ 12360us) service_pool.cc:224] Handling call
0709 13:03:30.808671 (+1010145us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400248e54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:30.808771 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119662336}
W20260709 13:03:30.805444  6496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.279s	user 0.034s	sys 0.065s
W20260709 13:03:30.814735  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 113845us
W20260709 13:03:30.820938  6496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.034s	sys 0.066s
I20260709 13:03:30.835695  6496 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.836282  6496 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.838374  6496 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:30.842175  6452 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:30.845530  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.846233  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.848290  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.848914  1681 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.856412  1681 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:30.857827  1501 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:30.858718  6385 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:30.859218  6385 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:30.860064  6385 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.861784  6571 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.863359  6349 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.811398  6655 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.872402  1680 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:30.873621  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:30.876744  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:30.884505  1680 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.881176  6655 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:30.883846  6349 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:30.898893  1680 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:30.900163  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:30.900996  6573 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.901481  6573 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:30.902410  6351 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.902272  6573 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:30.905989  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.909384  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2444) took 1120 ms. Trace:
I20260709 13:03:30.910061  1604 rpcz_store.cc:276] 0709 13:03:29.789076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.846947 (+ 57871us) service_pool.cc:224] Handling call
0709 13:03:29.847315 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:29.876392 (+ 29077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.876444 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.877397 (+   953us) log.cc:844] Serialized 52 byte log entry
0709 13:03:29.970739 (+ 93342us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:29.986006 (+ 15267us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.023125 (+ 37119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.490999 (+467874us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:30.909085 (+418086us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b540003d9d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:30.909133 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.909174 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:30.909186 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.909327 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18322,"prepare.queue_time_us":9550,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":56760,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"spinlock_wait_cycles":97375232,"thread_start_us":92904,"threads_started":1,"wal-append.queue_time_us":104889}
W20260709 13:03:30.932514  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.894510  6349 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:31.012672  6484 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.013376  6484 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:30.928498  6501 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.034101  6562 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:31.031406  6719 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:03:31.036016  6652 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:31.048146  6716 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:03:31.025549  6501 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.068305  6684 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:31.068933  6721 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:03:31.069988  6684 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:31.070858  6684 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:31.071990  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 749903us
I20260709 13:03:31.072786  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:31.076021  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.076622  1605 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:31.076972  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 284523us
I20260709 13:03:31.077523  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:31.078016  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:31.078558  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:31.079279  6693 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:31.080235  6693 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:31.079407  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:31.081090  6693 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.082042  6653 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.082549  6653 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.084329  6683 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.084631  6653 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.084913  6683 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.044227  6349 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.087118  6683 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.084170  6377 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.079571  6592 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:31.087970  6377 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.079432  6655 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:03:31.088572  6501 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:31.089985  6377 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.073444  6674 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.090834  6674 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.093086  6674 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.076614  1610 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:31.073659  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.096436  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.096828  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.097043  1610 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:31.098043  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.097549  1429 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:31.099285  1429 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.099946  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.100188  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.102352  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.102851  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.103698  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1918) took 1206 ms. Trace:
I20260709 13:03:31.104275  1531 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:31.103736  1527 raft_consensus.cc:2410] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:31.105441  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.105945  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.073289  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:31.079069  1605 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:31.106670  1604 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:31.074080  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.075419  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.107609  1607 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:31.077123  6684 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.102947  1534 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:31.108740  1607 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:31.104091  1532 rpcz_store.cc:276] 0709 13:03:29.896943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.897220 (+   277us) service_pool.cc:224] Handling call
0709 13:03:29.935035 (+ 37815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.014593 (+ 79558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.014640 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.015236 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.179918 (+164682us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:30.179959 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.103349 (+923390us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b540020ab54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:31.103397 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.103443 (+    46us) raft_consensus.cc:1685] finished
0709 13:03:31.103456 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.103645 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13467,"raft.queue_time_us":16407,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":16314,"spinlock_wait_cycles":165012352,"thread_start_us":164226,"threads_started":1,"wal-append.queue_time_us":225838}
I20260709 13:03:31.074805  1608 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:31.105396  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.116210  1602 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:31.117722  1602 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:31.110278  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:31.113188  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.075146  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.128973  1603 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:31.128844  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.126682  1576 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:31.082077  6484 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:31.068439  6722 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:31.134457  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.134804  1530 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:31.135967  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.136075  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.181943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.200413  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:31.205328  1527 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:03:31.208995  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70615us
I20260709 13:03:31.183010  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.170318  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.140120  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.215770  6498 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:31.201041  1677 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:31.219446  6437 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.220868  6437 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.223078  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.223709  1677 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:31.225234  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:31.207669  1604 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:31.221864  6437 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.241982  1605 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:31.243945  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.245783  1605 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:31.248335  1605 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:31.252568   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:31.263502  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:31.266975  1677 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:31.273782  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:31.128011  6660 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:31.133884  6592 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.133422  6655 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.280977  1605 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:31.200304  6684 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.233444  6452 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:31.139711  6521 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.101282  1429 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 15, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 15 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.282605  1607 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:31.294052  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:31.221948  6484 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.277107  6623 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.230804  6498 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:31.300580  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:31.293380  6719 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:31.135160  6674 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:03:31.313961  1607 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:31.135000  6377 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.161s
W20260709 13:03:31.323061  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.334429  6498 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.300181  6452 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:31.320261  6683 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:31.302893  6684 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.300750  6655 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.299947  6592 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.341447  6452 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.316694  6623 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.311961  6484 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:31.356643  6568 consensus_meta.cc:287] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.001s
I20260709 13:03:31.323478  6674 consensus_queue.cc:1243] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:31.350342  6683 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.385862  1601 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:31.387300  1603 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.388310  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:31.387255  1608 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:31.313092  6521 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:31.397800  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:31.399372  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:31.409238  6437 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.411269  1676 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:31.411689  6623 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.413273  6484 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.414135  6658 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:31.414601  6658 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:31.414969  6658 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:31.387455  6683 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:31.420696  6351 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.002s
I20260709 13:03:31.416867  6672 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.449751  6562 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.397574  1429 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.490499  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.491628  1603 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:31.492101  1429 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 15, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 15 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.514822  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:31.516177  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.517071  1610 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:31.522199  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.523046  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:31.524166  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.527920  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.529408  1603 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:31.454839  6672 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.637096  6684 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.639099  6690 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.639822  6690 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.645944  1603 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:31.647651  1603 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:31.650489  1603 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:31.651033  1603 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:31.651113  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:31.651770  1527 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:31.651827  1603 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.653098  1603 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:31.654774  6574 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.655365  6574 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.646764  6690 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.683750  6437 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.684100  6690 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.656535  6708 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.684625  6690 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.685002  6708 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.684415  6623 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.686548  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:31.687251  1527 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:31.686324  6623 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.689177  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.687711  1527 raft_consensus.cc:614] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:31.687683  6592 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.684404  6437 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.690136  6623 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.694630  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.695681  6690 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.652650  6484 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.649235  1429 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 12, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:31.780761  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.685138  6574 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:31.709525  6730 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:31.785616  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:31.788929  1498 leader_election.cc:336] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.516s (SENT)
I20260709 13:03:31.789557  1498 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:31.792339  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 480821us
I20260709 13:03:31.796972  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2420) took 1253 ms. Trace:
I20260709 13:03:31.779542  6623 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.803655  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.808689  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:31.779676  6592 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.784013  6350 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.806972  1675 rpcz_store.cc:276] 0709 13:03:30.543452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.545366 (+  1914us) service_pool.cc:224] Handling call
0709 13:03:31.221756 (+676390us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800003698. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:31.221997 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.222242 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:31.343752 (+121510us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.796418 (+452666us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.796641 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:31.796694 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:31.796737 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.796801 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.796917 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10757,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":162,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1765,"spinlock_wait_cycles":33006848,"thread_start_us":573181,"threads_started":2}
W20260709 13:03:31.813000  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.785384  6521 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:31.827792  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:31.824141  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:31.828655  1526 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:31.829691  1526 raft_consensus.cc:614] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:31.727922  6683 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.798481  6428 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:31.796070  6574 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:31.841718  1607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.028s	sys 0.074s
I20260709 13:03:31.784777  6484 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:31.851243  1607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.028s	sys 0.078s
W20260709 13:03:31.855476  6727 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:03:31.814275  6351 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:31.866791  6351 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.868942  6658 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:31.871225  6658 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:31.825241  6350 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.874328  6350 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.874889  6350 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.875336  6350 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.841895  6521 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.876636  6521 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.877370  6442 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:31.878652  6521 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.819710  6623 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.827595  6592 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.860352  1601 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:31.897373  1601 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:31.898154  1529 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:31.865504  6437 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.865990  6708 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:31.819118  6573 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:31.836905  6377 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:31.836302  6693 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.885212  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:31.888141  1535 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:31.896310  1528 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:31.898672  1529 pending_rounds.cc:85] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:31.918543  1529 pending_rounds.cc:107] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:31.918787  1527 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:31.919001  1529 raft_consensus.cc:2889] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:31.898511  1601 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.920507  1601 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:31.903975  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.922891  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:31.933706  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.014s	sys 0.098s
I20260709 13:03:31.858278  6690 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:31.934273  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.014s	sys 0.098s
I20260709 13:03:31.937168  1528 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:31.942056  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:31.942739  1529 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:31.940845  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 712526us
I20260709 13:03:31.937222  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:31.951460  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:31.951493  1529 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:31.952934  1601 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:31.903002  6521 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:31.955396  1529 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:31.952961  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:31.956929  1603 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:31.977838  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:31.987429  1531 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:31.988618  2178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.088s	sys 0.050s
I20260709 13:03:32.121381  6708 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:31.953478  6568 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:31.930787  6573 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:31.930663  6377 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:31.990188  6684 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:31.930377  6693 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:32.143524  1650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.008s	sys 0.028s
W20260709 13:03:32.236982  1650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.009s	sys 0.029s
W20260709 13:03:32.136278  1602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.020s	sys 0.017s
W20260709 13:03:32.237972  1602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.021s	sys 0.017s
I20260709 13:03:32.239048  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2458) took 1156 ms. Trace:
W20260709 13:03:32.129882  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.010s	sys 0.026s
W20260709 13:03:32.240993  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.010s	sys 0.028s
I20260709 13:03:31.954063  6690 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:32.086726  6656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.026s
I20260709 13:03:32.024930  6521 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.120431  6502 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:32.184866  6426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.086s	sys 0.161s
I20260709 13:03:32.192708  6437 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.245464  6437 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.247700  6437 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.092381  6658 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:03:32.198467  6592 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:32.226109  2178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.088s	sys 0.050s
I20260709 13:03:31.989092  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:32.191787  6452 consensus_meta.cc:287] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.002s
W20260709 13:03:32.252043  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 263062us
I20260709 13:03:32.251832  6452 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.252794  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.254140  6452 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.231462  6568 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:32.241405  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 791017us
I20260709 13:03:32.243852  1532 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.259809  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.261412  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:32.242674  6656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.005s	sys 0.027s
W20260709 13:03:32.265985  6541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.030s	sys 0.056s
I20260709 13:03:32.229981  6442 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:03:32.260265  6426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.086s	sys 0.161s
I20260709 13:03:32.233484  6708 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.259157  6592 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.259773  6683 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.264413  6484 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.245126  6502 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:32.290798  6740 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:32.292716  6739 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:32.301362  6573 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.304334  6693 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.277601  6623 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.307060  6690 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.274845  6684 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:32.291931  6742 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:03:32.308881  6652 consensus_meta.cc:287] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 1.256s	user 0.013s	sys 0.002s
I20260709 13:03:32.299882  6377 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:32.327196  6747 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:32.322562  6745 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.330809  6684 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.330081  6743 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:32.345911  6684 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.349030  6743 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:32.361436  6743 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:32.367165  6743 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.381903  6521 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.320837  6502 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:32.276674  6541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.030s	sys 0.056s
I20260709 13:03:32.384882  6708 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:32.439922  1498 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.007s
W20260709 13:03:32.440935  1498 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.001s	sys 0.007s
W20260709 13:03:32.441630  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 599163us
I20260709 13:03:31.953917  1429 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 14, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:03:32.448604  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.004s	sys 0.003s
W20260709 13:03:32.449317  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.005s	sys 0.003s
I20260709 13:03:32.450971  1429 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 8 to 14, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.458329  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea2020c26814418b630a447fc961d07"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
W20260709 13:03:32.460171  1606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.017s	sys 0.021s
W20260709 13:03:32.460690  1606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.017s	sys 0.022s
I20260709 13:03:32.466071  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.465137  1429 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.467201  1603 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:32.470767  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 281) took 1302 ms. Trace:
W20260709 13:03:32.472296  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.001s	sys 0.013s
W20260709 13:03:32.472752  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.001s	sys 0.013s
I20260709 13:03:32.474066  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2470) took 1248 ms. Trace:
I20260709 13:03:32.474509  1607 rpcz_store.cc:276] 0709 13:03:31.226082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.329230 (+103148us) service_pool.cc:224] Handling call
0709 13:03:31.329833 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.330460 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:31.852961 (+522501us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.473451 (+620490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.473556 (+   105us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:32.473681 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.473809 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.474009 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147232,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"thread_start_us":1141811,"threads_started":2,"wal-append.queue_time_us":519491}
W20260709 13:03:32.480561  1681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.013s	sys 0.004s
I20260709 13:03:32.466077  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2466) took 1354 ms. Trace:
I20260709 13:03:32.459769  1529 raft_consensus.cc:606] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.496857  1529 raft_consensus.cc:614] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.484246  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.283926  6350 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.504376  6562 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.505215  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.505432  6562 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.506279  6437 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:32.512382  1681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.013s	sys 0.004s
I20260709 13:03:32.514086  6340 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:32.514130  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2435) took 1682 ms. Trace:
I20260709 13:03:32.516466  6541 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.507272  6437 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.517547  6541 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.515360  6340 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.520020  6745 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.521940  6623 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:32.528294  6340 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:32.528929  6623 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.239564  1602 rpcz_store.cc:276] 0709 13:03:31.082991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.120904 (+ 37913us) service_pool.cc:224] Handling call
0709 13:03:31.121331 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.121558 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:31.458515 (+336957us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.238551 (+780036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.238636 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:32.238706 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.238805 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.238974 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":355761,"prepare.run_cpu_time_us":208,"prepare.run_wall_time_us":208,"raft.queue_time_us":1486,"thread_start_us":1004812,"threads_started":2}
I20260709 13:03:32.531276  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.532256  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.533190  1609 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:32.535867  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:32.536832  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.522789  6690 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:32.537379  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.525789  6752 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:32.538419  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2431) took 1780 ms (client timeout 2237 ms). Trace:
I20260709 13:03:32.538880  6752 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.534735  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.526170  6652 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:32.540627  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.541508  1602 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:32.541255  6652 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.542161  6745 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.544215  6652 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.545182  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:32.545951  1529 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.546495  1529 raft_consensus.cc:614] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.546418  6501 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:32.547096  6501 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:32.548540  6437 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.550400  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.553170  6752 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.554244  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.554477  6745 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:32.538895  1676 rpcz_store.cc:269] 0709 13:03:30.758145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.768919 (+ 10774us) service_pool.cc:224] Handling call
0709 13:03:32.538004 (+1769085us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400404554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:32.538224 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411283200}
W20260709 13:03:32.526744  6725 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.076s	user 0.006s	sys 0.003s
I20260709 13:03:32.558696  6541 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.493798  1604 rpcz_store.cc:276] 0709 13:03:31.111613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.269254 (+157641us) service_pool.cc:224] Handling call
0709 13:03:31.911290 (+642036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.911477 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.911503 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:31.911541 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:31.911569 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.911622 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.465683 (+554061us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54001c7ad0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:32.465889 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475763456}
I20260709 13:03:32.531836  6623 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.537861  6690 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.516894  1681 rpcz_store.cc:276] 0709 13:03:30.831422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.857063 (+ 25641us) service_pool.cc:224] Handling call
0709 13:03:30.858225 (+  1162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.858947 (+   722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.858976 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.809616 (+950640us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b2c00106ad8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:31.810065 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.513262 (+703197us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:32.513379 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.513519 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.513637 (+   118us) raft_consensus.cc:1685] finished
0709 13:03:32.513655 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.513990 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":260,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":16958848,"thread_start_us":702573,"threads_started":1,"wal-append.queue_time_us":594851}
I20260709 13:03:32.567148  6351 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.538053  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.469904  1429 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:32.583029  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:32.581784  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.590369  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.592664  1603 raft_consensus.cc:2410] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:32.601363  1532 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:32.541553  6484 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:32.606793  6484 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.610140  6484 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:32.610351  1678 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:32.588351  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 267208us
W20260709 13:03:32.612232  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 154802us
I20260709 13:03:32.471225  1605 rpcz_store.cc:276] 0709 13:03:31.168873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.308002 (+139129us) service_pool.cc:224] Handling call
0709 13:03:31.308379 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.422453 (+114074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.422499 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.423030 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.809101 (+386071us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:31.809359 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.811252 (+  1893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.469115 (+657863us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b180044c8c0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419
0709 13:03:32.470172 (+  1057us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540003d4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:32.470216 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.470303 (+    87us) raft_consensus.cc:1685] finished
0709 13:03:32.470323 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.470595 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1623,"prepare.queue_time_us":2055,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":18327,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":14274,"spinlock_wait_cycles":268183680,"thread_start_us":385736,"threads_started":1,"wal-append.queue_time_us":767980}
I20260709 13:03:32.619457  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:32.622785  6690 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.628484  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:32.628728  1429 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 12, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.632858  1681 raft_consensus.cc:606] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.633356  1681 raft_consensus.cc:614] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:32.618552  6562 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.639822  6726 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:32.640895  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2275) took 2045 ms. Trace:
I20260709 13:03:32.641491  6736 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:32.641383  1533 rpcz_store.cc:276] 0709 13:03:30.594890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.595025 (+   135us) service_pool.cc:224] Handling call
0709 13:03:30.595367 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.641902 (+ 46535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.640301 (+1998399us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54000f7654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:32.640699 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104859008}
I20260709 13:03:32.642026  6736 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:32.643289  6736 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:32.649865  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 358212us
I20260709 13:03:32.651439  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.653954  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.655632  6741 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:32.620664  6484 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:32.663393  6655 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.651690  6672 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.677444  6747 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:03:32.645179  6736 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.667482  1429 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 13, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.670480  6743 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:32.670639  6684 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.672598  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.692780  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:32.693339  6684 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.694136  6573 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.695200  6573 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:32.695802  6573 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.681279   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:03:32.699285  6762 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.001s	sys 0.003s
I20260709 13:03:32.701416  6747 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:32.702426  6747 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:32.680630  6729 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 1.150s	user 0.013s	sys 0.013s
I20260709 13:03:32.676486  6501 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.708570  6684 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:32.709250  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 368389us
I20260709 13:03:32.709410  6684 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:32.709838  6501 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:32.710322  6684 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.711292  6426 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:32.686059  6484 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:32.708757  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54943.3us
I20260709 13:03:32.722532  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2481) took 1363 ms. Trace:
W20260709 13:03:32.723827  1576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:43535 timed out after 2.028s (SENT) [suppressed 13 similar messages]
I20260709 13:03:32.724897  6032 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.735219  6032 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.726653  6747 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.731513  6708 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:32.742717  6426 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:32.747040  1429 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 11, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.761801  1682 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:32.763029  6032 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.763281  1678 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:32.751679  1610 rpcz_store.cc:276] 0709 13:03:31.359111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.634991 (+275880us) service_pool.cc:224] Handling call
0709 13:03:31.635257 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.635444 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:31.651770 (+ 16326us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.463529 (+811759us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b1800046300. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a 00007f4698083a2a
0709 13:03:32.665634 (+202105us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.675556 (+  9922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.687723 (+ 12167us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:32.721849 (+ 34126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.722010 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.722282 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14684,"prepare.queue_time_us":34904,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":5188,"raft.queue_time_us":2665,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":1259,"spinlock_wait_cycles":14222208,"thread_start_us":148212,"threads_started":1,"wal-append.queue_time_us":991641}
W20260709 13:03:32.765184  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39174 (request call id 1963) took 2042 ms (client timeout 2028 ms). Trace:
W20260709 13:03:32.766738  1682 rpcz_store.cc:269] 0709 13:03:30.725077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.725227 (+   150us) service_pool.cc:224] Handling call
0709 13:03:32.764933 (+2039706us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002e95d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:32.765086 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4025005440}
I20260709 13:03:32.767649   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:32.770551  6573 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.771955  6708 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.772696  6708 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.767557  6484 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:32.774115  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53079.9us
I20260709 13:03:32.775506  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:32.777302  6574 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:32.778244  6573 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:32.778879  6574 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.784700  6032 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.785439  6032 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.786545  6574 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.789866  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.790937  6747 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:32.793979  1526 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:32.791338  6349 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.795753  6349 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.798152  1682 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:32.791569  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:32.791812  6426 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:32.788116  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54998.6us
I20260709 13:03:32.801101  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.801484  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.801959  6726 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:32.803038  6426 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.803141  6726 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:32.803714  6426 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:32.803820  6726 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:32.790026  6032 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.826967  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:32.805505  6568 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.828294  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.748909  1429 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.828296  1676 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.829593  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.798758  6349 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.816540  6658 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.816170  6726 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.831656  6658 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.832696  6658 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.833429  6726 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.830340  1429 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.825433  6743 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:03:32.817162  6747 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:32.817952  6426 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.841377  6758 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:32.841749  6747 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:32.845465  6426 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.822655  6502 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.824831  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.841447  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.826330  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.827028  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.828326  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.827169  6708 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.808858  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.849483  1676 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:32.837996  1429 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.852837  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47952.4us
I20260709 13:03:32.853240  1679 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:32.854295  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65078us
I20260709 13:03:32.799324  6484 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:32.845353  6684 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.861225  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.860237  6502 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:32.863296  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.868342  6747 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:32.869475  6747 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:32.870092  6736 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:32.856127  6658 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.870728  6747 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.872571  6349 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.873023  6349 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.873395  6349 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.877408  6737 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:32.878080  6737 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:32.879158  6737 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:32.880738  6758 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:32.880867  6737 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.883385  6758 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:32.885349  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.889463  6684 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.890136  6708 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:32.892483  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51161.1us
I20260709 13:03:32.894515  6502 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:32.888357  6349 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.896783  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:32.890821  6658 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:32.891532  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.899161  6708 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:32.899662  6708 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:32.853194  6743 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.900127  6708 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.902302  1526 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:03:32.902751  1526 pending_rounds.cc:85] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:03:32.902978  1526 pending_rounds.cc:107] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:32.903358  1526 raft_consensus.cc:2889] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.905541  6573 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:32.908061  6574 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:32.909487  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.912132  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.898164  6658 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:32.900663  6032 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:32.912919  6484 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.915128  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.916062  1675 raft_consensus.cc:2393] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:32.900876  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:32.862530  1429 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 8 to 9, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 9 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.916930  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56300.4us
I20260709 13:03:32.918218  1429 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.920150  1429 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:32.922349  6531 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.922859  6531 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.924791  6658 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:32.929188  6658 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.935592  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.930699  6484 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.931010  2209 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:32.937402  1681 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:32.939550  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.925450  6531 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.933768  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.932875  6708 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:32.948679  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:32.950716  6484 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:32.951705  6484 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:32.952991  6484 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:32.961026  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46879.5us
I20260709 13:03:32.973716  1605 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:32.976533  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:32.988499  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:32.989255  1675 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:32.992146  6349 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:32.992247  1526 pending_rounds.cc:85] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:32.992779  1526 pending_rounds.cc:107] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:32.993085  1526 raft_consensus.cc:2889] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.922066  1429 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 6 to 9, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 9 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:33.023581  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.024405  1675 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:33.036463  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.037010  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:33.037231  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:33.019734  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:33.044063  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.044536  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.044809  1682 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:33.045256  1684 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:33.045903  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.046643  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.047439  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.048310  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.048832  6340 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.049757  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.050462  6349 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.103093  1678 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:33.050613  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.052604  1429 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:33.040359  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.093305  1607 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.093295  1610 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:33.094020  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.093705  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.095425  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.096769  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.096894  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.097882  1602 raft_consensus.cc:1240] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:33.095525  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.053141  6568 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.102149  1681 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:33.106906  2211 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:33.108331  6708 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.110400  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.108404  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.130965  1683 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:33.113917  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:33.130549  6340 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.143586  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.147780  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.148209  6655 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.148597  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:33.148895  6655 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.149698  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.150779  6674 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.150895  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:33.145640  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 95134.2us
I20260709 13:03:33.151892  1601 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:33.157688  1680 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:33.162223  1606 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:33.170146  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:33.151553  6655 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.173676  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.175009  1603 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:33.178072  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:33.172590  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.151417  6674 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.197728  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:33.177096  1605 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:33.205060  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:33.212536  6428 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:33.213447  6427 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:03:33.176314  1604 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:33.219573  1527 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.213735  6340 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:33.216017  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:33.181670  6770 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:33.168488  6349 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:33.177846  6741 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.231917  6349 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:33.260072  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 90068.6us
I20260709 13:03:33.262091  1680 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:03:33.236951  6427 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:33.265448  1535 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:33.180866  6568 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.267704  1682 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:33.268757  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.269889  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.270378  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.270965  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:33.271970  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.271982  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.273022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.273113  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.274183  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.272136  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.276921  1534 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:33.280133  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 81864.2us
I20260709 13:03:33.280328  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.281020  1528 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:33.274207  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.270913  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.284564  1429 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:33.290277  6498 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.291092  6498 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.294659  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.294314  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.298504  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.261667  6349 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:33.304342  1676 pending_rounds.cc:85] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 9
I20260709 13:03:33.304720  1676 pending_rounds.cc:107] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:03:33.304957  1676 raft_consensus.cc:2889] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.296188  6427 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:33.309054  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:33.309547  6427 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.304011  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.312557  6672 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:33.312915  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.314050  6573 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:33.314468  6573 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.314947  6573 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.318516  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:33.321997  6774 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:03:33.323019  1680 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:33.237577  6741 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.356529  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.361563  1527 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:33.362385  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48066us
I20260709 13:03:33.340449  6655 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.369468  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.357458  1682 raft_consensus.cc:2376] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18. Re-sending same reply.
I20260709 13:03:33.366338  1609 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.353969  6743 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:33.361361  6684 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:33.364432  6708 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:33.442884  6568 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.443508  6568 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.449692  6741 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.450552  6741 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.451195  6741 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.431846  6743 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.455523  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:33.462662  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.456229  6032 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.464495  6032 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.466989  6032 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.467540  6032 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:33.456830  6498 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.468384  6498 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.468923  6498 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.471060  6498 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:33.459034  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48859.6us
I20260709 13:03:33.472429  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:33.473961  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.474869  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.459767  6426 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:33.459937  6674 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.474738  6502 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.443980  6568 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.483902  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.487614  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.500670  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:33.492367  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:33.467881  6032 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.513671  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:33.514971  1530 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:33.515779  6658 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:33.516355  6658 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.516856  6658 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.510784  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.384684  6655 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.483248  6501 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.530619  1681 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:33.503994  6758 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:33.532570  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.535176  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:33.413039  6672 consensus_queue.cc:1059] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:03:33.509976  6747 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:33.520551  6032 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.526060  6426 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:33.537503  6758 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:33.537730  6340 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:33.510699  6684 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.540133  6747 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.604862  6747 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.606285  6684 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:33.608103  1531 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:33.608776  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:33.609401  2211 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:33.607975  6609 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:33.610441  6609 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:33.610642  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.611546  6684 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:33.611979  6684 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:33.612128  6778 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:33.612425  6684 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.612581  6778 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:33.613056  6778 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:33.611364  6609 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.613458  6747 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.613910  6609 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.615808  6747 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:33.533998  6574 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:03:33.620100  6674 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.620709  6674 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.621249  6574 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.621913  6574 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.601034  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.627534  1679 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:33.552211  6426 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:33.550436  6428 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:33.603528  6758 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.603891  6340 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.655926  1679 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:33.641309  6426 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:33.661130  1608 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:33.649844  6484 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.677222  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.678117  1679 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 11.
I20260709 13:03:33.657374  6340 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.694079  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.698319  6574 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.700982  6574 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.701617  6574 consensus_queue.cc:1243] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:33.705873  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.706570  1678 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:33.710193  1684 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:33.716696  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.717545  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.716610  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.723774  1679 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:33.727074  6428 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.760087  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.760308  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:33.768210  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 229710us
I20260709 13:03:33.776762  6501 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.777729  6568 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.777467  6501 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.778941  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.776810  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:33.780201  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.781678  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:33.784395  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.793267  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:33.793974  1602 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.731140  6573 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.740525  6502 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:33.820304  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:33.833564  6743 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:33.834661  6783 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:33.835175  6783 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:33.835475  6779 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:03:33.836102  6783 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.837433  6783 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:33.840163  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.843163  1609 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:33.840057  6349 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.847657   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:33.848193  6784 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:33.848269  1529 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:03:33.852535  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95030.1us
I20260709 13:03:33.853225  6792 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:33.854161  6792 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:33.854447  6796 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:33.854676  6792 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.856215  6498 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:33.856633  6498 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:33.857542  6498 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.858808  6498 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.791839  6684 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.866168  6684 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:33.822829  6655 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.868541  6501 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:33.869822  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 354249us
I20260709 13:03:33.870316  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.871011  1648 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:33.873226  6782 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:03:33.874257  6785 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:33.875329  6574 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:33.875638  1602 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:33.876848  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:33.839814  6791 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.879423  6791 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.880620  6573 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:33.878816  6788 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:33.871021  1604 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:33.882598  1606 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:33.903750  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:33.848920  6349 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.875867  6574 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.906199  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:33.922304  6349 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.900902  6568 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:33.928606  6568 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.931483  6568 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:33.932354  6793 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.914479  6574 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.914839  6502 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:33.946991  6032 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.910892  6655 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:03:33.935904  6794 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:33.952190  1607 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:33.912397  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:33.951648  6484 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:33.962292  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50007.5us
I20260709 13:03:33.923748  6791 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.903791  6501 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:03:33.974042  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70367.9us
I20260709 13:03:33.961696  6794 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:33.967988  6484 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.998198  6743 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.968906  6658 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:33.989138  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 145839us
I20260709 13:03:33.990547  6792 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:33.990991  6778 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.026301  6778 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.026356  6426 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:33.966300  6758 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.029687  6758 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.031980  6792 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.032207  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.032620  6792 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.033880  6812 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.034386  6812 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.034745  6812 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.035084  6792 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.031395  6484 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:34.040146  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 164484us
I20260709 13:03:34.040782  6484 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.042233  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.042358  6573 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:34.043015  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.043960  6573 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:34.045698  6655 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.046252  6655 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.051923  6655 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.051532  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.048660  6805 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.049782  1678 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:34.054917  6658 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.053267  1604 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:34.057828  6674 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.058382  6674 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.058933  6674 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.060654  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:34.061229  6498 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.061784  6498 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:33.967760  6340 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.064141  6340 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:33.999711  6794 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.060981  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:34.065676  2209 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:34.063798  6498 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.067456  6741 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.079113  2211 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:34.081641  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.086524  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.087730  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:34.089040  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50082.3us
I20260709 13:03:34.080633  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:34.090583  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 130881us
I20260709 13:03:34.097044  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.100486  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.053232  6032 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.104799  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:34.105536  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.112978  1576 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.114058  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.094192  6427 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.120873  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.104621  6655 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:34.085631  6736 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:03:34.106110  6502 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:34.126211  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.128961  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.133124  6574 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.135126  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.135349  6812 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.142153  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.143172  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.122798  6792 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:34.135818  6574 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.146142  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.150758  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.141546  6684 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.139422  6793 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:34.159863  6426 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:34.167537  6741 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:34.167827  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.168751  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.126667  6427 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.168648  6502 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.169929  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.172761  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.173529  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:34.174206  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131255us
I20260709 13:03:34.190802  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.191128  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.190902  1501 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.175514  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.175576  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.176335  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.177083  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.194308  1532 raft_consensus.cc:2393] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.177943  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.178596  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.179630  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.142647  6655 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:34.149272  6792 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.124352  6791 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:03:34.196681  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.197309  1534 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.197775  1527 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.198066  1528 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.198333  1604 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:34.202711  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81101.2us
W20260709 13:03:34.196564  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76901.2us
W20260709 13:03:34.205297  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 74880us
I20260709 13:03:34.178800  6684 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.188818  6793 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.207896  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.203878  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.211463  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.202867  6792 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:34.207264  6562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.007s
I20260709 13:03:34.218734  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.204886  6741 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:34.209501  6684 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.214546  6797 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:34.235455  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.239054  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:34.218605  6562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.007s	sys 0.007s
I20260709 13:03:34.212603  6793 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:34.246390  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.246703  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.219515  6674 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.260277  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.251078  6574 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:34.243322  6498 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:03:34.277280  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.261969  6783 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:34.280480  6498 consensus_queue.cc:1243] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:34.282572  1533 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:34.283703  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.268663  6655 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:34.292166  6821 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:34.292951  6821 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:34.303715  1533 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:34.298719  6812 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.286455  6824 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.308732  6574 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:34.313123  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.313479  6574 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.313951  6574 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:34.314824  6427 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.315855  6758 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.301038  6741 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.316434  6758 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.318539  6758 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.293967  6821 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.325206  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.326236  1535 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.306157  6783 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:34.323930  6824 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.341976  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.343416  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.343794  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.344275  1675 raft_consensus.cc:2410] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:03:34.344389  1680 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:34.345356  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.345806  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.345928  1678 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:34.346396  1680 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:34.346871  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64844.5us
I20260709 13:03:34.347579  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.348902  6428 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:34.351302  1680 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 18. Ops: []
I20260709 13:03:34.352658  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.353235  1680 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:34.322930  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.354331  6812 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.355576  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.356887  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.356982  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:34.307322  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50645.1us
I20260709 13:03:34.367069  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.367096  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.367928  1677 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:34.373140  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.374276  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.375168  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.376215  6831 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.376394  6498 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:34.376703  6831 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.377048  6498 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.377731  6498 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:34.380988  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.377206  6831 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.381630  1679 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:34.392076  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.340505  6824 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.405474  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.407517  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.411432  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.408839  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.410015  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.400728  6531 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:34.413226  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.404449  6032 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.419245  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:34.404286  6812 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:34.426483  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.429517  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.431370  1530 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:34.408016  6501 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:34.432749  6741 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:34.433401  6741 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.436395  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.436857  1534 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:34.437137  1535 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.413739  6804 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:34.422274  6805 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:34.404350  6674 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:03:34.444550  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.447777  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.435498  6741 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:34.446287  6684 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.446686  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:34.427203  6349 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:34.436303  6791 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.447443  2211 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:34.419523  6531 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.450735  1528 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.442250  6804 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.445075  6805 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.461607  6832 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:34.462143  6832 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.473242  1535 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:34.458416  6531 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.479024  6824 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.454571  6349 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.464411  6805 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:34.510672  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 82309.9us
I20260709 13:03:34.444888  6783 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.516124  6573 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:34.516906  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.461035  6804 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.462494  6832 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:34.485980  6349 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:34.525118  1531 raft_consensus.cc:2393] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:34.536129  6826 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:03:34.535208  6349 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.539209  6349 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.540165  6349 raft_consensus.cc:2764] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:34.541018  6349 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.541548  6349 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.542646  6032 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.542493  6794 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.543136  6831 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.545629  6831 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.521066  6850 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:03:34.513747  6827 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:34.547852  6827 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.548913  6827 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.548975  6684 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.543711  6349 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.554991  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.560835  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.543646  1527 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:34.566327  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.562363  1531 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:34.570200  1533 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:34.571497  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.541195  6531 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.575838  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.576449  1680 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.576694  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.577010  1528 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:34.579433  6855 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.579981  6855 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.582315  6855 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.584473  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.585078  1675 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.580323  6531 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.578562  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.593703  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:34.594626  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 150131us
I20260709 13:03:34.596621  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:34.596675  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.596988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.595517  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:34.603782  6841 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:34.580610  6792 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.609510  1532 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.610277  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.611227  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.587798  6741 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.619292  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.640623  1676 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17.
W20260709 13:03:34.628885  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.644833  1680 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:34.644834  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.608964  6794 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.609898  6428 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.651675  1528 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.652087  6804 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.654217  6804 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.612816  6684 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.611502  6792 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.658177  6859 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.658407  6857 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.659224  1576 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17.
I20260709 13:03:34.669188  1576 leader_election.cc:403] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:34.619289  6861 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:34.661744  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51632.3us
I20260709 13:03:34.659545  6741 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.619582  6574 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.675746  1526 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:34.616554  6793 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.680541  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.681427  1608 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.619874  6498 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.678668  1675 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:34.634442  6805 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.669133  6857 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:34.700567  6857 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.702575  6805 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.655284  6827 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.704326  1533 raft_consensus.cc:2368] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:34.704730  6573 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:34.705201  6573 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.706197  6827 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.706727  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.707459  1605 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 11.
I20260709 13:03:34.673834  6859 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.708900  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.709125  6793 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.709731  6859 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.710027  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.711155  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.711673  1605 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:34.713856  6842 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
W20260709 13:03:34.717216  6844 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:03:34.707859  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.660841  6428 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.665700  6684 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.695850  6498 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.696621  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.697142  6824 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.699074  6812 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:34.734879  6428 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:34.736155  6861 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.692652  6778 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:34.736752  6778 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:34.736954  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:34.737444  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.737960  6861 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.737661  6778 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.738440  1601 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:34.728185  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69198.9us
I20260709 13:03:34.739035  6778 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:34.739311  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:34.741822  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.739661  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:34.731545  6574 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.732098  1531 raft_consensus.cc:2368] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
I20260709 13:03:34.733786  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.735991  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:34.747087  1528 raft_consensus.cc:2393] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.747632  1603 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:34.745332  6828 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:34.729139  6792 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:34.703696  6837 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.343s	user 0.004s	sys 0.000s
I20260709 13:03:34.749575  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.766757  1532 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:34.768996  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.769961  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.770988  1532 raft_consensus.cc:2368] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17.
I20260709 13:03:34.744489  6684 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:34.768180  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.768291  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.777901  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.778833  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.781805  1678 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:34.782141  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.733778  6812 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.787889  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:34.798431  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.799129  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.762897  6828 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:34.800837  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.802251  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.803442  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.804831  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.811555  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.812239  1534 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:34.812801  1678 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:34.814667  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:34.812781  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73556.9us
I20260709 13:03:34.819140  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.822885  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.824656  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.771732  6792 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.828516  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.804271  6747 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:34.831619  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.834013  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.836587  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.814071  6574 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:34.837844  6843 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:34.841041  1604 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:34.841400  6831 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.851358  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:34.849689  1534 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:34.849383  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.846483  1675 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:34.819213  6793 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:34.881178  1605 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:34.891837  1609 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:34.892953  2211 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:34.833361  6821 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.894613  1676 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:03:34.895629  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.897773  6858 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:34.898715  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:34.899121  6828 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.899767  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.900173  6828 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:34.895933  6865 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:34.896246  6831 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.853431  6737 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:03:34.903776  1605 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:34.904778  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:34.910205  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:34.842437  6568 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:34.842805  6747 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:34.920886  1534 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 18. Ops: []
I20260709 13:03:34.842935  6804 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:34.855878  6032 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.924809  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.932838  1528 raft_consensus.cc:1240] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:34.847604  6850 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:34.844656  6794 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 13:03:34.967408  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62712.1us
I20260709 13:03:35.006069  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:34.970446  1534 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:34.986330  6747 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:34.926261  6568 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:35.000461  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.001457  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:34.839867  6857 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:34.971520  6791 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
W20260709 13:03:35.002827  6837 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:03:35.053000  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 201869us
I20260709 13:03:35.048913  1532 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:35.054190  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.054740  1532 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:35.057222  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:35.057762  1532 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:35.059938  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.001060  6807 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.901017  6843 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:35.070108  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 92552.4us
W20260709 13:03:35.078799  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46235us
I20260709 13:03:35.052487  6747 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.049793  6791 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.056398  6531 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.056797  6498 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.059101  6708 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.100307  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.100919  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.070791  6032 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:35.110081  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 139742us
I20260709 13:03:35.106705  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.114058  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.114796  1676 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.118397  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.123606  1608 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:35.024873  6850 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.129752  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.130533  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.131034  1684 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.123152  6794 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.077718  6807 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:35.170181  6807 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.127619  6428 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.170871  6428 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.172224  6850 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.173045  6428 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:35.173544  6831 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.135779  6875 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.176486  6843 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:35.130273  6498 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:35.182511  6874 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:35.185756  6792 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.127063  6568 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.191164  6568 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.128268  6741 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17.
I20260709 13:03:35.149601  6809 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:35.158249  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2396) took 1035 ms. Trace:
I20260709 13:03:35.205626  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:35.207427  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.213488  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.213920  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:35.214310  1677 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.164628  6857 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.166651  6726 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.196947  1601 rpcz_store.cc:276] 0709 13:03:34.122780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.746275 (+623495us) service_pool.cc:224] Handling call
0709 13:03:34.746709 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.802429 (+ 55720us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:34.802462 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.802946 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.972488 (+169542us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:34.972536 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.972668 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.158001 (+185333us) raft_consensus.cc:1685] finished
0709 13:03:35.158022 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.158186 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46927,"raft.queue_time_us":57111,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7679,"thread_start_us":169126,"threads_started":1,"wal-append.queue_time_us":325878}
I20260709 13:03:35.125365  6793 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:35.216172  1647 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:35.296128  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.237300  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:35.332906  6848 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.900s	user 0.001s	sys 0.002s
I20260709 13:03:35.333434  6726 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:35.330416  6778 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:35.337996  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:35.394649  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 264930us
I20260709 13:03:35.340473  6831 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.395435  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.342365  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.396561  1534 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:35.397774  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.343133  6498 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.347992  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.401070  1535 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:35.358186  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.359576  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2400) took 1226 ms. Trace:
I20260709 13:03:35.406411  1609 rpcz_store.cc:276] 0709 13:03:34.132928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.786470 (+653542us) service_pool.cc:224] Handling call
0709 13:03:34.891592 (+105122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.892239 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.359371 (+467132us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54003093d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:35.359516 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198993152}
I20260709 13:03:35.407775  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.408396  1609 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.360838  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.361789  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:35.365720  6845 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.939s	user 0.005s	sys 0.006s
I20260709 13:03:35.366555  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2393) took 1267 ms. Trace:
I20260709 13:03:35.367393  6858 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:35.367707  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.410094  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:35.368058  6484 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:35.368409  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:35.372531  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:35.386243  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.411738  1533 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:35.400945  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:03:35.386775  6812 consensus_meta.cc:287] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
W20260709 13:03:35.388270  6834 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 1.101s	user 0.000s	sys 0.010s
I20260709 13:03:35.196738  6809 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:35.392952  1676 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:35.400238  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.414278  1534 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:35.195741  6573 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.418110  1684 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:35.410113  1606 rpcz_store.cc:276] 0709 13:03:34.099087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.203760 (+104673us) service_pool.cc:224] Handling call
0709 13:03:35.366345 (+1162585us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003becd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:35.366479 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491649408}
W20260709 13:03:35.389798  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 173696us
I20260709 13:03:35.421286  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.421696  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:35.440111  1527 raft_consensus.cc:2368] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:35.331619  6875 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.444181  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:35.473766  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73611.4us
I20260709 13:03:35.482354  1681 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
W20260709 13:03:35.445685  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50357.5us
I20260709 13:03:35.486096  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:35.482595  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.491848  1609 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:35.495936  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:35.504225  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.505698  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:35.472450  6848 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:35.420660  6568 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.509948  1679 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:35.510535  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.462719  6795 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:35.465641  6794 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:35.514722  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.515717  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.520059  1609 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.520430  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:35.521016  1683 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.516211  6861 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:35.519281  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.517643  6795 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.504662  6032 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.416102  6778 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:35.526968  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:35.466070  6857 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:03:35.524555  1606 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.421375  6812 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.552637  1607 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:35.523119  1501 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.539680  1609 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
W20260709 13:03:35.548416  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44334.1us
I20260709 13:03:35.554409  1679 raft_consensus.cc:1217] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:03:35.561508  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:35.561859  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2017) took 1219 ms. Trace:
I20260709 13:03:35.518365  6794 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.564339  1682 rpcz_store.cc:276] 0709 13:03:34.342847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.342961 (+   114us) service_pool.cc:224] Handling call
0709 13:03:34.343345 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.343601 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.343634 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.344189 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.422178 (+ 77989us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:34.422201 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.422245 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.365006 (+942761us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:35.552788 (+187782us) raft_consensus.cc:1685] finished
0709 13:03:35.552823 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.561791 (+  8968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21476608,"thread_start_us":77597,"threads_started":1,"wal-append.queue_time_us":82114}
I20260709 13:03:35.525008  6795 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.571152  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:35.563607  1679 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:35.519956  6858 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:35.576867  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:35.574074  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2539) took 1151 ms. Trace:
I20260709 13:03:35.522981  6820 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:35.523298  6850 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.583683  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:35.587934  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64901.1us
W20260709 13:03:35.594528  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.012s	sys 0.016s
W20260709 13:03:35.595285  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.012s	sys 0.016s
I20260709 13:03:35.596390  1607 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:35.598826  1679 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:35.580462  6832 consensus_meta.cc:287] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 1.004s	user 0.014s	sys 0.004s
I20260709 13:03:35.605337  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.572199  6861 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:35.573395  6484 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:35.583925  6032 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:35.607498  1679 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:35.584388  6857 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:35.617834  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:35.620388  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58999.8us
I20260709 13:03:35.619719  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.585934  6831 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:35.519415  6793 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.586128  6858 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.625589  6824 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.625383  6783 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:35.600975  6820 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:35.622169  6502 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.626121  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:35.626677  6884 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:03:35.628073  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.640560  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.629109  1679 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:35.514083  6875 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:35.554116  6655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.262s	user 0.010s	sys 0.020s
I20260709 13:03:35.607095  6861 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:35.628744  6828 consensus_meta.cc:287] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 13:03:35.544718  6809 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:35.642795  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.636466  6573 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.644419  6708 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:35.647164  6882 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:35.622272  6032 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.627471  6850 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.680948  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.661621  1606 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:35.744391  1607 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.744926  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:35.745594  1606 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:35.746410  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:35.683061  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 55136.5us
I20260709 13:03:35.681867  1608 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:35.623669  6427 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:03:35.609359  6832 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.652110  1683 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:35.633342  6349 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.761086  1681 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:35.648916  6655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.010s	sys 0.020s
I20260709 13:03:35.747398  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.749092  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.648463  6831 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:35.758931  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 116198us
I20260709 13:03:35.650569  6743 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.623891  6778 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.638975  6857 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.644474  6726 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.752270  6737 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.782423  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.620369  6794 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.785578  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:35.775220  1677 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:03:35.794003  1677 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:35.787621  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:35.747814  6032 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.782404  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.637133  6824 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.636472  6747 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:03:35.791356  1604 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:03:35.807816  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 165301us
I20260709 13:03:35.795235  1606 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:35.785732  6573 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:35.782876  6809 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.801460  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.812857  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1951) took 1520 ms. Trace:
I20260709 13:03:35.802913  6857 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.795023  6737 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:35.814080  1526 rpcz_store.cc:276] 0709 13:03:34.292056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.292550 (+   494us) service_pool.cc:224] Handling call
0709 13:03:34.292868 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.683844 (+390976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.812604 (+1128760us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540020ab54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:35.812796 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880086912}
I20260709 13:03:35.785415  6502 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.795204  6349 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:35.810843  1607 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:35.799669  6658 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:35.809731  6655 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.816247  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.817162  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.828349  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:35.811745  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:35.801093  6887 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:03:35.806216  6812 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.837400  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2505) took 1007 ms. Trace:
W20260709 13:03:35.827515  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.838850  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.839887  1531 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:03:35.837842  1678 rpcz_store.cc:276] 0709 13:03:34.830168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.830310 (+   142us) service_pool.cc:224] Handling call
0709 13:03:34.830700 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:34.888746 (+ 58046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.888793 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:34.909259 (+ 20466us) log.cc:844] Serialized 52 byte log entry
0709 13:03:35.595942 (+686683us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:35.596003 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.596104 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.837164 (+241060us) raft_consensus.cc:1685] finished
0709 13:03:35.837187 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.837339 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6844,"raft.queue_time_us":97,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":38307,"thread_start_us":564210,"threads_started":1,"wal-append.queue_time_us":671939}
I20260709 13:03:35.843272  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.811004  1501 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.843958  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.813597  6573 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.815727  6850 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:03:35.833484  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:35.835083  6737 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:35.812855  6484 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.819589  6794 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:35.793574  6861 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.882881  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.883503  1607 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.838420  6349 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:35.855208  6890 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:03:35.892797  6797 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:35.893187  6824 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:35.846632  6828 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.846177  6562 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:35.897953  6484 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:35.895025  6812 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:35.793375  6820 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.837754  6801 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.271s
I20260709 13:03:35.903267  1607 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:35.884403  6741 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.864717  6747 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:03:35.911896  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:35.795430  6858 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.918169  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:35.902808  6850 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.934057  1683 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:35.934957  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:35.904068  6861 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:35.902734  6484 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.887859  6658 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:35.948199  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:35.940989  6032 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.905498  6797 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:35.907490  6562 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:35.940871  6824 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.944308  6741 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:35.932919  6817 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:03:35.902483  6573 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.942795  6850 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.952863  6863 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:35.952019  6875 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.953929  6824 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:35.954756  6741 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.955091  6832 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.954632  6879 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.958177  6655 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.958333  6831 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:35.945242  6349 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.959167  6792 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:35.960973  6484 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.974339  6032 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.980060  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:35.980605  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2536) took 1579 ms. Trace:
I20260709 13:03:35.967610  6573 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.959501  6747 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:35.974696  6741 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.998232  1682 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:36.016286  6824 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.013643  6797 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.977394  6879 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.026471  1606 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:03:36.027258  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2541) took 1588 ms. Trace:
I20260709 13:03:36.030089  6879 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.033471  6032 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.034101  6032 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.035912  6032 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.027586  1606 rpcz_store.cc:276] 0709 13:03:34.438676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.025822 (+1587146us) service_pool.cc:224] Handling call
0709 13:03:36.026224 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.027002 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.027206 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:36.040113  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.972851  6855 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:36.042639  6743 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:36.043174  6743 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:36.045573  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2389) took 1968 ms (client timeout 1942 ms). Trace:
W20260709 13:03:36.046146  1610 rpcz_store.cc:269] 0709 13:03:34.077310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.077579 (+   269us) service_pool.cc:224] Handling call
0709 13:03:36.045313 (+1967734us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540024a254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:36.045491 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3869371776}
I20260709 13:03:36.048868  6825 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:35.994773  6836 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.049494  6825 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:36.050702  6825 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.047883  1610 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:36.061357  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.982842  6831 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:35.987776  6817 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:03:36.066696  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2543) took 1617 ms. Trace:
I20260709 13:03:36.074294  1610 rpcz_store.cc:276] 0709 13:03:34.448886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.047194 (+1598308us) service_pool.cc:224] Handling call
0709 13:03:36.047596 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.066421 (+ 18825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.066628 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:36.068601  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.076974  1527 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:36.066104  6886 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:36.090621  6883 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:36.091903  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2397) took 1960 ms. Trace:
I20260709 13:03:36.041105  6484 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.092674  6850 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:35.981130  1601 rpcz_store.cc:276] 0709 13:03:34.401297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.340255 (+938958us) service_pool.cc:224] Handling call
0709 13:03:35.340579 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.340764 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:35.341053 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.979453 (+638400us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.980281 (+   828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.980329 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:35.980374 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.980438 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.980554 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38447,"prepare.queue_time_us":1587,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":18929,"spinlock_wait_cycles":4912000,"thread_start_us":559347,"threads_started":2,"wal-append.queue_time_us":280255}
I20260709 13:03:36.014691  6562 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.113132  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2353) took 1273 ms. Trace:
I20260709 13:03:36.126533  1529 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:36.115412  1528 rpcz_store.cc:276] 0709 13:03:34.839415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.974464 (+135049us) service_pool.cc:224] Handling call
0709 13:03:34.974782 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.035126 (+ 60344us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:35.060612 (+ 25486us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.413488 (+352876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.413544 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:35.413604 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.112802 (+699198us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b54000f7654. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.112873 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.113059 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21572,"prepare.queue_time_us":25284,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":20780,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":22483,"spinlock_wait_cycles":138161536,"thread_start_us":333159,"threads_started":1,"wal-append.queue_time_us":454183}
I20260709 13:03:36.094205  1603 rpcz_store.cc:276] 0709 13:03:34.131921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.781492 (+649571us) service_pool.cc:224] Handling call
0709 13:03:34.819570 (+ 38078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.901907 (+ 82337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.901936 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.350979 (+449043us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180039fca0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a
0709 13:03:35.352149 (+  1170us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2c0000e678. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:35.352681 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.584920 (+232239us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:36.087414 (+502494us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.090436 (+  3022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.091398 (+   962us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.091452 (+    54us) raft_consensus.cc:1685] finished
0709 13:03:36.091468 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.091831 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34809,"raft.queue_time_us":44660,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":212,"spinlock_wait_cycles":32709248,"thread_start_us":688017,"threads_started":2,"wal-append.queue_time_us":273085}
I20260709 13:03:36.073931  6824 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.984400  6792 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.130019  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:35.986678  6655 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.136648  1534 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:36.115114  6825 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.141891  1528 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:36.148241  2177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.149410  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:36.162701  1603 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:36.105968  6795 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:36.054934  6743 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.169380  1603 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:36.170468  1527 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:36.171339  1528 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:36.168479  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.184101  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:36.205966  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 269165us
I20260709 13:03:36.207945  1605 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:03:36.208526  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:36.208901  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.213994  1574 leader_election.cc:400] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:36.202714  6684 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:36.215226  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:36.215860  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 212577us
I20260709 13:03:36.207845  6879 raft_consensus.cc:2764] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:03:36.213450  6743 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.255823  1531 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:36.251410  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.220155  1498 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.217368  6793 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.263078  1574 leader_election.cc:400] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17.
I20260709 13:03:36.258042  6857 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:36.218979  2209 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:03:36.260111  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 449144us
I20260709 13:03:36.265283  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.286988  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.266566  6879 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.268013  6895 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:36.270910  6857 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:36.272979  6896 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:03:36.278165  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.280761  6778 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:36.283039  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.308406  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.260430  6684 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:36.258093  6901 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.316990  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.317830  6902 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.325167  6850 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:36.325322  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.325639  6850 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.326052  6850 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:36.326131  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.328060  6905 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:36.328614  6905 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:36.324795  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:36.329175  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.338616  6032 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:36.310182  6778 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:36.341468  6854 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.348728  6828 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.349385  6828 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.349558  6684 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.350773  6905 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:36.313768  6797 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.345203  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2540) took 1916 ms. Trace:
I20260709 13:03:36.345638  6032 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:36.353938  6032 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:36.344553  6831 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.354468  1607 rpcz_store.cc:276] 0709 13:03:34.428832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.943581 (+1514749us) service_pool.cc:224] Handling call
0709 13:03:35.943967 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.944237 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:36.270381 (+326144us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.344398 (+ 74017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.344460 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:36.344959 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.345030 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.345148 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":325721,"prepare.queue_time_us":326169,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"spinlock_wait_cycles":37632,"thread_start_us":73623,"threads_started":1}
I20260709 13:03:36.322817  6708 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:36.356611  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.358690  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:36.356316  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2542) took 1912 ms. Trace:
I20260709 13:03:36.323074  6879 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:36.343801  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 81747.4us
I20260709 13:03:36.385068  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:36.387037  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:36.387256  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:36.387902  1533 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.335616  6838 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:36.389279  6032 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:36.392465  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 105565us
I20260709 13:03:36.389359  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.394191  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.345003  6427 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.387632  1606 rpcz_store.cc:276] 0709 13:03:34.444105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.039691 (+1595586us) service_pool.cc:224] Handling call
0709 13:03:36.039998 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.040221 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:36.281956 (+241735us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.355983 (+ 74027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.356048 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:36.356089 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.356151 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.356261 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291714,"prepare.queue_time_us":259655,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2417,"raft.queue_time_us":26401,"thread_start_us":73715,"threads_started":1}
I20260709 13:03:36.399103  6032 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.410239  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:36.411293  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.412504  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:36.414922  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.411612  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.345038  6895 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:03:36.384249  6879 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.344872  6875 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:03:36.318082  6857 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.411732  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:36.425343  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:36.423475  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80993us
I20260709 13:03:36.395009  6708 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:36.428117  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.428984  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:36.434134  1647 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:36.437775  6747 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:36.437901  1535 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:36.438706  6907 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:36.438335  6747 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.440781  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.414786  6655 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.424553  6879 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.425145  6902 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:36.397683  6838 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.452090  1533 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 16.
I20260709 13:03:36.452440  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2403) took 2288 ms. Trace:
I20260709 13:03:36.419572  6820 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:36.424187  6795 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.408905  6427 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.467633  1604 rpcz_store.cc:276] 0709 13:03:34.164020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.901227 (+737207us) service_pool.cc:224] Handling call
0709 13:03:34.901522 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.809982 (+908460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.452165 (+642183us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.452382 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045756800}
I20260709 13:03:36.449445  6801 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:36.439559  6812 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:36.531924  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.491034  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.566066  1604 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:36.458166  6747 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.563015  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:36.573446  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.490738  6901 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:36.467343  6921 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.583771  1603 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:36.491513  6574 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:36.435848  6778 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.565562  6672 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.572904  6908 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:03:36.563581  6801 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:36.588856  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 194723us
I20260709 13:03:36.593816  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.594614  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.595487  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2533) took 2228 ms. Trace:
I20260709 13:03:36.568145  6902 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:35.578222  1602 rpcz_store.cc:276] 0709 13:03:34.422962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.344092 (+921130us) service_pool.cc:224] Handling call
0709 13:03:35.344359 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.344536 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:35.344829 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.573479 (+228650us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.573668 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.573722 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:35.573786 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.573868 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.574008 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16320,"prepare.queue_time_us":1799,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":16919,"spinlock_wait_cycles":149888,"thread_start_us":211580,"threads_started":1}
I20260709 13:03:36.589097  1604 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:03:36.604974  1606 raft_consensus.cc:2410] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:36.608357  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2421) took 1203 ms. Trace:
I20260709 13:03:36.608611  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2548) took 1199 ms. Trace:
I20260709 13:03:36.608733  1604 rpcz_store.cc:276] 0709 13:03:35.405211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.588550 (+1183339us) service_pool.cc:224] Handling call
0709 13:03:36.588869 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.608108 (+ 19239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.608303 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.609010  1606 rpcz_store.cc:276] 0709 13:03:35.409291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.607833 (+1198542us) service_pool.cc:224] Handling call
0709 13:03:36.608149 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.608311 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.608337 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.608379 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:36.608417 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.608479 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.608566 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.595978  1608 rpcz_store.cc:276] 0709 13:03:34.367511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.134283 (+766772us) service_pool.cc:224] Handling call
0709 13:03:35.134571 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.748517 (+613946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.595226 (+846709us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54003098d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.595415 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257849088}
I20260709 13:03:36.610736  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2551) took 1099 ms. Trace:
I20260709 13:03:36.597939  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:36.611347  1606 rpcz_store.cc:276] 0709 13:03:35.511437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.610132 (+1098695us) service_pool.cc:224] Handling call
0709 13:03:36.610356 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.610496 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.610516 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.610551 (+    35us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:36.610583 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.610625 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.610693 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.492401  6820 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.610720  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2549) took 1201 ms. Trace:
I20260709 13:03:36.612816  1604 rpcz_store.cc:276] 0709 13:03:35.409514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.609999 (+1200485us) service_pool.cc:224] Handling call
0709 13:03:36.610266 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.610422 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.610447 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.610483 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:36.610510 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.610558 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.610670 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.613250  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2554) took 1057 ms. Trace:
I20260709 13:03:36.613649  1606 rpcz_store.cc:276] 0709 13:03:35.555873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.612497 (+1056624us) service_pool.cc:224] Handling call
0709 13:03:36.612772 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.612947 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.612973 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.613018 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:36.613051 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.613103 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.613201 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.586283  6574 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:36.614998  1604 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:36.615077  1608 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:36.570050  6812 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.615938  2176 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:36.614781  6726 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:36.600710  6801 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.622184  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2521) took 1471 ms. Trace:
I20260709 13:03:36.621043  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2553) took 1070 ms. Trace:
I20260709 13:03:36.577219  6920 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:03:36.623421  1608 rpcz_store.cc:276] 0709 13:03:35.548181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.611452 (+1063271us) service_pool.cc:224] Handling call
0709 13:03:36.614908 (+  3456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.617780 (+  2872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.618030 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.609222  6684 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.622645  1681 rpcz_store.cc:276] 0709 13:03:35.150595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.530496 (+379901us) service_pool.cc:224] Handling call
0709 13:03:35.754462 (+223966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.781839 (+ 27377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.622006 (+840167us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540041b750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:36.622131 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514293120}
I20260709 13:03:36.620901  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2555) took 1053 ms. Trace:
I20260709 13:03:36.627775  1604 rpcz_store.cc:276] 0709 13:03:35.564091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.613507 (+1049416us) service_pool.cc:224] Handling call
0709 13:03:36.613794 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.617420 (+  3626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.617616 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.634120  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2560) took 1006 ms. Trace:
I20260709 13:03:36.616936  6778 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.621534  6726 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.643142  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2559) took 1035 ms. Trace:
I20260709 13:03:36.637207  6928 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.643548  1608 rpcz_store.cc:276] 0709 13:03:35.607509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.626415 (+1018906us) service_pool.cc:224] Handling call
0709 13:03:36.642650 (+ 16235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.642840 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.642867 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.642905 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:36.642934 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.642985 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.643085 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.637475  1604 rpcz_store.cc:276] 0709 13:03:35.627343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.628508 (+1001165us) service_pool.cc:224] Handling call
0709 13:03:36.633311 (+  4803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.633547 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.633584 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.633641 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:36.633690 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.633761 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.634013 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.645104  6574 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.645889  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2561) took 1010 ms. Trace:
I20260709 13:03:36.646486  6574 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:36.646318  1608 rpcz_store.cc:276] 0709 13:03:35.635696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.644941 (+1009245us) service_pool.cc:224] Handling call
0709 13:03:36.645383 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.645554 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.645582 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.645638 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:36.645673 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.645727 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.645834 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.636765  6684 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.650156  1608 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:36.650389  6684 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.603962  6672 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.588189  6708 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.652107  1608 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:36.644461  6931 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:36.625909  6809 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:36.633726  6917 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:03:36.657625  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.664886  6838 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:36.666006  6913 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:03:36.666676  6918 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:03:36.667456  6912 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:03:36.689471  6741 consensus_meta.cc:287] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 13:03:36.689947  6741 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.690953  1601 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:36.645119  6919 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:36.693413  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2547) took 1284 ms. Trace:
I20260709 13:03:36.693859  6672 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:36.693795  1601 rpcz_store.cc:276] 0709 13:03:35.409020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.607179 (+1198159us) service_pool.cc:224] Handling call
0709 13:03:36.619244 (+ 12065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.691363 (+ 72119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.693164 (+  1801us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54001716d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.693350 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164498816}
I20260709 13:03:36.697224  6812 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:36.707255  6861 consensus_meta.cc:287] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.762s	user 0.008s	sys 0.004s
W20260709 13:03:36.642722  6916 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
W20260709 13:03:36.673580  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.652259  6726 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.682950  6820 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:36.685389  6573 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.001s
W20260709 13:03:36.721251  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 296141us
I20260709 13:03:36.670714  1574 leader_election.cc:400] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
W20260709 13:03:36.729768  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59247.9us
I20260709 13:03:36.730871  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.734512  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.735575  1601 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 16.
I20260709 13:03:36.675225  6931 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.739831  1680 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 18. Ops: []
W20260709 13:03:36.679939  6825 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.004s
I20260709 13:03:36.743930  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.712838  6809 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:36.676141  6655 consensus_queue.cc:1059] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:03:36.745043  6927 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.752898  6498 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.758988  6927 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.759474  6498 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.761334  6927 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:36.761443  6498 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.762212  6793 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.762414  6741 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.763643  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.764901  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.765771  6655 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.766433  6655 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.768213  6883 raft_consensus.cc:3055] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:36.768666  6883 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:36.769526  6883 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.770953  6883 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:36.762300  6809 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:36.761368  6658 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:36.774889  6658 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:36.775808  6658 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.776834  6658 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:36.777253  2175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.779881  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.786023  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.758725  6929 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.787660  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2420) took 1382 ms. Trace:
I20260709 13:03:36.796161  1603 rpcz_store.cc:276] 0709 13:03:35.404976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.186887 (+781911us) service_pool.cc:224] Handling call
0709 13:03:36.198296 (+ 11409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.586742 (+388446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.787429 (+200687us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540005cdd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.787601 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886077312}
I20260709 13:03:36.784423  6747 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.784440  6898 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:36.789203  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 297021us
I20260709 13:03:36.789716  6349 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:36.680353  6902 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:36.790868  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.791854  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2407) took 2626 ms. Trace:
W20260709 13:03:36.805359  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.806634  1605 rpcz_store.cc:276] 0709 13:03:34.165332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.915613 (+750281us) service_pool.cc:224] Handling call
0709 13:03:34.915950 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:36.208476 (+1292526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.791606 (+583130us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540024aed4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:36.791799 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970664192}
I20260709 13:03:36.793009  6895 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:36.793504  6824 consensus_meta.cc:287] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:03:36.793893  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.794456  6792 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.802579  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:36.812569  6929 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:36.813920  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:36.826841  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.832924  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.833416  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.833722  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.834218  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.834918  6895 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.836781  6895 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.838694  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:36.840471  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.841720  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:36.841827  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92059.2us
I20260709 13:03:36.842532  6349 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.842764  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.843034  6349 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.832248  6929 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.844413  6929 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.845058  6349 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.847700  6828 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:36.849660  6931 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:36.853605  6836 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:36.854249  6836 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:36.855043  6836 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.860345  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.860750  6792 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:36.861573  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.862279  1684 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:36.862480  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2424) took 1456 ms. Trace:
I20260709 13:03:36.863034  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.864208  1574 leader_election.cc:400] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:36.864516  1574 leader_election.cc:403] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:36.843801  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:36.798475  6898 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:36.839709  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:36.862861  1602 rpcz_store.cc:276] 0709 13:03:35.406042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.605921 (+1199879us) service_pool.cc:224] Handling call
0709 13:03:36.606270 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.606482 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:36.616943 (+ 10461us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.852674 (+235731us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003cd7e0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c1923a
0709 13:03:36.861835 (+  9161us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.862188 (+   353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.862227 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:36.862265 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.862322 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.862430 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8711,"prepare.queue_time_us":11555,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":11653,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":54725248,"thread_start_us":27575,"threads_started":1,"wal-append.queue_time_us":27671}
I20260709 13:03:36.802287  6573 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.873428  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:36.877714  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.878935  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.880514  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.820238  6427 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:36.885416  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 91597.9us
I20260709 13:03:36.887399  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.855991  6836 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.872433  6828 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.872145  6878 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:36.872296  6920 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 11. Current term is 12.
I20260709 13:03:36.881028  6573 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.885001  6854 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:36.889642  6861 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.921537  6573 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:36.924185  6484 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.006s
I20260709 13:03:36.899178  6349 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.918298  6854 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:36.926474  6655 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.881444  6801 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:36.928385  6794 consensus_meta.cc:287] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.000s
I20260709 13:03:36.930327  6747 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:36.931329  6850 consensus_meta.cc:287] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
I20260709 13:03:36.899008  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.899432  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:36.935791  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:36.898250  6875 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.926784  6854 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.941861  6894 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.906940  6878 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:36.954089  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 111487us
I20260709 13:03:36.954893  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:36.941105  6794 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:36.931872  6850 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:36.969729  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:36.961980  6743 consensus_meta.cc:287] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:03:36.962386  6878 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.966272  6898 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.006898  6879 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.007790  6935 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:37.008602  6929 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.013263  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2043) took 1081 ms. Trace:
I20260709 13:03:37.026089  6850 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.026750  6801 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.054636  6879 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.034678  6901 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:37.055984  6901 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:37.056917  6901 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.058079  6901 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:37.059136  6923 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.483s	user 0.000s	sys 0.003s
I20260709 13:03:37.031086  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:37.039254  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.060945  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.062085  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:37.046092  1680 rpcz_store.cc:276] 0709 13:03:35.932153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.933172 (+  1019us) service_pool.cc:224] Handling call
0709 13:03:35.933456 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.740433 (+806977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.012981 (+272548us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54002d46d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:37.013201 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853987712}
I20260709 13:03:37.049691  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.052742  1683 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:37.063349  1680 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:37.053537  1607 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:36.966532  6797 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:37.061014  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:37.055189  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61000us
W20260709 13:03:37.073016  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.081250  6797 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.081800  6797 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.083431  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2544) took 1866 ms. Trace:
I20260709 13:03:37.083981  6879 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:37.081825  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.092730  1602 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.093907  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.094997  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.095557  1609 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:37.096345  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.096988  1609 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.083822  1610 rpcz_store.cc:276] 0709 13:03:35.217349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.114336 (+896987us) service_pool.cc:224] Handling call
0709 13:03:36.137604 (+ 23268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.137866 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:36.312695 (+174829us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.712446 (+399751us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b4800240258. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:03:37.082883 (+370437us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b180034f060. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287
0709 13:03:37.083078 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.083134 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:37.083182 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.083252 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.083373 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245972,"prepare.queue_time_us":180361,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":175530,"raft.run_cpu_time_us":1262,"raft.run_wall_time_us":131379,"spinlock_wait_cycles":66162688,"thread_start_us":378134,"threads_started":2,"wal-append.queue_time_us":253085}
I20260709 13:03:37.099665  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.098362  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.101150  1608 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:37.102057  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.102643  1602 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:37.104460  6783 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:37.104771  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.105897  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.106361  6726 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.106846  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.108577  6726 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.108646  1605 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:37.109477  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:37.110203  1605 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.107841  6743 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:03:37.111796  6783 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:37.112598  1601 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.112696  6658 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:37.113159  6658 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.113895  1601 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:37.114004  6658 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.115103  1601 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.115502  6658 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.117268  2209 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.118078  6783 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:37.119127  6817 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:37.119474  6817 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.120316  6863 consensus_queue.cc:1059] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:37.120749  6562 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:37.121500  6863 raft_consensus.cc:3055] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:37.121910  6875 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:37.121965  6863 raft_consensus.cc:740] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:37.122519  6875 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:37.124835  1647 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.125300  6938 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:37.054662  6929 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.111937  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.131184  1678 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
W20260709 13:03:37.136987  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62367.6us
I20260709 13:03:37.035861  6854 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.141261  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.122110  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.083815  6797 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.123399  6875 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.152374  6948 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:03:37.152921  6857 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.158249  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.179288  1533 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.160135  6897 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:03:37.161413  6850 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.099869  6855 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.163079  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.163566  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:37.164347  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.164801  1609 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:37.190491  1606 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.165340  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.193213  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.194262  6861 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.195422  6895 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:37.166865  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44831.4us
I20260709 13:03:37.132133  6905 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:37.208166  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.208937  6032 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.209398  6032 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.199790  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.201319  1678 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.209700  1680 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:37.175590  6562 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:37.215929  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.214274  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.216833  1607 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:37.217707  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.218245  1607 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:37.218962  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.219587  1533 raft_consensus.cc:2468] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 20.
I20260709 13:03:37.199216  1682 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:03:37.220111  1682 pending_rounds.cc:85] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 9
I20260709 13:03:37.175407  6743 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:37.220366  1682 pending_rounds.cc:107] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:37.220662  1682 raft_consensus.cc:2889] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.221216  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.226589  1607 raft_consensus.cc:2393] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:37.224582  2176 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:37.224360  1678 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:37.228868  6032 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.123301  6863 consensus_queue.cc:260] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.230077  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.231336  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.183679  6778 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:37.238436  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.239214  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.239845  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.240491  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.243229  1529 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:37.216180  6562 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.239220  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.247413  1529 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:37.185212  6938 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:03:37.243510  1528 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:37.244850  1533 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.253235  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.256016  1529 raft_consensus.cc:2410] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:37.250754  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.253140  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.126057  6817 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.256749  1532 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:37.230031  6875 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:37.249045  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.256824  1534 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:37.234848  6726 raft_consensus.cc:2804] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:37.253587  1526 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:37.197037  6850 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.184398  6857 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.262518  1530 raft_consensus.cc:1240] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.263226  1601 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:37.255674  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.208619  6939 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:37.208472  6855 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.264014  1610 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:37.264196  1534 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.266573  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.257671  1678 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:37.269510  1529 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.252689  6562 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.273142  1526 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:37.267973  1647 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.258322  6863 raft_consensus.cc:3060] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.284798  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.287966  1535 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:37.285867  1526 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:37.286265  1531 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:37.287030  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.254406  6783 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:37.292721  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.292017  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.296428  1534 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.298146  1535 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:37.298720  1601 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:37.253592  6427 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:03:37.275251  6809 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.270121  6726 raft_consensus.cc:697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:37.304952  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.304603  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.315336  1610 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:37.318763  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.323134  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.323315  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.316308  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.328917  6941 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:03:37.330533  6937 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:37.332602  6817 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.332823  1529 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.337289  1610 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:37.295138  6783 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:37.303318  6924 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.342579  1534 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:37.344689  1601 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:37.325315  6854 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.366780  1533 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:37.342036  6783 raft_consensus.cc:3060] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:37.364681  6946 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:03:37.323873  6809 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.345896  6924 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.390695  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.398331  1533 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:37.392858  1532 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.394076  1529 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.394544  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.395445  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.401639  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.382699  6349 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:37.404131  1610 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:37.404561  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.372624  6878 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.411484  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.417727  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.416093  1534 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:03:37.419773  1534 pending_rounds.cc:85] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 10
I20260709 13:03:37.419425  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.410681  6901 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.406713  6568 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:37.423228  1534 pending_rounds.cc:107] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:03:37.424598  1534 raft_consensus.cc:2889] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.414486  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.422092  6573 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:37.425311  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.405905  6349 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:37.426921  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.416826  6854 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:37.383005  6726 consensus_queue.cc:237] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:37.422462  6897 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.419138  6920 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:37.430749  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.426815  6857 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.434603  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:37.439178  6958 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:37.505468  6954 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.002s
I20260709 13:03:37.505926  6883 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.507849  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.509013  1607 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:03:37.424258  6568 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.509404  1607 pending_rounds.cc:85] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 9
I20260709 13:03:37.509687  1607 pending_rounds.cc:107] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:03:37.428926  6797 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:03:37.494359  6895 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:37.510818  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.511340  1607 raft_consensus.cc:2889] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.511469  1681 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:37.430832  6854 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.516426  6854 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.516882  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2557) took 1940 ms. Trace:
I20260709 13:03:37.414001  6929 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:37.518640  6929 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:37.519044  6929 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:37.498732  6921 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:37.429088  6901 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.430557  6850 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.440389  6484 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:03:37.491819  6920 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.426378  6894 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:03:37.497653  6924 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.500499  6855 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.501004  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.426373  6573 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.532526  1501 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.509631  6568 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.517263  1606 rpcz_store.cc:276] 0709 13:03:35.576131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.619570 (+1043439us) service_pool.cc:224] Handling call
0709 13:03:37.187068 (+567498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.197866 (+ 10798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.516699 (+318833us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540003d9d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:37.516829 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304252800}
I20260709 13:03:37.500099  6878 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.539601  1682 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.541787  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.522091  6920 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.549255  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:37.551492  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119856us
I20260709 13:03:37.493203  6879 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.550352  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.546168  6573 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.433084  2209 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:37.517179  6809 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.559335  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:37.560292  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 125763us
I20260709 13:03:37.561072  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.561887  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.558513  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.520244  6921 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.565001  6964 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.565733  6964 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:37.567042  6921 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.568430  6921 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.568491  6484 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.569020  6484 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.574738  6568 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.559687  6797 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:03:37.563483  6875 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:37.527148  6795 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:37.556984  6794 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:37.582651  6857 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.554451  6850 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.583339  6562 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.553305  6924 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:37.536098  6854 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.586300  6897 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:37.587285  6855 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.563966  6684 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:37.604452  6684 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.604879  6684 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.610013  6349 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.611326  6349 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.613018  6783 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.615123  6783 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.589771  6924 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:37.616864  6924 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.520009  6929 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.637133  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 75669.6us
I20260709 13:03:37.593261  6965 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.640334  6894 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.652421  6894 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.653975  6905 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:37.656004  6894 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.657420  6854 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.658929  6562 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.663365  6879 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.647737  6920 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.654743  6905 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.671907  1605 raft_consensus.cc:2410] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:03:37.672331  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 110487us
I20260709 13:03:37.673336  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:37.733143  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59894.7us
W20260709 13:03:37.732339  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62760.3us
W20260709 13:03:37.758101  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.758293  1574 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.670248  6854 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.760015  6875 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.733462  6836 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.761296  6797 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.761543  6573 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.761754  6969 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:37.764204  6905 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.770920  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.774163  6801 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.774638  6855 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:37.775071  6855 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:37.773985  6901 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:03:37.775935  6855 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.776417  6901 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:37.776961  6901 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:37.777438  6855 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.777793  6901 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.779168  6901 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.776357  6573 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.774683  6801 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.772840  6783 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.781345  6783 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.782148  6801 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.783390  6783 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.765345  6879 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.779769  6573 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.784442  6573 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.757082  6965 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.761768  6817 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.793406  6573 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.766746  6349 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.802691  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:37.793978  6968 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.796656  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.769830  6897 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.805127  1677 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:03:37.807106  1677 pending_rounds.cc:85] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 10
I20260709 13:03:37.807448  1677 pending_rounds.cc:107] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:37.807664  1677 raft_consensus.cc:2889] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.810040  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:37.810864  1682 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 14.
I20260709 13:03:37.812114  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.765373  6921 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:03:37.812832  6349 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.818558  6349 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.765596  6863 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:37.824761  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.768541  6854 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.770761  6875 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.770203  6836 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.830559  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 523477us
I20260709 13:03:37.831710  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.832527  1531 raft_consensus.cc:2393] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:37.836690  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.836957  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.837178  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.837519  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.838452  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.838690  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:37.839367  1602 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.839036  1604 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:37.837282  1526 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.771425  6797 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.828850  6940 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:37.828661  6795 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.808759  6969 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:37.804245  6817 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.827387  6965 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:37.845328  1533 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:37.845084  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.830024  6901 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.844590  6941 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.834321  6968 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.861162  6920 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.849964  6940 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.862800  6850 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:37.863327  6854 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.863858  6797 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.866510  6973 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.867568  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.827064  6726 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:37.877933  1602 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
W20260709 13:03:37.878675  6966 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:03:37.876628  6968 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.825222  6897 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.872380  6969 consensus_queue.cc:1243] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:37.880182  6941 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.878700  6975 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:03:37.897441  6484 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.882663  6850 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:37.911254  6850 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.912652  6850 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.914117  6801 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.914813  6801 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.915086  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.915951  6658 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.899166  6817 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.900488  6836 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.901046  6875 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.903103  6684 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.903954  6955 log.cc:927] Time spent T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.591s	user 0.002s	sys 0.000s
I20260709 13:03:37.873615  6965 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.882776  6940 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.926277  1526 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:37.928431  6658 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.881151  6901 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.944202  6968 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.945886  6901 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.947428  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.947788  6684 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:37.930785  6817 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:03:37.949090  6801 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.949285  6977 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:37.949505  6817 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:37.904930  6973 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.949915  6977 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.950026  6817 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:37.950799  6658 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.951373  6743 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:37.950901  6977 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.951191  6817 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:37.932574  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 135994us
I20260709 13:03:37.936463  1529 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:37.942656  6941 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.951783  6743 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:37.961846  6743 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:37.937366  6965 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.964761  1607 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:37.965808  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.966398  1607 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:37.967172  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.967715  1607 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:37.932336  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 64834.8us
I20260709 13:03:37.968294  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.968845  1604 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:37.958056  1602 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:37.933980  6820 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:37.940640  6974 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:03:37.976926  6032 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:37.961287  6937 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:37.960501  6973 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:37.970885  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:37.971248  1603 raft_consensus.cc:2468] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:37.991895  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:37.993016  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:37.975612  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.997865  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:37.998700  1528 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:37.988528  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.989902  6032 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:37.972190  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.001257  1526 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:03:38.001673  1526 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:03:38.001917  1526 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:03:38.002179  1526 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.003248  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.999517  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:37.996452  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.005731  1530 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:38.010430  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.012770  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.011713  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.013386  1602 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 12.
I20260709 13:03:38.013619  1531 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:38.014325  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.015265  1602 raft_consensus.cc:2393] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:38.018184  1530 pending_rounds.cc:85] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:03:38.018244  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.019394  1602 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:38.018723  1530 pending_rounds.cc:107] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:03:37.977773  6820 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.010882  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.019898  1530 raft_consensus.cc:2889] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.025789  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.027592  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.976722  6708 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.026397  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.032366  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.031039  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:37.989228  6937 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:38.005349  6941 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.033562  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.036897  6032 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.004861  6969 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.039814  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.040130  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.041149  6562 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:38.042531  6783 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:38.043081  6783 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.043551  6783 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.048631  6969 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.049290  1647 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.051077  6969 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.052099  6938 raft_consensus.cc:2804] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:38.052945  6938 raft_consensus.cc:697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:38.036183  6708 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.054170  6938 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.055614  6708 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.060065  1531 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:38.060092  6747 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:38.062081  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.063851  6809 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:38.066807  6743 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.068976  6743 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:38.066095  6929 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.065811  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.070091  6931 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:38.060158  6825 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:38.076789  1531 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:38.080843  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.082010  1602 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:38.024456  6901 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.088336  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.027462  6820 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:38.097136  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.097664  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.093367  6032 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.098835  6032 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.100840  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.102125  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.103072  1679 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:38.104207  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.105072  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.112847  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.113689  1677 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:38.034051  6801 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:38.036159  6658 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:38.038388  6817 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.155547  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.157828  1679 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:03:38.159387  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.161175  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.161357  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.162956  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.163882  1602 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:38.076112  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:38.166105  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90102us
I20260709 13:03:38.173763  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.024456  6973 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:03:38.175221  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.176783  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.074041  6883 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:38.164825  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.174443  1610 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:38.180321  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.192257  1676 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:38.077014  6931 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.077175  6672 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:38.175393  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:38.178227  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.032634  6778 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:03:38.191016  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.203931  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.204856  1678 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:38.205938  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.206697  1678 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:38.207464  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.197247  1677 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:38.087265  6825 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.201377  6032 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.209322  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.140771  6801 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.037784  6968 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:03:38.218127  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.216666  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.210492  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.174049  6658 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.116479  6979 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.085469  6927 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:03:38.199100  6883 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.216602  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.215328  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.181162  6743 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.172652  6902 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.190048  6797 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:38.178380  6684 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.238587  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.240836  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.241890  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:38.242362  6032 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:38.198014  6931 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.203765  6854 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.178668  6861 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:03:38.140981  6901 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.181579  6875 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:03:38.211485  6825 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:38.275523  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60326.4us
I20260709 13:03:38.306427  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.218541  6801 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.211438  6983 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:38.301577  6032 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.309934  6032 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:38.310134  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.150091  6980 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
W20260709 13:03:38.301017  6960 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:38.311731  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.254528  6658 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.273499  6938 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:38.319655  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.331843  1602 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
W20260709 13:03:38.320503  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 153597us
I20260709 13:03:38.333946  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.275208  6797 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.322654  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.273360  6883 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.300726  6879 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.335577  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.253113  6863 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:03:38.302192  6708 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:38.341274  6032 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.320019  6964 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.328091  6976 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:38.331979  6924 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:38.306525  6684 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.341689  6797 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.213531  6937 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.345360  6857 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:38.372807  6985 log.cc:927] Time spent T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:03:38.373505  6984 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:38.344537  6349 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:38.306351  6902 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.344513  6983 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.275306  6979 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.331497  6938 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:38.388475  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 47733.2us
I20260709 13:03:38.360224  6976 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.365530  6969 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.347908  6879 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.388639  6857 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.356634  6783 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.388236  6964 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:38.379878  6965 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.435071  6875 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.457612  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 359126us
I20260709 13:03:38.461378  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.465054  1606 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:38.439720  6976 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.477983  1676 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:38.453737  6857 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:38.478030  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 236256us
I20260709 13:03:38.481142  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.456234  6349 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.486841  1533 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:38.488202  1607 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.489655  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.491528  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:38.506605  1606 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
W20260709 13:03:38.499571  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61360.3us
I20260709 13:03:38.466378  6964 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.436903  6940 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.512405  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:37.826386   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:38.480621  6708 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.522529  6988 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:38.438277  6983 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.512852  6964 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.476115  6875 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.542927  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.543807  1533 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:38.485061  6938 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.548202  6502 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.527854  7001 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:38.550935  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 215376us
W20260709 13:03:38.531461  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 96542.5us
I20260709 13:03:38.548692  6938 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.555531  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.507673  6349 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.558261  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.564117  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.548837  6920 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:38.570271  6979 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:38.570780  6995 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:38.571825  6879 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.572847  1682 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:38.560410  6901 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.577255  6898 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.548748  6502 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.579423  6502 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:38.580470  6684 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.552821  6568 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.570468  1532 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:38.554625  7001 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.534202  6708 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.594894  7000 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:38.610548  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.597431  6797 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.601620  6965 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.606016  6897 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.621656  1533 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
W20260709 13:03:38.629238  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46521.3us
I20260709 13:03:38.634799  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.635936  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.636493  1532 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:38.637253  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.638218  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.639389  1532 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:38.640194  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.641193  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.642292  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:38.622210  6850 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
I20260709 13:03:38.644351  7000 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.644591  6980 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:38.645087  6980 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.644877  7000 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.645171  6658 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.645577  6980 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:38.646324  1679 raft_consensus.cc:2368] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20.
I20260709 13:03:38.647233  6658 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:38.648017  7000 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:38.649029  6983 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.649809  6996 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:38.650244  6996 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.650591  6996 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.652001  1528 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:38.660493  6708 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.661375  6783 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:38.661614  6997 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.002s
I20260709 13:03:38.663800  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:38.664242  6929 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.004s
I20260709 13:03:38.664680  1605 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:38.665215  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.665419  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.666004  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:38.666410  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.666621  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.668403  1608 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.672061  1535 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:38.673533  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2005) took 1368 ms. Trace:
I20260709 13:03:38.673863  1535 rpcz_store.cc:276] 0709 13:03:37.304665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.318443 (+ 13778us) service_pool.cc:224] Handling call
0709 13:03:38.673338 (+1354895us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000708d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:38.673444 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110298496}
I20260709 13:03:38.675043  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.678566  6976 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.681252  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.593201  6979 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:38.682758  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:38.679922  1608 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:38.684186  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:38.608385  6920 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:38.622820  6684 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:38.686213  6965 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:38.686592  6902 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.648597  7000 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:38.690667  6658 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:38.620296  7001 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.666031  6797 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.692138  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.701196  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.689960  6875 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.711081  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.712833  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.675508  6857 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.721045  1605 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:38.688376  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:38.680866  6924 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.732578  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:38.731287  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:38.735162  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.735881  1608 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:38.699031  6708 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.698983  6684 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.698655  6965 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.722574  7000 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:38.739907  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 184524us
I20260709 13:03:38.742360  1576 leader_election.cc:400] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20.
I20260709 13:03:38.747078  1576 leader_election.cc:403] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:38.743466  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.747056  1533 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:03:38.756583  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:38.744779  6817 consensus_meta.cc:287] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:03:38.698401  6979 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.734745  6658 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:38.743520  6965 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.743363  6684 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.768006  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.764779  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2400) took 1467 ms. Trace:
I20260709 13:03:38.769477  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.744258  7017 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.746516  7000 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:38.773247  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:38.778342  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.779489  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.782961  7013 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20.
I20260709 13:03:38.785270  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:38.769937  1527 rpcz_store.cc:276] 0709 13:03:37.297002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.297112 (+   110us) service_pool.cc:224] Handling call
0709 13:03:37.312405 (+ 15293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:37.321166 (+  8761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.321214 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:37.335085 (+ 13871us) log.cc:844] Serialized 52 byte log entry
0709 13:03:37.415622 (+ 80537us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:38.676676 (+1261054us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b180045d660. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f469ba713c7 00007f46980839a7 00007f46980930bf 00007f4698093038
0709 13:03:38.676942 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.758874 (+ 81932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.759099 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.759139 (+    40us) raft_consensus.cc:1685] finished
0709 13:03:38.764599 (+  5460us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.764724 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106730,"prepare.queue_time_us":1264359,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":43,"raft.queue_time_us":16992,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6143,"spinlock_wait_cycles":71860480,"thread_start_us":119702,"threads_started":2,"wal-append.queue_time_us":83636,"wal-append.run_cpu_time_us":1908,"wal-append.run_wall_time_us":1008350}
I20260709 13:03:38.747999  6708 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.739284  6924 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.792609  1609 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.759425  6940 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.792428  1684 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:38.789911  6986 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.773494  6797 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:38.813519  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.774042  6349 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.788554  6897 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:38.790046  6999 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:38.824103  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54704us
I20260709 13:03:38.816360  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:38.824944  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.797256  6929 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:38.822497  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 85542.6us
I20260709 13:03:38.828760  1535 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:38.825133  1527 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:38.830129  1576 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:38.836418  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.837066  1533 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.799580  6921 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.840099  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.812369  6976 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.840286  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:38.790973  6920 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.862385  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.865456  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:38.832513  6349 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.824095  6797 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.822976  6897 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.844758  6894 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.867472  1684 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.850344  1609 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 15.
I20260709 13:03:38.823262  6801 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.791285  7017 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.916339  6801 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:38.877324  6897 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:38.876660  6820 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
W20260709 13:03:38.903373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.873179  6931 consensus_meta.cc:287] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.547s	user 0.002s	sys 0.014s
I20260709 13:03:38.922236  1683 raft_consensus.cc:1240] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:38.902208  6836 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:38.865638  6921 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.902403  6999 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.934321  6999 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.910941  6855 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:38.936898  6855 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.940657  1533 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:38.891304  6349 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:38.905797  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2405) took 1069 ms. Trace:
I20260709 13:03:38.932530  1531 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:38.877547  6797 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.942703  1533 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:38.913337  6980 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.944197  1534 rpcz_store.cc:276] 0709 13:03:37.836024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.836209 (+   185us) service_pool.cc:224] Handling call
0709 13:03:37.849552 (+ 13343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.849747 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:38.755078 (+905331us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.905335 (+150257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.905410 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:38.905485 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.905579 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.905725 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845928,"prepare.queue_time_us":839450,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":30790,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7394,"thread_start_us":201352,"threads_started":2,"wal-append.queue_time_us":186664}
I20260709 13:03:38.864002  6658 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.960355  1684 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 15.
I20260709 13:03:38.961391  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.940305  6794 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:38.927927  6931 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.926867  6820 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.932580  6836 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:38.950047  6783 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:38.977676  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:38.991686  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.992643  1679 raft_consensus.cc:2410] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:03:38.994300  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:38.995019  1684 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:39.001271  1680 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:39.002305  1677 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:39.009128  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:03:39.016001  7018 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.016356  6726 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:39.017082  6726 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:39.017486  7010 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:39.018038  6726 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:38.994244  6999 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:38.973001  6794 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.063836  7017 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:38.994014  6783 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.067878  7023 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:03:39.008653  6964 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.077874  7017 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:39.111858  7032 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:39.115446  6979 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:39.087190  6999 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.116496  6999 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.118690  6999 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.121464  6921 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.125795  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:39.130045  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:39.130585  2209 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:39.131580  6980 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.132900  6996 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.133556  6825 consensus_meta.cc:287] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.000s
I20260709 13:03:39.133958  6825 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.136078  1682 raft_consensus.cc:1240] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:39.018072  7010 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.125862  6920 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.153178  6883 consensus_meta.cc:287] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.798s	user 0.005s	sys 0.006s
I20260709 13:03:39.136873  7017 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.165786  6883 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.178763  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:39.186391  7021 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
W20260709 13:03:39.188385  6992 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.703s	user 0.000s	sys 0.003s
I20260709 13:03:39.189188  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2572) took 1005 ms. Trace:
I20260709 13:03:39.189735  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2461) took 1217 ms. Trace:
I20260709 13:03:39.190202  1603 rpcz_store.cc:276] 0709 13:03:37.972314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.993812 (+ 21498us) service_pool.cc:224] Handling call
0709 13:03:37.994095 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.021998 (+ 27903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.022030 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.022480 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.312560 (+290080us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:38.312605 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.312675 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.187765 (+875090us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:39.189451 (+  1686us) raft_consensus.cc:1685] finished
0709 13:03:39.189474 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.189676 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27448,"raft.queue_time_us":27700,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":7171,"spinlock_wait_cycles":8468352,"thread_start_us":224764,"threads_started":1,"wal-append.queue_time_us":409107}
I20260709 13:03:39.197221  7001 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.197916  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2605) took 1242 ms. Trace:
I20260709 13:03:39.198283  7017 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.198333  1607 rpcz_store.cc:276] 0709 13:03:37.955615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.970223 (+ 14608us) service_pool.cc:224] Handling call
0709 13:03:37.990414 (+ 20191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.494626 (+504212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.197698 (+703072us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540007e4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.197858 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144165632}
I20260709 13:03:39.200611  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.201764  6883 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.202493  6965 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.205246  7010 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.205461  6836 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.206467  6783 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.209038  6794 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.209198  6980 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:39.210170  6980 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:39.211119  6980 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:39.211556  6996 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.189558  1677 rpcz_store.cc:276] 0709 13:03:38.183719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.210233 (+ 26514us) service_pool.cc:224] Handling call
0709 13:03:39.188992 (+978759us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400405454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:39.189120 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747992448}
I20260709 13:03:39.214895  1603 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:39.215060  6032 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.205044  6965 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.217758  6980 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.219313  6980 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.199950  7001 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.221753  6797 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.221923  6684 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.170969  7000 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.233592  1605 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:39.234262  1601 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:39.235033  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2562) took 1132 ms. Trace:
I20260709 13:03:39.236132  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.236774  1680 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.224347  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2021) took 1219 ms. Trace:
I20260709 13:03:39.225368  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2577) took 1029 ms. Trace:
I20260709 13:03:39.229571  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.229538  6897 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.230517  1528 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:39.230829  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.247074  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2558) took 1145 ms. Trace:
I20260709 13:03:39.244937  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.240617  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.237478  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.238304  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.256184  1682 rpcz_store.cc:276] 0709 13:03:38.196200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.573647 (+377447us) service_pool.cc:224] Handling call
0709 13:03:38.573929 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.136465 (+562536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.225109 (+ 88644us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54003cb4d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.225311 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292212608}
I20260709 13:03:39.240821  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.235395  1681 rpcz_store.cc:276] 0709 13:03:38.102833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.150308 (+ 47475us) service_pool.cc:224] Handling call
0709 13:03:38.173025 (+ 22717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.239540 (+ 66515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.239585 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.239643 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:38.239692 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.200011 (+960319us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b5400404f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.234866 (+ 34855us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.234980 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152390016}
I20260709 13:03:39.259963  1609 raft_consensus.cc:1275] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:03:39.272091  1678 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:39.272552  1609 pending_rounds.cc:85] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 14
I20260709 13:03:39.272852  1609 pending_rounds.cc:107] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:03:39.273077  1609 raft_consensus.cc:2889] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.270342  1683 rpcz_store.cc:276] 0709 13:03:38.101434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.101546 (+   112us) service_pool.cc:224] Handling call
0709 13:03:38.180734 (+ 79188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.922704 (+741970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.246850 (+324146us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54003cafd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.247018 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704692608}
I20260709 13:03:39.274106  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.261153  1680 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:39.250198  1433 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 11 to 14, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:39.237329  6797 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.266363  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.275665  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.275731  1684 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.276198  1609 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.256999  1535 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:39.270716  1679 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:39.278965  1682 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:39.269624  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.269956  1677 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:39.271028  1676 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:39.285960  1529 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:39.257194  1530 rpcz_store.cc:276] 0709 13:03:38.004658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.013609 (+  8951us) service_pool.cc:224] Handling call
0709 13:03:38.013911 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:38.025698 (+ 11787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.025727 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:38.641251 (+615524us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:38.641866 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 13:03:38.743702 (+101836us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:38.743737 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.743804 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.185793 (+441989us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:39.224104 (+ 38311us) raft_consensus.cc:1685] finished
0709 13:03:39.224125 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.224288 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34097,"raft.queue_time_us":397,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":7450,"spinlock_wait_cycles":20691712,"thread_start_us":100954,"threads_started":1,"wal-append.queue_time_us":260624}
I20260709 13:03:39.294229  6924 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.295166  6857 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.279191  6999 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:39.299080  6999 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:39.186605  6708 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.304020  6854 consensus_queue.cc:1059] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.309993  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.311157  1532 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:39.312242  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.313661  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.325143  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.331558  1530 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:39.168854  6920 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.333889  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64344.2us
I20260709 13:03:39.334584  6032 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:39.334931  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.248929  6855 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.339573  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.341238  1607 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:39.341761  1534 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:39.340157  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54757.8us
I20260709 13:03:39.352906  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.285619  7017 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.369465  1684 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:39.355146  1609 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:39.248908  6684 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.302910  7000 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.372318  6032 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.374648  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.375957  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.376809  1607 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:39.376924  6937 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.377610  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.378700  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.378772  6999 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:39.379487  1607 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:39.383185  6032 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.387270  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.388451  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:39.389737  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.390588  1607 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
W20260709 13:03:39.391157  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47524us
I20260709 13:03:39.392369  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:39.390237  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49215.7us
I20260709 13:03:39.390811  1606 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:39.392318  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:39.397418  6794 consensus_queue.cc:1059] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:39.398330  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:39.398996  6794 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.400277  6986 consensus_queue.cc:1059] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:39.400480  6857 raft_consensus.cc:3055] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:39.401005  6857 raft_consensus.cc:740] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.399417  6794 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.403728  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.394589  1607 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
W20260709 13:03:39.405735  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75197.9us
I20260709 13:03:39.409895  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:39.411376  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.355662  7001 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:39.435873  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.439354  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.357223  6894 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:03:39.401319  6986 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:39.412417  6924 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:39.393101  6838 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:03:39.430819  6994 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.416780  6794 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.389897  6562 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:03:39.373517  7017 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.450770  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.442988  6996 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.413082  6938 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:39.440299  7001 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.457134  6778 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.475694  6994 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:39.454319  6924 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.510128  6924 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.511343  6924 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.512205  6999 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:39.512720  6825 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.512804  6999 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.513764  6820 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.515110  6999 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.490068  6975 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:39.517951  6975 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:39.519032  6975 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.520691  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2616) took 1003 ms. Trace:
I20260709 13:03:39.521076  1605 rpcz_store.cc:276] 0709 13:03:38.517830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.735244 (+217414us) service_pool.cc:224] Handling call
0709 13:03:38.735506 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.233992 (+498486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.520461 (+286469us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400172ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.520638 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144878976}
I20260709 13:03:39.523058  6975 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.529613  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2613) took 1253 ms. Trace:
I20260709 13:03:39.529943  6977 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.530754  6977 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:39.530112  1602 rpcz_store.cc:276] 0709 13:03:38.276695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.332542 (+ 55847us) service_pool.cc:224] Handling call
0709 13:03:38.332828 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.455347 (+122519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.455393 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.455431 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:38.455459 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.529361 (+1073902us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400086954. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:39.529409 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.529547 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281267072}
I20260709 13:03:39.535856  6977 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:39.537263  7004 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:39.537683  7004 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.538434  7004 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.539665  7004 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.546439  7002 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:39.546736  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.546895  7002 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:39.548316  6994 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:39.549487  6994 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.552249  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 157558us
I20260709 13:03:39.552526  6778 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.552978  6778 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.553769  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.555008  6778 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.557308  6939 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:39.547658  7002 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.559329  7002 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.462865  6986 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.552251  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:39.561122  1608 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:39.561373  6986 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.562817  6708 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.563302  6708 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.565249  6708 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.565747  6708 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:39.566166  6743 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:39.566658  6743 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:39.567003  6708 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:39.567417  6708 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.578809  1602 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:03:39.571604  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99499.3us
I20260709 13:03:39.571870  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.580745  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.483497  7001 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.483858  6897 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.568277  6783 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:39.589381  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.590126  1675 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:39.590044  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.412178  6857 consensus_queue.cc:260] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.490224  1606 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:39.492476  6931 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:39.495438  7022 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.638s	user 0.003s	sys 0.003s
I20260709 13:03:39.500514  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:39.506616  7017 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.507845  6920 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.460881  6684 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:39.641758  6684 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.643429  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.631299  6897 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:39.644556  6897 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.645444  6897 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.646273  1675 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.631973  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.467353  6996 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:39.580870  1648 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.582849  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.585124  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.578331  6878 consensus_queue.cc:1048] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:03:39.484593  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:39.655635  1680 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:39.574823  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.567744  6708 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:39.657083  6684 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:39.657291  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 76476.7us
I20260709 13:03:39.658571  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.652988  1682 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:39.589675  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:39.660203  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 85451us
I20260709 13:03:39.661381  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.633473  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.632849  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.662133  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.662956  1531 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:39.631605  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.629755  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.649016  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:39.655663  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.633162  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.665396  1676 raft_consensus.cc:2368] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:39.588884  7051 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.616608  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.666837  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.451300  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:39.667691  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.660236  1679 raft_consensus.cc:2393] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:39.616247  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 115846us
I20260709 13:03:39.669982  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.664259  1683 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:39.723531  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.744562  1675 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:39.719017  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:39.718051  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.754081  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.754745  1675 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:39.755683  1531 raft_consensus.cc:2368] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
I20260709 13:03:39.650952  6980 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.671880  6931 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.760746  6980 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.717947  6658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.077s	sys 0.106s
W20260709 13:03:39.762126  6658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.077s	sys 0.110s
I20260709 13:03:39.591216  6976 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.762938  6976 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.763370  6976 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.693243  7051 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:39.766698  7051 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.591391  6901 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:39.724861  6977 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:39.767676  6901 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:39.768389  6977 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:39.768900  6977 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.654752  6996 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.775192  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.776986  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.779812  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.677907  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.692780  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.569252  6875 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:39.753080  1535 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:39.752497  1678 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:39.633646  6861 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:39.699306  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:39.782063  1528 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:39.785127  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.790268  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.790751  1576 leader_election.cc:400] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:39.791102  1576 leader_election.cc:403] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:39.791749  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.792763  1678 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:39.794015  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.795332  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.672070  6838 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.792812  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.798435  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.799091  1678 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:39.802181  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.806773  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.807519  1675 raft_consensus.cc:2368] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
W20260709 13:03:39.802408  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 124600us
I20260709 13:03:39.808167  6032 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:39.804116  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.809089  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.809695  1531 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:39.676909  6920 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:39.751320  6824 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.004s	sys 0.009s
I20260709 13:03:39.812288  1534 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:39.783844  6875 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.817750  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.814253  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:39.818352  1531 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:39.755144  7003 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:39.797255  6484 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:39.813134  6931 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.819433  6931 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:39.819772  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.820395  6999 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:39.820845  6999 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:39.821194  6999 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.821488  6927 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:39.821882  6927 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:39.822252  6927 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.819343  6484 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:39.819983  6931 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.823422  1535 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
W20260709 13:03:39.819368  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 120199us
I20260709 13:03:39.823699  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.815183  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.764111  6879 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.824748  1526 raft_consensus.cc:2410] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:39.825729  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:39.825839  1683 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:39.826929  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:39.820341  1679 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:39.796895  6861 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.831527  1576 leader_election.cc:400] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
I20260709 13:03:39.804791  7001 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 14. Current term is 15.
I20260709 13:03:39.838438  1576 leader_election.cc:403] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:39.839210  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.804438  6894 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.811376  6838 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:39.846146  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.843899  1676 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:39.860219  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:39.863055  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.567682  6743 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.838403  6797 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.889179  6975 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:39.863776  6783 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:39.839568  6855 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:39.839282  7000 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.842236  6861 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.853524  6838 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.837711  6895 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:03:39.830946  6879 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.899204  7001 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.818060  6875 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.900230  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.864991  6901 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:39.918597  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53110.2us
I20260709 13:03:39.920606  6032 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.921142  6032 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.922185  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.922899  1676 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
W20260709 13:03:39.825366  6824 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.005s	sys 0.009s
I20260709 13:03:39.906113  6855 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.929054  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:39.926685  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103056us
I20260709 13:03:39.853387  6894 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.908322  7000 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:39.912039  6797 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:39.942370  6032 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.948676  1648 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:39.956874  6801 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.963510  6964 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.968416  6349 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:39.993562  6879 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.994340  6879 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.994009  6349 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.994817  6879 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.968976  6484 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:39.970146  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:39.997037  6349 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.945382  6875 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.996671  1433 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 11 to 12, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:40.002180  6708 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:40.005115  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56524.5us
I20260709 13:03:39.976635  7003 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.978796  6976 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:39.981362  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:39.985347  6894 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.947455  6743 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.929883  6941 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.930160  6855 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:39.987061  7054 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:39.935958  7000 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.992686  6797 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:39.975095  6794 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.001s
I20260709 13:03:40.044420  6794 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.047065  6794 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:40.003640  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57288.4us
I20260709 13:03:40.049419  6708 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.050711  6927 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.051366  6976 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.955293  6977 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.053934  6977 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:39.926637  7035 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:03:40.020375  6861 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.055266  7035 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:40.055735  7035 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:40.056329  6861 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.012270  7003 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.056736  7035 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.057886  6980 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.058287  7035 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.005262  6931 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.060078  1527 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:40.028165  6999 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.031435  7017 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.060606  6931 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.060902  7017 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.006947  6975 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:03:40.009126  6562 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:40.061869  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.062917  6562 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:40.063482  6562 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.063012  6879 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:39.963631  6996 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.068642  6996 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.063946  6562 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.069811  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.072773  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.073479  1606 raft_consensus.cc:2393] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:40.074013  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.070434  1605 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:40.080376  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.082635  1604 raft_consensus.cc:2410] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:03:40.086032  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.088220  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.089007  1603 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:40.090013  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.092566  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.095208  1606 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:40.063033  7017 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.096951  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.112905  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.120894  1602 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:40.093827  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:40.137099  1604 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:40.069566  6931 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:03:40.078749  6941 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:40.141180  2209 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:40.152686  7001 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
I20260709 13:03:40.174950  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:40.178583  1603 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:40.159298  6975 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:40.197930  1607 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
W20260709 13:03:40.201128  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 369699us
I20260709 13:03:40.190769  6975 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.217767  6801 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.249352  6801 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:40.252671  7059 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:03:40.254241  7057 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:40.247453  6975 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.251798  6801 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.268700  6562 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:40.277992  6999 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.236608  6927 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.271836  6838 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.293558  6855 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.305253  6999 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.306224  6999 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:40.309157  2237 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:37403 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:37403 timed out after 15.000s (SENT)
I20260709 13:03:40.313879  6975 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.317203  6562 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:40.322724  6857 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.341624  1682 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:40.349490  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:03:40.360247  7049 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.471s	user 0.005s	sys 0.000s
I20260709 13:03:40.361292  7012 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:40.361742  7012 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.336239  6684 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:40.373237  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.373961  1680 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:40.376706  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.361894  6999 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.362855  7012 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.378192  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:40.376833  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 279947us
I20260709 13:03:40.334824  7000 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:40.380062  1678 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:03:40.379747  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.041s
I20260709 13:03:40.382261  1677 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:40.383505  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.384106  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.385035  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:40.387673  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.012s	sys 0.041s
I20260709 13:03:40.384127  1608 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:03:40.388048  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 539725us
I20260709 13:03:40.388958  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:40.387979  1676 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:40.396392  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.397452  1604 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:40.405297  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.406067  1604 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:40.402961  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.408757  1606 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.412907  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:40.385409  6975 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.410122  6938 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.377887  6684 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.431486  1534 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:03:40.434055  1534 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:40.436698  1602 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:40.404903  6502 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:40.441352  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.441730  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.444983  1529 raft_consensus.cc:2368] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:03:40.445003  1530 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:40.445459  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:40.448957  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:40.449103  1531 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:40.450126  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.422161  6854 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:40.449616  1529 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:40.425725  7004 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.460872  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.401813  7003 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.478647  7003 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.460016  1606 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:40.480199  6838 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.435793  6938 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.482996  6938 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.462951  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.463048  6855 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.465407  6684 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.429085  7063 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:40.466168  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.466001  6854 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.435266  7035 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.466936  1529 raft_consensus.cc:2368] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:03:40.470165  6941 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:40.497351  1610 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.497906  1648 leader_election.cc:400] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:03:40.504050  1648 leader_election.cc:403] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:03:40.505915  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 43931.9us
I20260709 13:03:40.506973  1648 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:40.507256  1648 leader_election.cc:403] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.442354  6562 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:03:40.508903  1530 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:40.509948  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.510653  1530 raft_consensus.cc:2368] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19.
I20260709 13:03:40.513803  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:40.523357  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.074s
W20260709 13:03:40.524515  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.074s
W20260709 13:03:40.525247  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 592645us
I20260709 13:03:40.526108  1501 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:40.529064  1648 leader_election.cc:400] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:03:40.529438  1648 leader_election.cc:403] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.453768  6502 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:40.507717  6897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.008s
I20260709 13:03:40.535487  7075 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:40.536049  7075 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:40.536229  7062 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:03:40.536412  7075 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.497396  7004 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.537240  6502 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.538232  7004 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.541361  6824 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:40.542761  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:40.543720  1648 leader_election.cc:400] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19.
I20260709 13:03:40.496949  6977 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:40.544329  1526 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:40.514248  7076 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.541147  6502 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:40.547135  6502 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:40.503314  7035 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.549782  7035 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.499485  7063 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.529260  6783 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.508585  6986 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:40.556118  6824 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:03:40.543995  1648 leader_election.cc:403] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.557444  6824 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.547991  7000 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:40.544139  6927 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:40.562219  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:40.556392  7063 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.574136  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:40.574362  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:40.582594  1526 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:40.576757  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:40.560587  6897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.009s
W20260709 13:03:40.560662  6978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.027s
I20260709 13:03:40.573752  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:40.597612  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 208715us
I20260709 13:03:40.514796  6938 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:03:40.606153  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:40.612493  1529 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:40.608805  7075 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.613642  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.602384  7065 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:40.610780  6684 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.574559  7004 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:40.646442  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.614094  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:40.580574  6854 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.607035  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:40.605724  6978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.001s	sys 0.027s
I20260709 13:03:40.622355  1601 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:40.627355  7076 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:03:40.556322  6986 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.548053  6502 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.602669  6927 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:40.662842  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.663884  1676 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:40.621233  6783 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:40.633466  1602 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:40.643429  1610 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:40.657227  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.658831  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:40.660593  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53649.6us
I20260709 13:03:40.630193  7012 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:40.666282  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.633466  7075 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:40.668660  6502 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.670476  6978 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:40.670717  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:40.653385  6901 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.677575  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.688562  1610 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:40.691457  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:40.678727  1684 raft_consensus.cc:2368] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:40.679378  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:40.694212  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:40.667465  6986 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.644757  7004 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.682031  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.704968  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.675560  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.708109  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.683072  1683 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.621919  7063 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:40.684281  1531 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.686436  6927 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.664788  6854 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:40.695629  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:40.702913  7004 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.652921  6684 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:40.722703  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.700116  6920 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:40.701409  6855 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:40.739346  1683 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:40.701750  1610 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:40.671857  7000 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:40.715013  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.740829  1602 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.719452  7064 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:40.717237  2209 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 18: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:03:40.718587  1574 leader_election.cc:400] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19.
I20260709 13:03:40.699714  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.680194  7001 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:40.687680  6978 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:40.699708  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.719633  7066 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:40.731539  1531 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:40.717643  6980 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:40.716540  1601 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 20: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:40.720909  7063 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:40.742252  7075 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:40.732414  6854 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:40.747516  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.749325  1603 raft_consensus.cc:2368] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:40.764945  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.765507  1603 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.751446  7066 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.733855  6999 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:40.704407  6901 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.684288  7065 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:03:40.770416  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 156409us
I20260709 13:03:40.754482  6980 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.755174  6879 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.756985  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.772645  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.773595  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.742580  7000 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:40.763022  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.724640  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:40.780021  1603 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:40.780885  1602 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:40.784152  1601 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:40.783504  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:40.784746  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60192.1us
I20260709 13:03:40.785717  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.786401  1576 leader_election.cc:400] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:40.789026  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:40.789088  1576 leader_election.cc:403] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.789258  1603 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.790251  1601 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.752213  7001 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.799062  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.799841  1676 raft_consensus.cc:2368] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:40.757190  6937 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:40.800845  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.802089  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.802892  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.770650  6999 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.803617  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.804528  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.770464  6897 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:40.770819  6684 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:40.808809  1501 leader_election.cc:400] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:40.785162  7000 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.770304  7066 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.782992  6980 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.809695  1676 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:40.827458  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.877712  1683 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:40.827458  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.879405  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:40.808842  1679 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:40.880697  7011 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:40.881163  7011 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:40.882040  7011 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.883338  7011 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.848385  1501 leader_election.cc:403] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.888208  7068 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:40.852962  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:40.856170  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:40.855618  6897 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.894639  6897 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.895836  6897 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.896618  6854 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.903898  6901 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.905448  7017 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:40.906756  7001 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:40.912302  6797 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:40.912987  6797 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.923969  1603 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:03:40.924710  1603 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 6
I20260709 13:03:40.925073  1603 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:03:40.925467  1603 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.932413  1610 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:40.935202  6980 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.788880  6931 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:40.867785  7081 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:40.945003  7064 raft_consensus.cc:2764] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:03:40.946239  7086 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:40.855530  7063 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.947528  7000 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.787660  6978 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.979331  1601 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:40.849042  6999 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.981151  1607 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:40.819957  7092 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.977761  7012 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.021067  1602 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:40.988507  6931 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:41.028834  6824 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19.
W20260709 13:03:41.029063  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 407446us
I20260709 13:03:41.030222  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:41.032718  6857 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:41.033366  6857 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:41.035709  6857 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:40.993912  1677 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:40.783893  6879 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:40.997339  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:40.997187  6855 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.002233  6797 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.089228  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:41.090133  1677 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:41.091789  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:41.006574  7075 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.076385  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 330186us
I20260709 13:03:41.099599  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:41.033375  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:40.968911  1680 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
W20260709 13:03:41.101140  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67887us
I20260709 13:03:41.102363  1530 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:41.102814  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:41.103555  1681 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:41.104321  1675 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:41.097070  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:41.093628  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:41.105434  1681 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:03:41.106523  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 320232us
I20260709 13:03:41.105585  1677 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:41.107328  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:41.108122  7094 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:41.108672  7094 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:41.109620  1681 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:03:41.111914  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 326052us
I20260709 13:03:41.113442  6684 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:41.114017  6684 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.116216  6684 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:41.126418  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 320590us
I20260709 13:03:41.003827  7053 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:03:41.130144  1498 leader_election.cc:400] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:41.130020  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.129366  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:41.151822  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:41.152666  1603 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ab72f324d545a6b4ecb1025df1f7c0 in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:41.153264  1647 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:41.154446  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:41.150375  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:41.086447  6857 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:41.156738  1647 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:40.945040  7066 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.163784  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:41.160868  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.148669  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:41.128873  6994 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.150660  6824 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:41.153949  7065 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.187999  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:41.187127  6854 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:41.185045  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.158195  6977 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:41.192144  1605 raft_consensus.cc:2368] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:41.163110  7001 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:41.141830  6855 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.144095  7075 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.179445  6897 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16.
I20260709 13:03:41.181869  7051 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.180311  7099 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:41.185276  6562 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:41.205286  1574 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.183868  7107 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:41.185519  6824 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:41.167186  7017 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:41.192070  6994 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.215972  6978 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:41.218245  6901 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:41.246889  6901 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:41.247750  6901 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.196382  6977 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.250815  6977 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:41.254263  7075 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.186164  6809 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 13:03:41.240908  7090 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:03:41.206243  7001 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:41.247828  7004 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.002s
I20260709 13:03:41.241873  7000 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.242533  7017 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:41.243508  6855 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.244134  7099 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:41.229272  6980 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:41.206983  7088 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:41.198688  7102 raft_consensus.cc:2764] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:03:41.289517  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.019811  7092 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.173362  6931 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:41.246447  6994 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.237572  6824 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:41.307548  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119598us
I20260709 13:03:41.322873  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.237241  6562 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:41.109570  7094 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.309717  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 128972us
I20260709 13:03:41.209681  6502 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:03:41.313349  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131999us
I20260709 13:03:41.301604  6861 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:41.290812  7001 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:41.323349  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:41.304589  6838 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.302883  7091 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:41.326602  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 122783us
I20260709 13:03:41.327117  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:41.360864  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:41.361873  1529 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:03:41.310269  7017 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:41.301287  7004 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.375305  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 52025.5us
I20260709 13:03:41.365854  6975 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.387099  1647 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:41.363483  7111 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:41.442080  1528 raft_consensus.cc:606] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:41.442027  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 115030us
I20260709 13:03:41.429590  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2651) took 1344 ms. Trace:
I20260709 13:03:41.404922  7101 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:41.362587  6854 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:41.459429  1609 rpcz_store.cc:276] 0709 13:03:40.085399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.086858 (+  1459us) service_pool.cc:224] Handling call
0709 13:03:40.087264 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.087695 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:40.592107 (+504412us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.782341 (+190234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.783369 (+  1028us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.783502 (+   133us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:40.783545 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.783834 (+   289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.429324 (+645490us) raft_consensus.cc:1685] finished
0709 13:03:41.429354 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.429510 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64008,"prepare.queue_time_us":69196,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":12853,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":28158,"spinlock_wait_cycles":1467776,"thread_start_us":623192,"threads_started":2,"wal-append.queue_time_us":450686}
I20260709 13:03:41.390380  7075 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.357590  7102 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:41.441149  7097 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:03:41.464907  1533 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:41.405707  6879 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.477789  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:41.478838  2211 raft_consensus.cc:2368] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
W20260709 13:03:41.461898  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66493.6us
I20260709 13:03:41.330104  6855 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.373845  7001 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.390141  6783 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.390285  6937 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.400887  7118 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:41.449107  7096 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.386152  6861 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:41.395684  6994 consensus_queue.cc:1059] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:03:41.499408  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:41.889716  1603 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:41.501458  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:41.458352  7066 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.479274  7075 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.513089  6854 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.864233  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:41.465533  7101 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:41.466003  6980 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:41.860971  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.863786  7000 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.897781  7000 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.862514  6879 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.468230  6977 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.862706  6783 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.900327  6879 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.901674  6977 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.901888  6783 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.858084  6937 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.902349  6977 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.780609  7098 log.cc:927] Time spent T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.383s	user 0.000s	sys 0.000s
I20260709 13:03:41.868705  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2663) took 1474 ms. Trace:
I20260709 13:03:41.457787  7017 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.402868  7099 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.581920  7122 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:41.441891  6562 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.503266  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:41.861804  7001 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.475095  7103 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:41.858485  7116 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.388s	user 0.002s	sys 0.019s
I20260709 13:03:41.871976  7092 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.460652  7112 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:41.875743  7011 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:41.860191  7004 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.470824  6975 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.932704  7091 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:41.932986  6975 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.897120  6743 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.933422  7110 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.933634  6743 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.933934  7110 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.889520  6855 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:41.907207  1604 rpcz_store.cc:276] 0709 13:03:40.393868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.406706 (+ 12838us) service_pool.cc:224] Handling call
0709 13:03:40.428018 (+ 21312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.599206 (+171188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.599234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.606585 (+  7351us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.905087 (+298502us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4800240258. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469cfa2aa1 00007f469cf99b37 00007f469cf999ca 00007f469d09126f 00007f469d090f37 00007f469d0a555c 00007f469d0a5508 00007f469d0a5488 00007f469d0a5443 00007f469d0a46ec 00007f469bfcea96
0709 13:03:41.388662 (+483575us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b1800200260. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1 00007f4698034a0f
0709 13:03:41.458312 (+ 69650us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:41.458352 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.458415 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.868495 (+410080us) raft_consensus.cc:1685] finished
0709 13:03:41.868517 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.868631 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170837,"raft.queue_time_us":178519,"raft.run_cpu_time_us":2932,"raft.run_wall_time_us":294658,"spinlock_wait_cycles":13742208,"thread_start_us":69348,"threads_started":1,"wal-append.queue_time_us":1257222}
I20260709 13:03:41.905046  7096 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.922593  1609 raft_consensus.cc:1240] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:41.935007  6855 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.936636  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.935776  7096 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:41.903223  1610 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:41.937186  6855 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.939599  7118 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:41.940128  7096 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:41.925042  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2480) took 1288 ms. Trace:
I20260709 13:03:41.940572  7118 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.941339  1527 rpcz_store.cc:276] 0709 13:03:40.637083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.859996 (+222913us) service_pool.cc:224] Handling call
0709 13:03:40.860360 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.127395 (+267035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.127452 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.128298 (+   846us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.305136 (+176838us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:41.305174 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.305239 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.924844 (+619605us) raft_consensus.cc:1685] finished
0709 13:03:41.924861 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.924985 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34918,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":382653,"threads_started":2,"wal-append.queue_time_us":259909}
I20260709 13:03:41.912097  6977 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:41.910509  6980 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.926977  6861 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.928640  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2601) took 1129 ms. Trace:
I20260709 13:03:41.929433  7001 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.934166  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:41.964882  1528 raft_consensus.cc:606] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:41.925668  6937 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.935837  6743 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.965267  1528 raft_consensus.cc:614] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:41.925616  7011 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.928692  6978 consensus_meta.cc:287] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.000s
I20260709 13:03:41.960986  1682 rpcz_store.cc:276] 0709 13:03:40.798980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.801228 (+  2248us) service_pool.cc:224] Handling call
0709 13:03:40.801519 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.178485 (+376966us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:41.178533 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.179135 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.303214 (+124079us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:41.303265 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.303345 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.928423 (+625078us) raft_consensus.cc:1685] finished
0709 13:03:41.928447 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.928581 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36094,"raft.queue_time_us":74505,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":449071,"threads_started":2,"wal-append.queue_time_us":204477}
I20260709 13:03:41.943121  7075 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.935871  7110 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.948714  7112 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:41.975504  7125 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:41.978381  7125 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.980639  7125 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.983836  7011 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:41.990314  6980 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:41.967207  6927 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.991595  6927 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:41.993616  7089 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.820s	user 0.005s	sys 0.006s
I20260709 13:03:41.993865  6927 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:41.994406  6999 consensus_meta.cc:287] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.975s	user 0.006s	sys 0.005s
I20260709 13:03:41.994792  6999 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.994881  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2681) took 1277 ms. Trace:
I20260709 13:03:41.997061  1602 rpcz_store.cc:276] 0709 13:03:40.717673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.783232 (+ 65559us) service_pool.cc:224] Handling call
0709 13:03:41.994713 (+1211481us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400100c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:41.994814 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542739840}
I20260709 13:03:42.004513  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2659) took 1612 ms. Trace:
I20260709 13:03:42.004935  1608 rpcz_store.cc:276] 0709 13:03:40.391691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.391856 (+   165us) service_pool.cc:224] Handling call
0709 13:03:40.392224 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.597434 (+205210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.597479 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.598046 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.800519 (+202473us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:40.800565 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.800638 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.993068 (+1192430us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:41.996550 (+  3482us) raft_consensus.cc:1685] finished
0709 13:03:41.996575 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.004443 (+  7868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204725,"raft.queue_time_us":210310,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4365,"spinlock_wait_cycles":10096000,"thread_start_us":201748,"threads_started":1,"wal-append.queue_time_us":502197}
I20260709 13:03:41.920349  7103 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.007640  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db0d135af1343458208be9b79d66635"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:42.009043  1528 raft_consensus.cc:606] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.009624  1528 raft_consensus.cc:614] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:41.941984  7091 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:41.943926  7101 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.015520  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.016219  1682 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:42.014549  6975 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.017426  6975 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.019706  6975 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.014804  6978 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.022827  6978 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.023048  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:42.023721  1528 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.024305  1528 raft_consensus.cc:614] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.024645  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2608) took 1218 ms. Trace:
I20260709 13:03:41.995958  6857 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.024979  6978 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.025516  6857 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.022558  6999 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.025002  1675 rpcz_store.cc:276] 0709 13:03:40.805919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.806077 (+   158us) service_pool.cc:224] Handling call
0709 13:03:42.024486 (+1218409us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400034b54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:42.024588 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339636480}
I20260709 13:03:42.023633  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56314 (request call id 310) took 1411 ms. Trace:
I20260709 13:03:42.028344  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.028179  1606 rpcz_store.cc:276] 0709 13:03:40.612242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.612700 (+   458us) service_pool.cc:224] Handling call
0709 13:03:40.613096 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.002718 (+389622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.002753 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.003223 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.228509 (+225286us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:41.363294 (+134785us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.363541 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.023012 (+659471us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540024a254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:42.023085 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.023154 (+    69us) raft_consensus.cc:1685] finished
0709 13:03:42.023368 (+   214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.023549 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159371,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":13445,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":10255,"spinlock_wait_cycles":302862080,"thread_start_us":616054,"threads_started":3,"wal-append.queue_time_us":307742}
I20260709 13:03:42.033281  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.033963  1676 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:42.033208  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.034854  1682 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:42.035455  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.036499  1683 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:42.036319  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.037904  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.038244  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.038383  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.038689  1678 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21.
I20260709 13:03:42.039176  1679 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.042819  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.042963  7103 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.044509  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.048825  7102 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.058315  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.060118  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:42.050055  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.051061  7126 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:03:42.052241  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2682) took 1317 ms (client timeout 1647 ms). Trace:
W20260709 13:03:42.065284  1607 rpcz_store.cc:269] 0709 13:03:40.734433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.747184 (+ 12751us) service_pool.cc:224] Handling call
0709 13:03:42.052020 (+1304836us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400085554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:42.052182 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498166656}
I20260709 13:03:42.053493  7107 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.066663  6824 consensus_meta.cc:287] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 13:03:42.066478  7107 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.067035  6824 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.068322  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.068627  7107 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.069247  1676 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:42.053961  7092 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.070152  7092 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.072458  7092 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.054394  7004 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.047771  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 606468us
I20260709 13:03:42.056474  1684 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:42.057452  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.073844  1682 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.058159  7112 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.062105  7117 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.062474  7095 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:42.105172  7091 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.105288  7095 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.105947  7095 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:42.105918  7091 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.062740  7114 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.107100  7114 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.108444  7091 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.109295  7114 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.109414  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.061295  7102 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.110168  1528 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:42.111389  1528 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:42.111891  7102 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.063243  6986 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.063685  1576 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21.
I20260709 13:03:42.113054  1576 leader_election.cc:403] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:03:42.113559  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50071us
W20260709 13:03:42.114073  7140 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:42.115305  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.061080  7063 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.116286  7063 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.116619  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.062028  7103 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:42.075054  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.076582  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2482) took 1404 ms. Trace:
I20260709 13:03:42.123560  1607 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:42.120390  1682 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:42.115346  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.124917  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.102401  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.123467  1529 rpcz_store.cc:276] 0709 13:03:40.671961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.914588 (+242627us) service_pool.cc:224] Handling call
0709 13:03:40.915063 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.440582 (+525519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.076348 (+635766us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400209c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:42.076529 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026756480}
I20260709 13:03:42.125151  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.125649  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.126051  1601 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:42.128288  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.127871  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.128834  1603 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:42.112579  6986 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.134754  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.073148  7004 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.120805  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.133011  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.134883  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.135618  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.136301  1602 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:42.145628  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:42.161849  1526 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:42.122578  7092 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.169905  7092 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.171221  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.161890  1527 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:42.125627  7103 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.174723  7103 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.133500  7017 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.177560  7017 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.177992  7017 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.137816  6980 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:42.179188  6980 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:42.180475  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:42.122424  6999 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:42.181694  7100 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.182258  7100 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.137138  7001 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.167061  7118 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.184325  7001 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.184435  7118 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.185039  7138 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.185691  7138 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.186676  7001 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.187004  7118 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.136958  6801 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.167445  7063 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.187635  6801 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.188683  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.189069  7092 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.189635  6801 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.190542  6927 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.190989  6927 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.191077  6801 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:42.191466  6927 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.160575  6861 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:42.192497  6861 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.193539  6986 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.164119  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.194489  6861 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.194629  1534 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:42.168073  6977 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:42.173898  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.173803  7150 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:42.163439  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.195850  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.175593  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.162210  1606 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.180267  6980 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.176136  7102 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.201782  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.171967  1602 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:42.198292  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.202867  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:42.202162  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 81489.9us
I20260709 13:03:42.204252  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.204815  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.205842  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.206486  1606 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:42.207365  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.205406  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.212255  1530 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:42.212762  1526 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:42.213121  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.150321  7144 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.222535  1528 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:42.222848  7144 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.224567  7101 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:42.224943  7144 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.214358  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.227186  7144 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:42.227833  7144 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:42.228725  7144 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.229588  7017 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.232010  7017 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.213656  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.214074  1534 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.232800  1530 raft_consensus.cc:2368] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21.
I20260709 13:03:42.214227  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.234215  1608 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:42.184739  7100 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.167486  6854 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.235019  6994 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:42.235502  6994 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:42.235992  6994 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.235536  6854 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.238440  6854 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.218024  6824 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.122958  7117 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.217784  7004 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.232945  7063 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:42.240854  7117 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:42.221542  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.232838  1526 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:42.187943  7138 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.208367  7102 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.215528  6978 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.242406  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.251641  1527 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:42.242462  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68647.6us
I20260709 13:03:42.243397  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.214291  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.253003  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.244274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.249934  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:42.253813  1682 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.254288  1574 leader_election.cc:400] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:42.254961  1526 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:42.256659  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.256987  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.257903  1606 raft_consensus.cc:2410] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:03:42.255206  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.258642  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:42.259212  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.259394  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.248580  7114 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.264895  1498 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.260987  1602 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:03:42.258579  7117 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.266566  7117 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.266927  7117 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.267704  6879 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.268456  6861 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.268837  6861 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.262578  7004 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:42.269214  6861 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.269353  7004 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.269800  7004 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.253232  6978 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:42.262022  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.253508  6941 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.285154  6941 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.286324  7102 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.286701  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2508) took 1637 ms. Trace:
I20260709 13:03:42.287176  6941 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.287068  1605 rpcz_store.cc:276] 0709 13:03:40.649238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.879100 (+229862us) service_pool.cc:224] Handling call
0709 13:03:42.286533 (+1407433us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400248454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:42.286647 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717184896}
I20260709 13:03:42.258322  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.263998  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.289270  1605 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:42.290737  7150 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:42.291595  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.265849  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.264578  7063 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:42.293799  7092 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:42.257230  7118 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.294166  7092 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.294339  7118 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.294627  7092 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:42.294837  7118 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.265298  7114 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.297574  7114 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.298424  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.299127  1529 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.271193  6854 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:03:42.280648  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2474) took 1721 ms (client timeout 2233 ms). Trace:
W20260709 13:03:42.302338  1533 rpcz_store.cc:269] 0709 13:03:40.559441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.560846 (+  1405us) service_pool.cc:224] Handling call
0709 13:03:42.280458 (+1719612us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54000708d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:42.280590 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002067840}
I20260709 13:03:42.303646  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.304464  1533 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:42.305194  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.306228  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.264360  6857 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:42.284142  1647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:33801 timed out after 1.647s (SENT) [suppressed 19 similar messages]
I20260709 13:03:42.310417  6857 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.284710  6978 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.289319  7105 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:42.292843  6797 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:42.312837  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.339123  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73346.9us
I20260709 13:03:42.254113  7091 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:03:42.279771  6994 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.310938  6857 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.362203  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:42.278499  7004 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.356861  6861 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.373673  6854 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.375938  6854 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.378046  6854 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.379529  7102 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:42.379643  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:42.345288  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.368870  1533 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:42.382616  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:42.383791  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 90889.8us
I20260709 13:03:42.389173  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:42.394162  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:42.353634  6797 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.397401  1679 raft_consensus.cc:2410] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:42.398152  1574 leader_election.cc:400] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21.
I20260709 13:03:42.400949  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:42.403478  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.408573  1527 raft_consensus.cc:2393] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 18: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:42.420377  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.413250  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.422835  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.422928  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:42.392558  6854 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:42.392577  7102 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:42.370842  7103 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.416455  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.398789  6879 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:42.405993  6797 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.436050  6032 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:42.441174  7095 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.502453  7095 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.444437  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.503484  1678 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:42.504576  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.506112  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.506857  1678 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:42.453824  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.406332  7064 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.429163  7096 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.469478  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:42.549019  6032 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:42.550001  1605 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:03:42.421214  7017 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.556303  7017 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.558564  7017 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.559460  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.560927  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.484448  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.406643  7138 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:42.488186  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.563015  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:42.433027  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.489790  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.563882  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.491266  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.504484  6684 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.492300  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.493645  1529 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:42.496206  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.497056  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2683) took 1002 ms. Trace:
I20260709 13:03:42.499579  6901 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.499339  7092 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.510097  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.507822  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.512609  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.581545  1534 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:42.582769  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.528863  1607 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:42.458746  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:42.534590  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 250437us
I20260709 13:03:42.462543  7000 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.549611  6032 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:42.585340  1535 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:42.478606  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.553968  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.451731  6927 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.565276  1677 raft_consensus.cc:2393] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.491343  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.571982  1681 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:42.572798  1609 rpcz_store.cc:276] 0709 13:03:41.494866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.508863 (+ 13997us) service_pool.cc:224] Handling call
0709 13:03:41.863363 (+354500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.935405 (+ 72042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.496836 (+561431us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54003098d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:42.497001 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135766912}
I20260709 13:03:42.573231  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.554214  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.587936  1678 raft_consensus.cc:2393] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 13: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.583611  1534 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:42.598094  1529 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:42.597049  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.602530  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:42.611266  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.603722  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.548146  7096 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.617964  7096 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.625706  7103 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.570865  7091 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.627051  7091 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.644929  1610 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:03:42.645380  1610 pending_rounds.cc:85] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 9
I20260709 13:03:42.645614  1610 pending_rounds.cc:107] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:42.645838  1610 raft_consensus.cc:2889] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.646620  6978 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.648113  7095 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.648773  7095 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.651849  6927 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.651628  7118 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.549213  7064 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.654338  7114 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.544453  6857 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.658839  1526 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.660331  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.623878  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.661254  1609 raft_consensus.cc:2410] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:42.670220  1683 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:42.661296  1603 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
W20260709 13:03:42.672880  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 194346us
I20260709 13:03:42.673679  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.674496  1603 raft_consensus.cc:2410] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:42.675264  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:42.675463  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.676687  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:42.676864  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60610.2us
I20260709 13:03:42.675850  1603 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:42.678341  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:42.685580  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:42.689107  1681 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:42.692092  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.587848  6684 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.696316  2211 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:42.692991  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:42.697353  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:42.680012  6941 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.700356  7004 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.700278  6941 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.701056  7064 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.702692  6941 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.703001  1647 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:42.703374  6941 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:42.702746  7105 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:42.705717  7100 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:42.680197  6996 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:42.707561  6996 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.707973  6996 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.709617  7144 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.710137  7144 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.711665  1605 raft_consensus.cc:1240] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:42.681599  6999 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21.
I20260709 13:03:42.691531  7117 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.712571  7144 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.703667  6978 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.716178  6783 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:42.717260  6783 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:42.679785  7125 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.750623  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:42.753935  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.755577  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.756374  1678 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.756932  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:42.759181  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:42.759968  1675 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:42.811157  1681 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
W20260709 13:03:42.815833  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53863.8us
I20260709 13:03:42.817744  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:03:42.736789  7157 log.cc:927] Time spent T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:42.823052  6978 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:42.821419  6977 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.748723  6502 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:42.824770  6502 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.824608  6977 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.825172  6502 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:42.826035  6861 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.826875  6977 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.813059  7125 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.816146  6797 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.714509  7117 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.823665  6783 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.805640  6901 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.816488  6999 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.830539  7000 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.703819  6941 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.867314  1606 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:42.829324  6980 consensus_queue.cc:1059] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:42.837037  6999 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:42.829203  7096 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.847838  7000 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:42.874075  6941 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.839149  6901 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:42.885855  6999 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.889436  7125 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.891242  7000 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.851816  1678 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:42.978837  6684 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:42.994120  6797 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.021235  7096 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.022683  6901 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.035066  6502 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.052968  6502 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:42.677002  1526 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:43.125022  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.217829  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.218791  1533 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:43.142774  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.067s	sys 0.097s
W20260709 13:03:43.220271  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.067s	sys 0.097s
W20260709 13:03:43.143621  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 321162us
I20260709 13:03:43.155427  1603 raft_consensus.cc:2410] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:43.180867  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.182713  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.185030  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.186882  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.226008  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.226825  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.188601  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.192845  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.194964  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.195924  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.227705  1680 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:43.227965  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.235073  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.229609  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.237363  1677 raft_consensus.cc:2368] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15.
I20260709 13:03:43.239497  1677 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:43.236574  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.231949  1675 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:03:43.206952  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.076380  6999 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.284933  7118 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.286124  6999 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.047258  7000 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.235939  1605 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:43.229406  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.231626  1681 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:43.071254  6941 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.233093  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.271544  1678 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 13.
I20260709 13:03:43.273912  6797 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.277529  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.277709  7096 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.278178  7161 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:43.280448  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.286993  6743 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.231287  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:43.289310  6994 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:43.292433  6824 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.337173  7091 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.322183  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.346616  1609 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:43.337682  7161 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.354079  7161 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.296557  6857 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.041025  6996 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.328768  1676 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:43.329746  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.331022  7174 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.332647  1647 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.332499  6797 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.333736  1535 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:43.334372  7096 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.368870  1605 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:43.368702  7174 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.370229  7096 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.335436  6743 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.371279  7174 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:43.373163  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71792.1us
W20260709 13:03:43.337499  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 106545us
I20260709 13:03:43.374398  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.375514  6783 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:43.376475  6783 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:43.376538  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.378288  1576 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.344609  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.339645  6901 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:43.380108  1604 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:43.380585  7162 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.382102  1604 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:43.382010  7162 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.382882  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.383852  1534 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:43.385794  7162 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.343030  6824 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.389842  7114 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.390787  6824 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:43.394011  7106 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.920s	user 0.014s	sys 0.006s
I20260709 13:03:43.380066  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.342494  6941 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:43.327548  1501 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.381026  6901 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:43.397804  6797 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.373246  6743 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:43.340291  7000 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.337908  7095 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:43.400758  7173 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:03:43.400417  6996 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:43.399991  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2521) took 1297 ms. Trace:
I20260709 13:03:43.401372  6941 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.401309  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2479) took 2780 ms. Trace:
I20260709 13:03:43.414032  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.409459  1610 rpcz_store.cc:276] 0709 13:03:42.102605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.104596 (+  1991us) service_pool.cc:224] Handling call
0709 13:03:42.104954 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.646240 (+541286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.399514 (+753274us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54001c7ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:43.399825 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240875776}
I20260709 13:03:43.414894  1532 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:43.416952  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2702) took 1014 ms. Trace:
I20260709 13:03:43.417416  1603 rpcz_store.cc:276] 0709 13:03:42.402216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.678106 (+275890us) service_pool.cc:224] Handling call
0709 13:03:43.416659 (+738553us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540030a2d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:43.416868 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088895872}
W20260709 13:03:43.421749  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 94564.8us
I20260709 13:03:43.411031  1531 rpcz_store.cc:276] 0709 13:03:40.620300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.757420 (+137120us) service_pool.cc:224] Handling call
0709 13:03:40.757779 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:40.758214 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:40.819554 (+ 61340us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.212798 (+393244us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:41.244727 (+ 31929us) log.cc:844] Serialized 52 byte log entry
0709 13:03:41.244867 (+   140us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:41.244899 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.244964 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.473728 (+1228764us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b180045d600. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:43.392969 (+919241us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:43.400884 (+  7915us) raft_consensus.cc:1685] finished
0709 13:03:43.400903 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.401113 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112918,"prepare.queue_time_us":109966,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":138254,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":10514,"spinlock_wait_cycles":123244800,"thread_start_us":308904,"threads_started":2,"wal-append.queue_time_us":434472}
I20260709 13:03:43.411881  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.409857  6901 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:43.442425  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.431686  7095 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:43.446023  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43512us
I20260709 13:03:43.448817  7000 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:43.451532  7000 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:43.452977  7000 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.456945  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2694) took 1056 ms. Trace:
I20260709 13:03:43.457465  1607 rpcz_store.cc:276] 0709 13:03:42.400735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.403282 (+  2547us) service_pool.cc:224] Handling call
0709 13:03:43.456458 (+1053176us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400171bd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:43.456736 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286338944}
I20260709 13:03:43.445490  7162 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:43.461048  7162 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:43.464512  1535 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
W20260709 13:03:43.480620  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81134us
I20260709 13:03:43.474856  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.475057  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.471355  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.463584  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.485412  1601 raft_consensus.cc:2410] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:43.478060  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.462855  7064 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.489478  1676 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.489828  7064 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.493498  1678 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:43.461642  7162 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:43.462936  7113 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:43.500795  1533 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:43.501518  7095 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.501973  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:43.502892  1683 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.503110  1610 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:43.504550  7095 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.437114  6901 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.508759  1603 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:43.510533  1607 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:03:43.512923  7160 log.cc:927] Time spent T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.666s	user 0.005s	sys 0.012s
W20260709 13:03:43.514074  7175 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:03:43.514019  6032 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:43.515811  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2072) took 1345 ms. Trace:
I20260709 13:03:43.517201  1498 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:43.517302  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.518553  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2693) took 1118 ms. Trace:
I20260709 13:03:43.520169  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:43.529394  1679 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:43.521992  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:43.522306  7138 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:43.502085  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.467813  7092 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:43.523154  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 100587us
I20260709 13:03:43.524076  7064 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.529659  1606 rpcz_store.cc:276] 0709 13:03:42.400468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.403299 (+  2831us) service_pool.cc:224] Handling call
0709 13:03:43.518184 (+1114885us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400100c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:43.518373 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659704192}
I20260709 13:03:43.531807  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.528447  1526 rpcz_store.cc:276] 0709 13:03:42.170417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.258116 (+ 87699us) service_pool.cc:224] Handling call
0709 13:03:43.515477 (+1257361us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54002c01d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:43.515632 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852586880}
I20260709 13:03:43.537782  1676 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:43.539211  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.540824  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.543567  1532 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:43.545250  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.546058  1529 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:43.546450  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2083) took 1171 ms. Trace:
I20260709 13:03:43.545277  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.546845  1529 rpcz_store.cc:276] 0709 13:03:42.375116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.536542 (+1161426us) service_pool.cc:224] Handling call
0709 13:03:43.546382 (+  9840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.547290  1532 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:43.547789  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2067) took 1378 ms. Trace:
I20260709 13:03:43.530829  7138 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:43.547976  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.550402  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:43.548290  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:43.548138  1532 rpcz_store.cc:276] 0709 13:03:42.169028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.544932 (+1375904us) service_pool.cc:224] Handling call
0709 13:03:43.547716 (+  2784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.548849  1528 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:43.561070  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80527.1us
I20260709 13:03:43.562264  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.563109  6996 consensus_queue.cc:1059] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:43.564582  6996 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:43.564999  6996 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.565011  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.578043  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2078) took 1204 ms. Trace:
I20260709 13:03:43.578619  1683 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:43.578626  1532 rpcz_store.cc:276] 0709 13:03:42.371589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.564464 (+1192875us) service_pool.cc:224] Handling call
0709 13:03:43.575868 (+ 11404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.566716  6743 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.580425  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.578003  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.580013  6743 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:43.582172  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 65329.8us
I20260709 13:03:43.583057  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.584110  7068 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:43.584553  7177 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:03:43.584892  1602 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:43.586102  1603 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:43.587541  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.579636  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:43.585575  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.589561  1498 leader_election.cc:400] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:43.589613  6801 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:43.590510  6801 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.591423  1610 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:43.592892  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.594277  6783 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:43.594924  6783 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.595187  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2063) took 1429 ms. Trace:
I20260709 13:03:43.595613  1528 rpcz_store.cc:276] 0709 13:03:42.166202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.568515 (+1402313us) service_pool.cc:224] Handling call
0709 13:03:43.595127 (+ 26612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.596635  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:43.597936  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.598783  1535 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:43.599129  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2507) took 1460 ms. Trace:
I20260709 13:03:43.599414  1535 rpcz_store.cc:276] 0709 13:03:42.138832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.568924 (+1430092us) service_pool.cc:224] Handling call
0709 13:03:43.599078 (+ 30154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.589639  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.550252  7138 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.601466  1529 raft_consensus.cc:2376] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20. Re-sending same reply.
I20260709 13:03:43.602078  7138 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:43.577921  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.591991  6801 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.603243  1606 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:43.606369  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.607368  7068 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:43.607777  7064 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:43.602272  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2059) took 1436 ms. Trace:
I20260709 13:03:43.608115  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.608691  7064 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:43.610203  7064 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.600093  6783 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.608525  1529 rpcz_store.cc:276] 0709 13:03:42.165508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.547589 (+1382081us) service_pool.cc:224] Handling call
0709 13:03:43.602203 (+ 54614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.614459  1603 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:43.614722  1606 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:43.566234  6996 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.617919  6996 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.619112  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:43.583874  6743 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:43.609098  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57254 (request call id 2508) took 1444 ms. Trace:
I20260709 13:03:43.622637  1530 rpcz_store.cc:276] 0709 13:03:42.164388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.557467 (+1393079us) service_pool.cc:224] Handling call
0709 13:03:43.609037 (+ 51570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.624271  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.624966  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2504) took 1500 ms. Trace:
I20260709 13:03:43.625101  1602 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:43.625406  1535 rpcz_store.cc:276] 0709 13:03:42.124342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.623897 (+1499555us) service_pool.cc:224] Handling call
0709 13:03:43.624322 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.624584 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.624610 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.624654 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:43.624687 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.624742 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.624878 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.627184  1535 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:43.628194  1528 raft_consensus.cc:606] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.628662  1528 raft_consensus.cc:614] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:43.629519  1531 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:43.594301  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.627842  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2054) took 1463 ms. Trace:
I20260709 13:03:43.638967  1535 rpcz_store.cc:276] 0709 13:03:42.164350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.626582 (+1462232us) service_pool.cc:224] Handling call
0709 13:03:43.626992 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.627609 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.627784 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.641932  1534 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:43.648059  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.649017  1679 raft_consensus.cc:2393] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:43.650889  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.652429  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:43.653654  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.654279  1676 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:43.651006  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:43.658470  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:43.660333  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.663045  1678 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
W20260709 13:03:43.664731  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70647.3us
I20260709 13:03:43.668601  1527 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:43.669661  1602 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:43.651754  7068 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:43.675678  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69431us
I20260709 13:03:43.680385  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2071) took 1508 ms. Trace:
I20260709 13:03:43.646010  7113 consensus_queue.cc:1059] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:03:43.681154  6797 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:03:43.690222  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.690721  1610 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:43.691495  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 30) took 1330 ms. Trace:
I20260709 13:03:43.662212  7118 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.675350  6941 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.691993  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.691849  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.690295  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:43.693185  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2517) took 1411 ms. Trace:
I20260709 13:03:43.692207  1529 raft_consensus.cc:1240] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:43.691897  1528 rpcz_store.cc:276] 0709 13:03:42.355788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.596387 (+1240599us) service_pool.cc:224] Handling call
0709 13:03:43.686328 (+ 89941us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002c01d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698073853 00007f469d04160a 00007f46965c77d4 00007f46965c7762 00007f46965c7691 00007f46965c760c 00007f46965c68c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:43.686485 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71047552}
I20260709 13:03:43.680812  1527 rpcz_store.cc:276] 0709 13:03:42.170162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.651724 (+1481562us) service_pool.cc:224] Handling call
0709 13:03:43.667138 (+ 15414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.672023 (+  4885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.678199 (+  6176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.697633  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.698127  1684 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:43.705842  1534 rpcz_store.cc:276] 0709 13:03:42.281389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.642612 (+1361223us) service_pool.cc:224] Handling call
0709 13:03:43.659434 (+ 16822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.692805 (+ 33371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.692833 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.692893 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:43.692931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.692989 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.693111 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.702898  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.678638  6743 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:43.698705  1679 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:03:43.711376  1679 pending_rounds.cc:85] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 7
I20260709 13:03:43.716152  7004 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.717115  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2515) took 1485 ms. Trace:
I20260709 13:03:43.716955  7004 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.717573  1530 rpcz_store.cc:276] 0709 13:03:42.231682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.680331 (+1448649us) service_pool.cc:224] Handling call
0709 13:03:43.716466 (+ 36135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.716710 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.716746 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.716834 (+    88us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:43.716866 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.716935 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.717047 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.719388  7004 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.719655  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2522) took 1234 ms. Trace:
I20260709 13:03:43.720638  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 314) took 1449 ms. Trace:
I20260709 13:03:43.721765  1683 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:43.723232  1535 rpcz_store.cc:276] 0709 13:03:42.271369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.646940 (+1375571us) service_pool.cc:224] Handling call
0709 13:03:43.653885 (+  6945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.708697 (+ 54812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.708734 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.720346 (+ 11612us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:43.720386 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.720452 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.720561 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.727313  1602 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:43.724103  1530 rpcz_store.cc:276] 0709 13:03:42.485538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.718628 (+1233090us) service_pool.cc:224] Handling call
0709 13:03:43.719060 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.719310 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.719335 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.719397 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:43.719430 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.719477 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.719584 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.728745  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.722563  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2062) took 1543 ms. Trace:
I20260709 13:03:43.735651  1529 rpcz_store.cc:276] 0709 13:03:42.166005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.627548 (+1461543us) service_pool.cc:224] Handling call
0709 13:03:43.665797 (+ 38249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.709225 (+ 43428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.709432 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:43.702332  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 57) took 18442 ms (client timeout 15000 ms). Trace:
I20260709 13:03:43.711606  1679 pending_rounds.cc:107] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:03:43.738534  1679 raft_consensus.cc:2889] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:43.738272  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 59330.5us
I20260709 13:03:43.741083  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.741760  1676 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:43.740196  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:43.729523  6901 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.743665  6901 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.743902  1683 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:43.744021  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.746198  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.745344  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2519) took 1397 ms. Trace:
I20260709 13:03:43.749056  1532 rpcz_store.cc:276] 0709 13:03:42.348153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.677897 (+1329744us) service_pool.cc:224] Handling call
0709 13:03:43.744762 (+ 66865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.745025 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.745048 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.745115 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:43.745143 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.745190 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.745287 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.746330  1528 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:43.722169  6743 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.756361  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2520) took 1316 ms. Trace:
I20260709 13:03:43.751619  7096 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.758723  1675 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:03:43.756896  1533 rpcz_store.cc:276] 0709 13:03:42.439807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.709185 (+1269378us) service_pool.cc:224] Handling call
0709 13:03:43.740130 (+ 30945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.755887 (+ 15757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.755936 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.755999 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:43.756071 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.756154 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.756297 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.760763  1680 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:43.746450  7095 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.766729  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 191896us
I20260709 13:03:43.768399  1528 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:43.776247  1527 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:43.776952  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.777186  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2521) took 1326 ms. Trace:
I20260709 13:03:43.777559  1527 rpcz_store.cc:276] 0709 13:03:42.450927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.712320 (+1261393us) service_pool.cc:224] Handling call
0709 13:03:43.754442 (+ 42122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.776959 (+ 22517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.777135 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.779089  1648 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.779978  6684 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.716138  7118 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.780617  6684 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.782673  7118 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.783227  1529 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:43.783453  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.783658  6684 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.784204  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.776000  6999 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:43.776186  6861 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:43.790215  1530 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:43.792920  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:43.755338  6743 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:43.784255  7096 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.779018  1535 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:43.758829  7103 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.795174  6861 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:43.810456  6861 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.795631  6941 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:43.812376  6941 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:43.800103  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 102632us
I20260709 13:03:43.812776  6941 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.796010  7161 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:43.795818  6783 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:43.825044  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:43.828203  7095 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:43.836587  1533 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:03:43.737706  1433 rpcz_store.cc:269] 0709 13:03:25.259800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.259954 (+   154us) service_pool.cc:224] Handling call
0709 13:03:43.702015 (+18442061us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:40.530296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:40.545054 (+ 14758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:40.545092 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:03:40.545111 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:40.545513 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:40.545600 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:40.545630 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:40.545924 (+   294us) tablet.cc:701] Row locks acquired
0709 13:03:40.545942 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:40.546080 (+   138us) write_op.cc:270] Start()
0709 13:03:40.546188 (+   108us) write_op.cc:276] Timestamp: P: 1783602220546036 usec, L: 0
0709 13:03:40.546208 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:40.546880 (+   672us) log.cc:844] Serialized 981 byte log entry
0709 13:03:41.248729 (+701849us) op_driver.cc:464] REPLICATION: finished
0709 13:03:41.478307 (+229578us) write_op.cc:301] APPLY: starting
0709 13:03:41.488205 (+  9898us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:41.863119 (+374914us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:41.863216 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:41.924672 (+ 61456us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:41.967819 (+ 43147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:03:41.972885 (+  5066us) write_op.cc:312] APPLY: finished
0709 13:03:41.984530 (+ 11645us) log.cc:844] Serialized 32 byte log entry
0709 13:03:41.984709 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:41.984804 (+    95us) write_op.cc:454] Released schema lock
0709 13:03:41.984846 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:41.985227 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:41.985258 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2567514,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":209279,"apply.run_cpu_time_us":14396,"apply.run_wall_time_us":516447,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":493288,"prepare.run_cpu_time_us":36706,"prepare.run_wall_time_us":244140,"raft.queue_time_us":170399,"raft.run_cpu_time_us":10091,"raft.run_wall_time_us":87352,"replication_time_us":702346,"thread_start_us":746510,"threads_started":4,"wal-append.queue_time_us":446180,"wal-append.run_cpu_time_us":15663,"wal-append.run_wall_time_us":1992094}]]}
I20260709 13:03:43.795938  6996 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:43.795128  6999 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.824666  6797 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:43.824548  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.754354  7092 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:03:43.809525   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:43.811929  6861 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.836845  7103 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.836445  1501 leader_election.cc:400] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15.
I20260709 13:03:43.836903  7063 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:43.875594  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.883675  1501 leader_election.cc:403] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:43.854329  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37256 (request call id 315) took 1358 ms. Trace:
I20260709 13:03:43.892932  1534 rpcz_store.cc:276] 0709 13:03:42.485266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.735724 (+1250458us) service_pool.cc:224] Handling call
0709 13:03:43.794065 (+ 58341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.821679 (+ 27614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.821723 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.843665 (+ 21942us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:43.843724 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.843905 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.844096 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:43.843288  7161 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:43.897888  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 181910us
W20260709 13:03:43.898986  7186 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:03:43.905913  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81472.3us
I20260709 13:03:43.865046  6996 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.923240  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.924553   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:43.935906  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 134185us
I20260709 13:03:43.938302  7113 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15.
I20260709 13:03:43.939042  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:43.939244  7113 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:43.939074  6996 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:43.948228  7063 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:43.943078  2211 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:43.921932  7112 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:43.873432  6783 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.878278  6999 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:43.883411  6797 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.957582  6797 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.951390  6901 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:43.958678  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 166216us
I20260709 13:03:43.959205  7112 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.959606  7114 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:43.960525  7112 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.922201  7103 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.949476  7096 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:43.932140  7138 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:43.905792  7161 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:43.964048  6032 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:43.964504  6032 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.965113  6032 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:43.965291  6801 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:43.965920  6801 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:43.966931  6801 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.968576  6684 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:43.968829  7138 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:43.969290  6684 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.969952  7138 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:43.964444  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52559.2us
I20260709 13:03:43.971727  6684 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:43.921517  7178 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
I20260709 13:03:43.977592  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:43.976550  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:43.997416  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 130961us
I20260709 13:03:43.971875  7162 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:43.994278  6994 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:44.007815  1501 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:44.008345  1501 leader_election.cc:403] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:43.996868  7092 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:44.011123  7092 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.018600  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.032883  6854 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:44.033469  6854 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.034610  6854 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:44.036520  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59052.5us
I20260709 13:03:44.037483  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.038982  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:44.036551  6854 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.042349  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.043833  7068 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:44.043885  7063 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:44.047026  1430 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.054773  7161 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.056270  6824 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:44.057148  6824 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:44.057539  6824 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:44.057886  6824 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.061560  6032 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.027427  7092 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.071206  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:44.082631  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 61018.6us
I20260709 13:03:44.087141  6032 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:44.089713  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 296944us
I20260709 13:03:44.091676  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.089748  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.123215  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.031909  6743 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.076794  7063 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.051805  1430 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:44.091426  7114 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:44.127333  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43862.2us
I20260709 13:03:44.027169  6783 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:44.124174  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 143866us
I20260709 13:03:44.139787  1677 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:44.132756  6684 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.147305  6032 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:44.135330  7095 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:44.165925  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.166256  7064 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:44.167217  7064 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:03:44.168355  7192 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:44.169003  7000 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:44.169492  7000 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.170169  7198 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:03:44.170532  7000 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.171144  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.172346  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.172469  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.173673  1675 raft_consensus.cc:2410] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 23 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:03:44.173820  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.175249  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.175477  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:44.176688  1684 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:44.171932  1681 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:44.184545  6032 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.158852  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.144121  6996 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.132647  7103 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:03:44.192495  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.150744  6684 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.137820  7096 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:03:44.157032  6994 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:44.203974  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.204321  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60549.3us
I20260709 13:03:44.167809  7064 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:44.178014  7114 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.199268  1430 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 12, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.214962  7095 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.215570  7095 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.185853  7112 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:03:44.219811  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.171924  7000 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.141359  7063 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.193015  7067 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:44.221961  7067 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:44.222505  7067 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.222945  6996 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:44.224884  7095 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.225625  7063 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.229398  6032 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.232296  7095 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:44.208639  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 148) took 24366 ms (client timeout 15000 ms). Trace:
I20260709 13:03:44.232928  6743 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:44.233259  1429 rpcz_store.cc:269] 0709 13:03:19.708724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.709312 (+   588us) service_pool.cc:224] Handling call
0709 13:03:44.071790 (+24362478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:34.136381 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:34.137064 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:34.137117 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:34.137152 (+    35us) tablet.cc:662] Decoding operations
0709 13:03:34.227465 (+ 90313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:34.227617 (+   152us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:34.227660 (+    43us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:03:34.230075 (+  2415us) tablet.cc:701] Row locks acquired
0709 13:03:34.230145 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:03:34.230387 (+   242us) write_op.cc:270] Start()
0709 13:03:34.230589 (+   202us) write_op.cc:276] Timestamp: P: 1783602214230297 usec, L: 0
0709 13:03:34.230640 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:03:34.334486 (+103846us) log.cc:844] Serialized 8689 byte log entry
0709 13:03:34.803377 (+468891us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4694f6f0ac 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b
0709 13:03:35.175463 (+372086us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698074e28 00007f469baaf581 00007f469baaed58 00007f469bab39f1 00007f469bab39a9 00007f469bab3939 00007f469bab3901 00007f469bab2b2d 000000000038f354 000000000038f199
0709 13:03:35.897689 (+722226us) op_driver.cc:464] REPLICATION: finished
0709 13:03:36.260608 (+362919us) write_op.cc:301] APPLY: starting
0709 13:03:36.298094 (+ 37486us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:36.766601 (+468507us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:36.766651 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:37.114012 (+347361us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:37.114380 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:03:37.114437 (+    57us) write_op.cc:312] APPLY: finished
0709 13:03:37.114912 (+   475us) log.cc:844] Serialized 195 byte log entry
0709 13:03:37.280257 (+165345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.314126 (+ 33869us) write_op.cc:454] Released schema lock
0709 13:03:37.364397 (+ 50271us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:37.415454 (+ 51057us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.417594 (+  2140us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":102408,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":308906,"apply.run_cpu_time_us":40004,"apply.run_wall_time_us":1166533,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96043,"num_ops":22,"prepare.queue_time_us":258482,"prepare.run_cpu_time_us":90395,"prepare.run_wall_time_us":1039330,"raft.queue_time_us":330297,"raft.run_cpu_time_us":21144,"raft.run_wall_time_us":318510,"replication_time_us":1654281,"spinlock_wait_cycles":84793984,"thread_start_us":1204263,"threads_started":5,"wal-append.queue_time_us":896737,"wal-append.run_cpu_time_us":25055,"wal-append.run_wall_time_us":2742163}]]}
I20260709 13:03:44.239780  7064 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.203243  6684 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:44.248803  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 206564us
W20260709 13:03:44.259286  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 93452us
I20260709 13:03:44.255658  1683 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:44.231705  6941 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.250789  7103 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:44.272811  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2510) took 2087 ms. Trace:
I20260709 13:03:44.256233  7162 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.223518  7067 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:44.273428  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 190933us
W20260709 13:03:44.288414  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69016.9us
I20260709 13:03:44.276969  1430 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.275651  1526 rpcz_store.cc:276] 0709 13:03:42.182352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.650356 (+1468004us) service_pool.cc:224] Handling call
0709 13:03:43.705131 (+ 54775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.746290 (+ 41159us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:44.066307 (+320017us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.269096 (+202789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.269148 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:44.269191 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.269255 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.269388 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271787,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2278,"raft.queue_time_us":18370,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":21578,"thread_start_us":435382,"threads_started":3}
I20260709 13:03:44.301687  6941 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:44.273845  7103 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.250144  7095 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.312937  7112 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.313218  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.313557  7112 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.313923  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.314214  1675 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.315459  1683 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:44.316393  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.267697  6901 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:44.288251  7198 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.261241  6999 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.319811  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.320472  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.315841  7112 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:44.306864  7103 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.260695  6801 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:03:44.324694  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.328918  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.329782  1678 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:44.334518  1682 raft_consensus.cc:2368] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:44.276014  7064 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.309278  7162 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:44.335397  1676 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:03:44.347360  7162 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.350194  7162 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.352471  6996 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.354427  6996 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.354676  6999 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.343315  7112 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.355603  6994 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:44.356112  6994 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:44.318118  7199 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.332464  6901 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:44.357751  1681 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:44.378266  1676 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:44.357385  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.362996  1576 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:44.375938  6994 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.356969  1647 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.377296  6901 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.386917  7064 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:44.388240  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45386.7us
I20260709 13:03:44.394088  1679 raft_consensus.cc:1240] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:44.392125  7211 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:44.396181  7138 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:44.398272  7095 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.344760  6797 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.399705  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.401057  6797 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:44.401368  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 269475us
W20260709 13:03:44.402992  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 235528us
I20260709 13:03:44.397991  1430 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 15, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.408594  1678 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:44.332008  6824 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.334793  7114 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.411592  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.413074  6824 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:44.401065  6861 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:03:44.410929  6994 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.410792  6726 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:44.413875  1430 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 13, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.342618  6743 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:44.333921  7198 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.355786  7112 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.420060  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.427906  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.431823  1605 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.406941  7217 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:44.425699  6901 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.440616  7095 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.450139  7095 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.453333  1675 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:44.456825  6824 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:44.458683  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127685us
I20260709 13:03:44.457103  6901 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.450129  1430 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.461090  1430 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:44.463060  7195 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.332s	user 0.000s	sys 0.003s
I20260709 13:03:44.467401  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2514) took 2236 ms. Trace:
I20260709 13:03:44.467906  1531 rpcz_store.cc:276] 0709 13:03:42.230953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.647406 (+1416453us) service_pool.cc:224] Handling call
0709 13:03:43.674347 (+ 26941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.785551 (+111204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.785589 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.840519 (+ 54930us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.978730 (+138211us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:43.978788 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.978886 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.462023 (+483137us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:44.467027 (+  5004us) raft_consensus.cc:1685] finished
0709 13:03:44.467055 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.467329 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25858,"raft.queue_time_us":50526,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":30394,"spinlock_wait_cycles":10455808,"thread_start_us":137657,"threads_started":1,"wal-append.queue_time_us":219651}
I20260709 13:03:44.470841  7210 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:03:44.489488  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.490116  1675 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.420568  7199 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.491495  1430 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:03:44.496294  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 162168us
W20260709 13:03:44.501477  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 108542us
I20260709 13:03:44.516167  7131 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.516954  7131 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:44.521943  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.528422  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62176.5us
I20260709 13:03:44.541102  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.550792  7196 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:44.551437  7196 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.552292  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.552897  7208 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:44.553292  7208 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:44.553444  7198 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.554281  7208 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.555037  1430 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 13, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.557314  1430 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:44.566078  7161 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.550942  1531 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:44.568589  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.569205  1609 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.574757  7112 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:44.574606  7193 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:44.578894  7196 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:44.582968  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.583765  7095 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.585100  7199 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.586447  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.587649  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.588392  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.589395  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.612393  1605 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:44.612941  1601 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.612538  1606 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:44.590870  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.614403  1603 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:03:44.593822  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51750.5us
I20260709 13:03:44.596192  1675 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:44.616452  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.617110  1675 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.559473  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 11 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:44.593107  1607 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:03:44.598232  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.618795  1604 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:44.600709  1647 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:44.601775  1681 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:44.601892  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.620257  1683 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.602376  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.602700  1676 raft_consensus.cc:1240] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:44.603238  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.603700  1682 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:03:44.603902  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.555779  7208 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.613051  1602 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.590085  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.624356  7131 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.628536  7196 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.630326  1601 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:44.639640  1608 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:44.640794  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:44.642279  7092 consensus_meta.cc:287] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.004s
I20260709 13:03:44.642709  7092 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.643494  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.644178  1601 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:44.645020  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.646251  1601 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:44.647522  1601 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:44.648353  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.649528  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.650092  1679 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.656494  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.657691  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.658675  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:44.659504  7199 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:44.646138  1602 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:44.660737  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:44.663125  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.672399  1683 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:44.675271  1609 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:44.686892  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.687438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.688090  1681 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:44.689383  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.690801  6726 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:44.691207  6726 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:44.691569  6726 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.700115  6726 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:44.685910  1430 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 15, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.682065  7199 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:44.719460  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 112640us
W20260709 13:03:44.728269  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127665us
I20260709 13:03:44.729525  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:44.730614  1529 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:44.731845  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.732863  7092 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.734051  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.761989  1681 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:44.762495  1607 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.735536  1601 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:44.687366  6941 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:44.736900  7196 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:44.737668  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.772598  1605 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:44.738340  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:44.738631  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.740428  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.774266  1530 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:03:44.741079  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.741542  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.741693  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.742157  7138 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:44.742403  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.712519  7000 consensus_queue.cc:1059] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:03:44.727833  6824 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:03:44.777807  6901 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:44.777995  7095 raft_consensus.cc:2764] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:44.744292  7103 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.781473  1430 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.782706  7103 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.747876  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.783965  1608 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:44.784464  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.785771  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.749696  6684 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.786957  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.787851  6684 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.718734  1501 leader_election.cc:400] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:44.739823  1534 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:44.788568  1501 leader_election.cc:403] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.755398  1675 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
W20260709 13:03:44.755903  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.705595  7063 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.789317  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:44.790064  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60678.4us
I20260709 13:03:44.790333  1534 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:44.789947  7063 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.791371  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.792172  1534 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:44.761874  1527 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:44.793051  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.792562  7196 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:44.793407  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.794198  1527 raft_consensus.cc:2410] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:44.794472  1534 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:03:44.752676  1679 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:44.743049  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.792667  7063 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:44.796437  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77916.2us
I20260709 13:03:44.798465  7113 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:44.799428  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:44.787966  1610 raft_consensus.cc:2368] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21.
I20260709 13:03:44.799306  7113 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.776124  1532 raft_consensus.cc:2368] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20.
I20260709 13:03:44.714526  6797 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:03:44.776196  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.801035  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.815263  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.813946  1430 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:44.817236  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.795883  7196 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:44.818276  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.825721  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:44.804474  7004 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:44.827148  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.828184  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:44.829022  7198 raft_consensus.cc:3055] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:44.829316  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.829461  7198 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.830148  1675 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:44.813819  7068 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:03:44.832017  7092 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:44.832288  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.832455  7092 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.835505  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.833673  1430 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 8 to 13, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 13 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:44.838209  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:44.838860  1608 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.842839  7208 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:44.823710  7063 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:44.852962  1607 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:03:44.851205  1501 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.855180  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.859084  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.859688  1535 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:44.839821  7196 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:44.862049  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.864997  1531 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.821710  7199 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:44.868069  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:44.848453  7000 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:44.833433  7210 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:44.835783  7113 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:44.882767  6861 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:44.889729  6861 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.890784  6861 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.856065  6726 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:44.892660  7220 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:44.893203  7231 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:44.894915  7215 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.898257  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.899533  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.900161  1532 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:44.874707  1430 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.879974  1501 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.902835  7067 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:44.903368  7067 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:44.906221  1608 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:03:44.907356  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:44.869490  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.883287  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.885073  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.910068  1534 raft_consensus.cc:2410] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:44.886715  6783 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.888357  7000 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.888582  2209 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:44.921543  1501 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.924290  1533 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:44.929770  1530 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:44.930604  1535 raft_consensus.cc:2468] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:44.830590  7198 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.916967  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:44.882514  7196 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:44.950141  7230 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:44.932350  6783 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:44.949115  7000 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:44.961920  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74872us
I20260709 13:03:44.969803  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.974555  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:44.978953  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:44.979905  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.001296  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:44.964010  7004 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:45.005601  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.966686  6996 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:03:44.964185  7138 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.930644  7063 consensus_queue.cc:1059] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:44.936853  6824 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:03:45.013707  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:44.976917  7230 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:44.850451  7131 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 7 to 11, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:45.048810  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:45.020692  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53735us
I20260709 13:03:45.012080  7209 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:45.029523  7138 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:45.031914  7235 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:03:45.032829  7236 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:45.034287  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.038650  1535 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:45.046149  6783 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:45.020128  6941 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:03:44.904883  7067 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.048833  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:45.009547  7210 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.964874  7092 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.067166   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:45.095144  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.062537  7063 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:45.074147  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:45.100108  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.103940  1529 raft_consensus.cc:2376] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20. Re-sending same reply.
I20260709 13:03:45.108608  1531 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:45.055738  7209 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:45.101938  1528 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 7 to 11, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:45.112481  1531 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:03:45.112840  1531 pending_rounds.cc:85] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:03:45.113065  1531 pending_rounds.cc:107] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:03:45.113288  1531 raft_consensus.cc:2889] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.107993  7199 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.114044  7199 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.097539  6684 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:45.116668  7199 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.118546  7138 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.119478  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.089017  6901 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.120333  6901 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.103595  7063 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:45.073372  7210 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:45.132211  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 58121.8us
I20260709 13:03:45.133467  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.134081  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.103943  7095 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.137241  1529 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:45.121042  7209 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.127898  7208 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:45.128379  7210 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:45.147630  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:45.150470  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 185672us
I20260709 13:03:45.132740  7092 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.088590  7196 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.151373  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:45.151834  7208 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.161927  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:45.157917  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.140722  7004 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:45.163619  1648 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:45.170487  1678 raft_consensus.cc:2368] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:45.167065  7208 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.146293  7095 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.198982  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.156709  7215 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:03:45.176168  6854 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.177484  6994 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:45.180088  6743 raft_consensus.cc:2804] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:45.137089  7230 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:45.214253  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:45.202603  7239 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:45.215086  1501 leader_election.cc:400] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:45.223721  1501 leader_election.cc:403] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.222175  1677 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:45.225975  1680 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:03:45.228168  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.230754  1675 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:45.233623  1682 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:45.234428  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:45.231899  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54903.3us
I20260709 13:03:45.236699  1529 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:45.171425  7063 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.221275  6854 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.231968  6994 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:45.262108  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.302367  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.303289  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.305322  1603 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:45.306249  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.256783  7063 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.241552  7247 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:45.318652  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.307962  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.309486  6783 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:45.320892  1609 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:45.321696  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:45.324831  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88903.4us
I20260709 13:03:45.330468  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.333477  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.334376  1602 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.334226  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.335279  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.336344  1605 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:45.339668  1601 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:45.347961  1608 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:45.351678  1609 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:45.360672  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.328753  6783 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:45.283066  7257 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:03:45.376782  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.348294  6743 raft_consensus.cc:697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:45.385983  6743 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.356381  7113 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.374822  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.380065  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:45.350603  7234 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:45.384146  7252 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.384387  6994 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:45.423308  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.261989  7004 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.372737  7250 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.373229  7245 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.430307  1535 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:45.429575  1604 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:45.431713  1602 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:45.433890  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.435703  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:45.426316  7241 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:03:45.436692  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.426015  7247 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.388361  7113 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.460222  7095 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:45.464884  7255 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:03:45.466531  7242 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:03:45.467052  1529 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:45.468065  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.468320  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.469653  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.470695  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.472815  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.473835  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.474828  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.459261  7247 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.475916  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.477262  6901 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.477638  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.477850  7247 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.478740  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.479795  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.480789  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.481807  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.451104  7250 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.485000  7250 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.471827  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.486471  1535 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:45.487020  7208 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.488483  1681 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:45.487365  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.492682  7264 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.493247  7264 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:45.494855  7261 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:45.482303  1527 raft_consensus.cc:2376] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20. Re-sending same reply.
I20260709 13:03:45.495409  7264 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:45.500470  7240 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
I20260709 13:03:45.502305  6854 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.453770  7252 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:45.504454  7258 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:03:45.463845  7249 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:03:45.512578  1529 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
W20260709 13:03:45.520970  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.521760  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.523535  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.527289  1679 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:45.528613  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.531373  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.516925  1675 raft_consensus.cc:2955] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 7 to 11, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:03:45.457072  7114 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.542080  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:45.538167  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:45.534281  7241 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:45.565171  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.565812  1609 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:45.566141  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:45.535032  7195 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:45.568831  1606 raft_consensus.cc:2368] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
W20260709 13:03:45.561422  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51497us
W20260709 13:03:45.561632  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49173.6us
I20260709 13:03:45.576871  1607 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:45.439571  7245 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.579007  1606 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:03:45.583479  1606 pending_rounds.cc:85] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 9
I20260709 13:03:45.582736  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.584177  1605 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:45.581525  1608 raft_consensus.cc:1240] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:45.586169  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:45.587422  1606 pending_rounds.cc:107] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:03:45.570498  7096 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.588934  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.588613  1602 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:45.591639  1606 raft_consensus.cc:2889] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.560370  7114 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.454643  6783 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:45.614428  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.590545  7068 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.624354  7248 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:03:45.624891  7113 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.625444  7095 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:45.585632  6854 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:03:45.588696  7199 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:45.628058  7000 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:45.631115  7114 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.637167  1609 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:45.627389  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.590696  7250 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:03:45.691062  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 102211us
I20260709 13:03:45.694319  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:45.701097  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:45.643335  6861 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:45.724113  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:45.725181  1534 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:45.597956  7096 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.694646  6783 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.739449  1498 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:45.670706  7000 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.645288  7247 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:03:45.756384  1606 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:45.744297  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:45.740190  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 147095us
I20260709 13:03:45.754204  1535 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:45.722556  7067 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:45.721658  7252 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.723101  7208 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:45.756410  7000 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:45.761798  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56861.9us
I20260709 13:03:45.730875  6996 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.767594  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.730268  6861 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.740095  7114 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.777469  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:45.832280  1608 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:03:45.832284  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57053.9us
I20260709 13:03:45.833598  1606 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:45.834682  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 207378us
I20260709 13:03:45.760635  7067 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:45.836383  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:45.775619  7209 consensus_meta.cc:287] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
W20260709 13:03:45.844355  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65571.1us
I20260709 13:03:45.775996  7252 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:45.774746  6861 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.847550  7068 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:45.849467  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.859138  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.841439  7161 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.868999  6901 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.869421  7277 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:45.870172  7238 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:03:45.871915  7278 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:03:45.776896  6996 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.851082  7245 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:45.777179  7251 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.297s
I20260709 13:03:45.850652  7113 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:45.852705  7209 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.878870  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.776808  7215 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 13:03:45.896504  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51679.7us
I20260709 13:03:45.852291  7252 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:45.864950  7247 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.858240  7199 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:45.868234  7196 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:45.921805  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:45.925755  1608 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:03:45.913142  7210 consensus_meta.cc:287] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.001s
I20260709 13:03:45.856945  7213 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 13:03:45.940071  1610 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.943478  1680 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:45.878031  7138 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:03:45.953162  7275 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:03:45.954300  7267 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 13:03:45.956166  7284 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:45.947324  7274 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.958690  7274 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.937259  7247 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:45.998939  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.932323  7114 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.931869  7245 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:45.892866  7161 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.012346  1607 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:46.016876  1601 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:45.944909  7279 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.927248  7113 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:45.979996  7246 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.285s
W20260709 13:03:46.017736  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 139016us
I20260709 13:03:46.058941  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.017083  7245 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:46.090679  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:45.948238  7210 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:46.102387  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.107467  7293 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.090766  7245 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:46.108105  7293 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.034099  7114 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:46.115950  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 266558us
I20260709 13:03:46.120784  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.092566  7279 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.126761  6996 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:46.102133  7096 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.114704  7209 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:46.138545  7293 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.140084  7274 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:46.148645  7092 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.000s
I20260709 13:03:46.148888  7292 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:46.150637  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60073.8us
I20260709 13:03:46.151983  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.150092  1530 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
W20260709 13:03:46.157604  7131 consensus_meta.cc:287] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent flushing consensus metadata: real 1.026s	user 0.008s	sys 0.003s
W20260709 13:03:46.159894  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.163103  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.167407  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.158716  7248 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:46.265612  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 284676us
I20260709 13:03:46.161742  7279 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.150151  7245 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.164610  7292 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:46.168203  7210 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:46.272105  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:46.271627  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.276503  1604 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:46.264214  7138 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.279884  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:46.289803  7290 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:03:46.297091  7283 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:46.297304  7067 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.299998  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.276659  7199 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:46.313295  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161378us
I20260709 13:03:46.314373  1608 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:46.288506  7297 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 13:03:46.317186  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.277889  7213 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:46.369814  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52731us
I20260709 13:03:46.370898  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.376443  6684 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:46.378877  7294 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:03:46.380263  7294 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:03:46.380687  7289 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 13:03:46.380980  7287 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:03:46.279121  7248 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.284337  7092 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:46.398664  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 231348us
I20260709 13:03:46.279304  7068 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
W20260709 13:03:46.375895  7281 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
W20260709 13:03:46.418031  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 137837us
I20260709 13:03:46.322348  7199 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.427819  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:46.427673  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2116) took 1474 ms (client timeout 1710 ms). Trace:
I20260709 13:03:46.429735   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:46.432482  1498 leader_election.cc:400] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21.
W20260709 13:03:46.323408  7063 consensus_meta.cc:287] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.001s
I20260709 13:03:46.374490  7213 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:46.450008  1530 rpcz_store.cc:269] 0709 13:03:44.952963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.013297 (+ 60334us) service_pool.cc:224] Handling call
0709 13:03:46.427447 (+1414150us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000fb754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:46.427593 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594858240}
I20260709 13:03:46.426659  6684 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.455371  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.284976  7292 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.387921  7131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 9) took 2376 ms. Trace:
I20260709 13:03:46.318466  7138 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.457584  1531 raft_consensus.cc:2410] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:03:46.458369  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 87572.2us
I20260709 13:03:46.400460  7294 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.458767  1498 leader_election.cc:400] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20.
I20260709 13:03:46.458761  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.461401  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.476282  7312 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.470578  7225 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:46.469202  7302 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:46.459823  7257 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:03:46.469192  7248 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.460683  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:46.480556  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.456283  7213 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:46.510861  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.482056  1605 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:46.485868  1610 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:46.457502  7068 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:46.490896  7295 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:46.491096  7246 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:46.483212  7220 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.494100  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.498274  7312 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:46.502585  6861 consensus_meta.cc:287] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:03:46.504129  7293 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:46.504987  7161 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.488457  7114 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.538123  7096 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.554400  7292 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.457432  7131 rpcz_store.cc:276] 0709 13:03:43.940245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.940437 (+   192us) service_pool.cc:224] Handling call
0709 13:03:43.971028 (+ 30591us) log.cc:844] Serialized 501 byte log entry
0709 13:03:44.389928 (+418900us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800364b40. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4697fd2b0b 00007f4698057b63 00007f469807f752 00007f46980779fa
0709 13:03:44.559346 (+169418us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4c00108240. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696345a20 00007f4696356a29 00007f469635713f 00007f469631b2ab 00007f4696348f3c 00007f46963493fe 00007f46965d650b 00007f4697fd5381 00007f4697fd326b 00007f4697fd9d53 00007f4697fd9cd9
0709 13:03:46.316168 (+1756822us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":254,"mutex_wait_us":2273,"raft.queue_time_us":274049,"raft.run_cpu_time_us":5310,"raft.run_wall_time_us":427618,"spinlock_wait_cycles":43889664,"thread_start_us":156690,"threads_started":1,"wal-append.queue_time_us":263007,"wal-append.run_cpu_time_us":1693,"wal-append.run_wall_time_us":1003053}
W20260709 13:03:46.526764  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70571us
W20260709 13:03:46.523171  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44049.9us
I20260709 13:03:46.533564  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.536600  7269 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:46.601109  6783 consensus_meta.cc:287] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.000s
I20260709 13:03:46.522691  7294 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.537467  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.589303  7266 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:46.478137  7063 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:03:46.598564  1605 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:46.519871  7295 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:46.517865  7068 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.536530  6861 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:46.523422  7277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.004s
W20260709 13:03:46.617074  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 83686.4us
I20260709 13:03:46.538107  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:46.520426  7225 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:46.624233  1675 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:46.636322  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:46.630429  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 93042.4us
I20260709 13:03:46.623773  7266 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.634843  1527 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.639165  7292 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.639293  7266 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:46.621680  7220 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.640345  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.640765  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:46.641059  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:03:46.641402  1528 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:46.641631  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.642204  7068 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.642915  1527 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:46.643362  7068 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:46.640146  7220 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.629472  7295 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:46.632386  7114 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:46.627792  7245 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.620533  7210 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:46.646730  7063 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:46.651469  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:46.672516  1529 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.672996  1529 raft_consensus.cc:614] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:46.660210  1535 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:46.663738  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.659590  7138 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:46.653661  7310 log.cc:927] Time spent T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:03:46.660914  7000 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.001s
W20260709 13:03:46.682407  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44276.9us
I20260709 13:03:46.661170  7063 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.683270  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.684291  7138 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.684536  7063 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.682086  7000 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.650066  7220 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:46.687517  7000 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.688385  1606 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:46.691299  6801 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.692875  6801 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:46.693063  7198 raft_consensus.cc:3060] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.695964  7112 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:46.697912  6797 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:46.698513  6797 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.698936  7209 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.699507  7209 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.700486  6854 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:46.700992  6854 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.702062  6854 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.699596  6797 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.663643  6743 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:03:46.647655  7309 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 13:03:46.655381  6861 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.699371  7199 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.712181  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.719094  1679 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:46.716112  1529 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:46.722805  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:46.645766  7277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.004s
I20260709 13:03:46.720168  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.726179  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.726852  1678 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:46.727556  1683 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:46.718717  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:46.718201  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 90906.5us
I20260709 13:03:46.734930  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.738142  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:46.738626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.740845  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.744179  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:46.706009  7305 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 13:03:46.746430  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.746723  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:46.707934  7286 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.579s	user 0.000s	sys 0.010s
I20260709 13:03:46.750586  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.703738  6854 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:46.752529  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.758031  1528 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
W20260709 13:03:46.785178  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44492us
I20260709 13:03:46.785961  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.758391  1682 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:46.749282  6684 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:46.760385  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:46.763983  1684 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:03:46.765183  7138 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:46.789958  1608 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:46.766646  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:46.769537  7199 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.769980  7000 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:46.691349  7113 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.804384  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.772377  7209 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:46.709659  6743 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:03:46.778512  7312 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:46.779142  7302 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:46.781435  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.691809  7213 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.788493  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.726305  7277 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:46.797394  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.661258  7225 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.801482  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.817030  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:46.817269  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.818940  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.826406  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.798431  6797 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:46.828884  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:46.812975  7273 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 1.033s	user 0.015s	sys 0.019s
I20260709 13:03:46.830308  1604 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:46.807569  7292 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:46.831884  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.804529  7257 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:46.829998  1608 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:46.835585  1604 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:46.835927  1527 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:46.834975  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:46.890084  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 55215.7us
I20260709 13:03:46.822997  7199 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:46.827858  7113 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.895651  1601 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:03:46.901191  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73639.2us
W20260709 13:03:46.905092  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 214153us
I20260709 13:03:46.903314  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.905930  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.816524  7063 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:03:46.907754  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:46.811765  7095 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:03:46.873327  6684 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:46.834263  6783 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:46.888199  7248 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:46.932209  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 115059us
I20260709 13:03:46.894515  7004 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.931923  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2575) took 1252 ms. Trace:
I20260709 13:03:46.939121  1526 rpcz_store.cc:276] 0709 13:03:45.672928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.676532 (+  3604us) service_pool.cc:224] Handling call
0709 13:03:45.677024 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.720351 (+ 43327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.720399 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.733290 (+ 12891us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.881655 (+148365us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:45.881696 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.881874 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.707259 (+825385us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:46.908697 (+201438us) raft_consensus.cc:1685] finished
0709 13:03:46.908742 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.925670 (+ 16928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31236,"raft.queue_time_us":39773,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9820,"spinlock_wait_cycles":14311808,"thread_start_us":115900,"threads_started":1,"wal-append.queue_time_us":368992}
I20260709 13:03:46.893865  7292 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.934036  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.935134  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:46.935400  7266 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:46.932225  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.844832  7312 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:03:46.931159  6783 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:46.822127  7302 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.958544  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.964107  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.936090  6996 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:46.986711  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.991017  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:46.991840  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:46.993254  1610 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:46.928467  7113 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.897953  7257 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:46.953099  7292 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:46.996017  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 62086.9us
I20260709 13:03:46.998997  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:46.968483  7138 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:47.000383  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:46.946583  7095 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:03:47.001638  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.004005  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:47.007045  1534 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:46.960431  7260 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:03:47.011929  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.013001  1602 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:47.014082  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:47.007017  1526 raft_consensus.cc:606] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.002991  7301 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:47.022430  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.032414  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.035996  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:46.994936  7269 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:03:47.040813  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.041617  7323 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:47.042500  7161 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.042304  7323 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:47.043288  7161 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.046726  7250 raft_consensus.cc:993] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:03:47.047756  7247 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.050666  7257 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:47.021611  7209 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:47.051594  7209 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.052640  7209 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.053311  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 2690) took 1526 ms. Trace:
I20260709 13:03:47.053674  1680 rpcz_store.cc:276] 0709 13:03:45.526844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.543123 (+ 16279us) service_pool.cc:224] Handling call
0709 13:03:45.558323 (+ 15200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.949584 (+391261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.053053 (+1103469us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540041ad54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:47.053226 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885172608}
I20260709 13:03:47.055770  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50950 (request call id 352) took 1113 ms. Trace:
I20260709 13:03:47.038314  7312 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.056246  1675 rpcz_store.cc:276] 0709 13:03:45.926806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.927013 (+   207us) service_pool.cc:224] Handling call
0709 13:03:45.942833 (+ 15820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.634890 (+692057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.039758 (+404868us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001405d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:47.039935 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558139136}
I20260709 13:03:47.057618  7252 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.059258  7252 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.059509  7266 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:47.020677  6743 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:03:47.061344  7113 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.022294  6684 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.019179  6994 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:03:47.063752  6994 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:47.069486  6994 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.040238  6783 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.070429  6994 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.071635  6994 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.065655  7225 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:47.074553  7095 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.075031  7318 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:47.075142  7095 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.077394  7095 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.077680  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2771) took 1212 ms. Trace:
I20260709 13:03:47.077852  7095 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:47.078069  1606 rpcz_store.cc:276] 0709 13:03:45.864972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.865196 (+   224us) service_pool.cc:224] Handling call
0709 13:03:45.865690 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.688825 (+823135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.077444 (+388619us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400086454. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:47.077627 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891228928}
I20260709 13:03:47.079489  1609 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:47.079779  7096 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:47.080157  7096 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:47.081049  7096 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.048102  7248 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:03:47.096015  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59563.6us
I20260709 13:03:46.956228  7277 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.100857  7230 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:47.082227  1603 raft_consensus.cc:2410] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:03:47.103434  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.103520  7321 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
W20260709 13:03:47.105522  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35646 (request call id 2749) took 1804 ms (client timeout 1681 ms). Trace:
I20260709 13:03:47.082911  7302 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:47.106036  1603 rpcz_store.cc:269] 0709 13:03:45.301048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.321366 (+ 20318us) service_pool.cc:224] Handling call
0709 13:03:47.105242 (+1783876us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001716d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:47.105442 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4046301952}
I20260709 13:03:47.021313  7301 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.107038  7301 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.039645  7138 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.112396  7138 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.113757  1535 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:47.115366  7138 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.085507  7323 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:47.086807  7213 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:47.087540  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2117) took 2109 ms (client timeout 1726 ms). Trace:
I20260709 13:03:47.120501  7294 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:47.120573  1533 rpcz_store.cc:269] 0709 13:03:44.978368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.015322 (+ 36954us) service_pool.cc:224] Handling call
0709 13:03:47.087330 (+2072008us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400435dd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:47.087472 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4072505728}
I20260709 13:03:47.123221  1533 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:47.120404  6783 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.088697  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.126138  1677 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:47.089852  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:47.090233  7067 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.042260  1574 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.093883  7295 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.078363  7095 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.129038  7295 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.129468  7095 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.130039  1532 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22. Ops: []
W20260709 13:03:47.082983  1531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2121) took 1943 ms (client timeout 1599 ms). Trace:
W20260709 13:03:47.133621  1531 rpcz_store.cc:269] 0709 13:03:45.139965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.147376 (+  7411us) service_pool.cc:224] Handling call
0709 13:03:47.082773 (+1935397us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000dd254. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:47.082895 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005263104}
I20260709 13:03:47.139869  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:47.140594  1683 raft_consensus.cc:606] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.140957  1683 raft_consensus.cc:614] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:47.143110  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.154568  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:47.156546  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 13:03:47.157744  7095 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.158059  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.095721  7096 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.158946  6684 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:47.159162  7161 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.155295  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:47.159515  6684 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:47.160621  1533 raft_consensus.cc:606] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.161811  1533 raft_consensus.cc:614] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:47.162716  6684 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:47.165059  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.166833  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:47.161087  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.166344  6684 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:47.168124  6684 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.168247  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.168581  6684 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:47.169620  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 72625.7us
I20260709 13:03:47.141975  7292 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.182274  1608 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:03:47.183239  7292 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.185176  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:47.188316  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 127413us
I20260709 13:03:47.194069  1528 raft_consensus.cc:606] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.194587  1528 raft_consensus.cc:614] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:47.195840  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.196352  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.196959  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.197422  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.199307  7292 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:47.199851  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 163965us
I20260709 13:03:47.200569   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:47.203881   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:47.200587  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.205837  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.206552  7323 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.207645  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.204725  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.205901  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.208663  1534 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:47.208942  6797 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.200757  6854 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:47.209879  7250 raft_consensus.cc:1081] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:03:47.211057  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:47.211870  7208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.012s	sys 0.020s
W20260709 13:03:47.212275  7208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.013s	sys 0.020s
I20260709 13:03:47.212533  1678 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:47.217901  7329 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.218624  7329 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.221033  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.221685  1530 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:47.223227  1677 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:47.224459  7329 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:47.228834  1500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.233925  6861 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:47.234668  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.235195  6797 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:47.235574  6797 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:47.209342  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.236524  6797 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.237248  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.237525  6797 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:47.238111  7213 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:47.238546  7213 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:47.239034  7213 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.240794  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.241739  7292 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:47.231971  1527 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.235666  7250 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.242235  7292 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:47.244823  7292 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.206620  1528 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
W20260709 13:03:47.248585  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.236526  7067 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.254004  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.200964  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.258253  1677 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:47.258558  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.261556  1679 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:47.268018  7138 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:47.268519  7138 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.182948  7301 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.268887  7138 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:47.269412  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68538.7us
I20260709 13:03:47.272570  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.273870  1683 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:03:47.275012  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.278759  1679 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:03:47.279727  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:47.282053  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 291081us
I20260709 13:03:47.286557  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.288859  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:47.254230  6684 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.290269  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.301997  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.307231  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:47.309633  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 70452.7us
I20260709 13:03:47.275002  1527 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:47.318158  1680 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:47.326301  6684 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.330940  1675 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:47.311201  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.332053  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.332798  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.333706  1676 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:47.334439  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.337891  6684 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:47.338498  6684 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:47.338910  6684 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:47.340056  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51235.7us
W20260709 13:03:47.344527  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73896.9us
I20260709 13:03:47.346933  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.343204  7269 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:47.354193  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57092us
I20260709 13:03:47.329175  7293 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:47.330098  6854 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.361835  1681 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:03:47.365604  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63688.3us
I20260709 13:03:47.367426  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.371304  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.353704  7067 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:47.300784  7161 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.372506  1676 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:47.372996  1647 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:47.333055  7213 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.376552  1576 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.377278  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.367225  7269 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.392580  7225 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:47.393209  7269 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.395893  7294 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:47.397514  7092 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:47.398502  7092 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.399333  7092 raft_consensus.cc:993] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:03:47.399905  7092 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:47.406497  7092 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:47.407574  7266 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:47.382943  7004 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:47.382659  7000 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:47.408360  7004 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.408586  7000 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:47.408800  7004 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:47.409471  7266 consensus_queue.cc:1059] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:47.409601  7000 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.412295  6996 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:47.392791  7208 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:47.412827  6996 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.413087  7208 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.414013  6996 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.414263  7208 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.415465  6996 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:47.407383  7092 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.401034  7213 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.400367  7297 raft_consensus.cc:1081] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:03:47.399202  7292 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.361135  7303 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:03:47.427341  6684 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.370606  7293 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:47.389217  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:03:47.437551  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47433.5us
I20260709 13:03:47.379472  7096 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:47.374591  7067 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:47.439649  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 54569.3us
I20260709 13:03:47.437062  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:47.388437  7095 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.445943  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.446724  1607 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:47.451252  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.453889  1604 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:47.455350  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.456053  1604 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:47.457489  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.461939  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 72797.1us
I20260709 13:03:47.462131  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:47.444509  7293 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.471385  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.472844  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:47.473304  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:47.470381  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 83895.2us
I20260709 13:03:47.478684  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.451458  7092 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.468819  6684 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.445904  7067 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.484629  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.486342  1681 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:47.537544  1610 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:47.540657  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:47.542346  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.441392  6854 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:47.478694  7210 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:47.482118  7323 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:47.469868  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:03:47.562738  1606 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.563118  1606 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:47.563263  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.482906  7266 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:47.484259  7277 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.531445  7259 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:47.560576  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74873.4us
I20260709 13:03:47.574100  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:47.544333  7297 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:47.544229  6861 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:47.586138  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.480990  7309 consensus_queue.cc:1059] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:03:47.482518  7294 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:03:47.552410  7199 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:47.593724  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.562071  7210 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:47.596738  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 219513us
I20260709 13:03:47.602308  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.575435  7266 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:47.600063  1610 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:47.603703  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.601984  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:47.589589  7297 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.593396  7301 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:47.611378  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.619082  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.619429  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.610010  6684 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.587553  7259 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.601717  7257 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:47.622390  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.629652  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.604617  7210 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:47.627774  7323 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:47.615993  7225 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:47.637244  7352 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.637075  7323 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.639063  7269 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.606628  7349 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:47.641343  7353 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:03:47.607363  7266 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:47.666250  1681 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:47.668336  1610 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:03:47.642766  7348 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:47.617503  7297 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.670008  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.675086  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:47.644078  7344 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:03:47.604583  7199 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:47.666857  7342 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:03:47.689314  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.628734  7257 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:47.740095  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:47.740873  1610 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.691107  7068 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.685917  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74567.1us
W20260709 13:03:47.774561  7351 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:47.774402  7004 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.776803  7004 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.778816  7269 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:47.782135  1606 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.784263  1606 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.788918  7067 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.685803  7225 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.792066  7293 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.793864  7225 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.795429  7293 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.688861  7138 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.743399  7257 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.750437  7292 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.830485  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.860432  1602 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:47.783699  7259 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.852962  7199 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.853538  7067 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:47.854409  1605 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:03:47.878364  1605 pending_rounds.cc:85] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 9
I20260709 13:03:47.878726  1605 pending_rounds.cc:107] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:03:47.879046  1605 raft_consensus.cc:2889] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:47.880357  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 109854us
I20260709 13:03:47.857582  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.882550  1647 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.853468  1601 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:47.861903  1609 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:47.868438  1604 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
W20260709 13:03:47.869465  7348 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.004s
I20260709 13:03:47.871668  7260 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:47.884877  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.887353  1535 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:03:47.887773  1535 pending_rounds.cc:85] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 11
I20260709 13:03:47.888005  1535 pending_rounds.cc:107] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:03:47.888360  1535 raft_consensus.cc:2889] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.889442  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.854305  7068 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.891216  1608 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:47.893416  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.893682  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.894197  1675 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:47.895951  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.899462  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.900578  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.901232  1604 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.906324  1684 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:47.909058  1676 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:47.917016  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:47.922451  1604 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:47.911211  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.924718  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:47.925992  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.927011  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.927754  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:47.928857  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.930030  1535 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:47.931514  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.933960  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.952623  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:47.953680  1532 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 8. (term mismatch)
I20260709 13:03:47.954200  1532 pending_rounds.cc:85] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 7
I20260709 13:03:47.954512  1532 pending_rounds.cc:107] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 18.8
I20260709 13:03:47.954818  1532 raft_consensus.cc:2889] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.938553  1610 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:47.942026  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.956413  1675 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:03:47.946962  1604 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:47.891445  7260 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.948555  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.959339  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:47.960111  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.962355  6684 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.961758  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:03:47.951719  6996 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.006s
I20260709 13:03:47.964257  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.934798  7309 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.936007  7112 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.949110  7199 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:47.971660  1498 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.964845  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:47.980839  1677 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:47.973733  1610 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:47.900924  6941 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:03:47.970302  1535 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:47.975860  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:47.977828  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.952793  7301 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.986714  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:47.962286  7303 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:47.962428  7357 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.983893  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:47.994679  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:48.002029  7210 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:47.951133  7293 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:03:48.004987  6684 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.964349  7138 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.009694  1602 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:03:48.010865  1601 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:47.995739  7251 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:48.073542  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:48.009389  1535 raft_consensus.cc:2393] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:48.075569  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:47.966435  7000 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:03:48.030375  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.077134  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.067063  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54857.1us
I20260709 13:03:48.080003  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.071771  7303 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:47.957301  7208 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:03:48.080912  1610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:03:48.082389  1682 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:48.082713  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.003808  7199 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:47.984414  7276 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:03:47.992959  7292 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:03:48.135748  1607 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:48.134780  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:48.155831  1610 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.157899  1607 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:48.173128  1610 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:48.070672  7068 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:48.145632  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65776.7us
I20260709 13:03:48.018620  7357 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:48.124845  7360 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:03:48.129855  7095 raft_consensus.cc:2764] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:03:48.129287  7092 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 13:03:48.181418  1602 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:03:48.182893  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.184917  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.085759  6861 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:48.192971  1609 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:48.194375  7297 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.187391  7067 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 13:03:48.196818  7361 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:48.245493  1602 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:48.134014  7210 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:48.145154  7251 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.092227  7000 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:48.245898  1610 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.211748  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.232399  6684 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:48.233315  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50537.2us
I20260709 13:03:48.254098  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:48.234513  7363 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:03:48.237439  1526 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:48.186719  6941 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.131543  7257 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.255119  1607 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:48.259389  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48672.5us
I20260709 13:03:48.260836  1533 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 15: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:48.270437  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.209400  7277 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.199919  7269 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.265010  1535 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:48.282063  1610 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.261291  7313 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.297524  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.088111  7260 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.259262  7295 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.277719  6861 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.130777  7303 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.284610  7225 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.355633  7225 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.358397  7225 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:48.359412  7266 consensus_meta.cc:287] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.002s
I20260709 13:03:48.360361  7000 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.361593  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.362234  1526 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:48.283703  7277 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.291458  7269 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.292800  7357 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.261459  6941 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.307248  7276 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:03:48.326625  7363 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:48.307492  7313 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:48.354861  7367 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:48.380511  7313 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:48.381317  7365 log.cc:927] Time spent T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.296s	user 0.003s	sys 0.000s
I20260709 13:03:48.381835  6861 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:48.385308  7364 log.cc:927] Time spent T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:03:48.386456  6941 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:48.391364  7297 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.383973  1534 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:48.398048  1534 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.398857  1534 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.401295  7277 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.366135  7251 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.399945  1534 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:48.406733  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.365751  7068 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:48.348289  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.409168  1527 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:48.306360  7199 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.379937  7269 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:48.418437  7248 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:48.374068  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:48.425829  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52242.2us
I20260709 13:03:48.425745  7198 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:48.425732  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:48.428486  1532 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:03:48.375622  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:48.428741  1526 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:03:48.442140  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66629.3us
I20260709 13:03:48.445410  1574 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.317963  7295 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.286161  7095 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:48.425628  7276 consensus_queue.cc:1243] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:48.470305  1532 pending_rounds.cc:85] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 6
I20260709 13:03:48.470544  1534 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:03:48.421590  7248 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.478948  1532 pending_rounds.cc:107] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:03:48.432955  7297 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.480402  1532 raft_consensus.cc:2889] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.359858  7266 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.442775  6783 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:48.485855  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.464195  7198 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.478808  7246 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:03:48.424431  7068 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:48.496539  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.483385  7323 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 13:03:48.506258  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2223) took 1024 ms. Trace:
I20260709 13:03:48.493916  1527 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:48.522429  1534 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: [18.9-19.10]
I20260709 13:03:48.520753  1682 rpcz_store.cc:276] 0709 13:03:47.481878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.482027 (+   149us) service_pool.cc:224] Handling call
0709 13:03:47.482321 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.163453 (+681132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.506024 (+342571us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400404554. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:48.506197 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379502848}
I20260709 13:03:48.482040  7257 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:48.510864  7295 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.513504  7092 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:48.533059  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:48.518708  7068 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.463676  1574 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.553736  1530 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:48.555326  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 91729.3us
I20260709 13:03:48.556519  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.557791  1533 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:48.523590  7213 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.484453  7297 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.563833  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:48.574052  1682 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 13:03:48.575742  7213 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.583205  7213 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.560920  7198 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.590571  7266 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:48.559636  7257 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:48.591895  7257 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:48.593442  7248 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.593145  7257 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.598423  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.566133  7357 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:48.533319  7092 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.600824  7092 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.601598  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:48.602195  7092 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:48.607105  1529 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:48.607270  7357 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:48.608745  7198 raft_consensus.cc:2764] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:03:48.608912  7293 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:48.609576  7293 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:48.403126   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.614253  1427 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 12 to 15, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.602393  1682 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:48.630718  1605 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:48.641400  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.642673  1527 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:48.663565  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.622051  7295 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:48.681581  7371 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 13:03:48.683324  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2802) took 1205 ms. Trace:
W20260709 13:03:48.685889  7355 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.436s	user 0.002s	sys 0.000s
I20260709 13:03:48.696689  1605 rpcz_store.cc:276] 0709 13:03:47.478336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.041525 (+563189us) service_pool.cc:224] Handling call
0709 13:03:48.071508 (+ 29983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.631179 (+559671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.683005 (+ 51826us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400249354. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:48.683247 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285610368}
I20260709 13:03:48.688562  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:48.690040  1528 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:48.691690  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2610) took 1242 ms. Trace:
I20260709 13:03:48.692348  1603 raft_consensus.cc:1240] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:48.703814  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:48.704680  1675 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:48.704718  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 100326us
I20260709 13:03:48.703363  1601 rpcz_store.cc:276] 0709 13:03:47.449023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.449157 (+   134us) service_pool.cc:224] Handling call
0709 13:03:47.669811 (+220654us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800005498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:03:48.691497 (+1021686us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400100c54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:48.691633 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304582400}
I20260709 13:03:48.708024  1677 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:48.709498  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:48.610471  7293 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.638527  7248 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:48.707435  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 63403.9us
W20260709 13:03:48.712656  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 71371.8us
I20260709 13:03:48.715068  1681 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:48.715739  1574 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.716809  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.717406  1676 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:48.694160  7068 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:48.713265  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:48.718185  7198 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:48.712643  7356 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:48.692813  7199 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:03:48.710986  7266 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:03:48.740731  7138 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:48.744863  7266 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:48.745335  7266 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:48.746160  7266 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.747437  7266 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:48.718467  7208 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:48.748114  7068 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.748333  7208 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:48.750639  7068 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.720894  7248 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.753324  7248 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.706143  7295 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.723191  7293 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:48.757839  1531 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:48.758229  1531 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.750584  7208 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:48.760255  7377 log.cc:927] Time spent T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:48.761147  1531 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.762118  7312 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.762639  7312 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.764623  7312 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:48.768162  7355 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:48.768529  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52876.4us
I20260709 13:03:48.755671  7295 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.768448  7198 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:48.768337  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43819.6us
I20260709 13:03:48.770228  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.771374  1574 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.772032  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:48.772272  7138 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.773432  7292 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.774039  1684 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:48.775701  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.777319  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.778833  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.762244  1531 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:48.779080  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.729385  1675 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
W20260709 13:03:48.719331  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 140393us
I20260709 13:03:48.708197  7004 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:48.796669  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.785178  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.791303  1574 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.793865  1609 raft_consensus.cc:1240] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:48.797654  1607 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:48.798573  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:48.794456  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.795192  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.800124  1606 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:48.800181  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.796768  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.779883  1676 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:48.806394  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:48.808633  7292 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:48.813184  1608 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:48.813938  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.814572  1681 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:48.815521  7292 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:48.815944  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:48.816468  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2631) took 1200 ms. Trace:
I20260709 13:03:48.816823  1530 rpcz_store.cc:276] 0709 13:03:47.615621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.616939 (+  1318us) service_pool.cc:224] Handling call
0709 13:03:48.274104 (+657165us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:48.274415 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.554193 (+279778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.816255 (+262062us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400209754. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:48.816414 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646501888}
I20260709 13:03:48.819382  1498 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:48.819684  1682 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
I20260709 13:03:48.820092  7199 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.851665  7199 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.847186  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:48.825994  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2629) took 1211 ms. Trace:
I20260709 13:03:48.827081  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2798) took 1350 ms. Trace:
I20260709 13:03:48.854789  1603 rpcz_store.cc:276] 0709 13:03:47.476904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.946387 (+469483us) service_pool.cc:224] Handling call
0709 13:03:48.692142 (+745755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.704127 (+ 11985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.826908 (+122781us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400100c50. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:48.827029 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714302592}
I20260709 13:03:48.831128  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2630) took 1215 ms. Trace:
I20260709 13:03:48.855947  1529 rpcz_store.cc:276] 0709 13:03:47.615317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.616467 (+  1150us) service_pool.cc:224] Handling call
0709 13:03:48.511839 (+895372us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:48.512072 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.607606 (+ 95534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.830867 (+223261us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b540003eb54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:48.831062 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222110976}
I20260709 13:03:48.816462  7292 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.833470  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.861176  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:48.861496  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.833745  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:48.863092  1609 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:48.835687  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.836267  1607 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:48.807464  7068 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:48.840538  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:48.846203  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.844714  1608 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:48.845191  1535 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:48.868701  1535 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.849367  1531 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:03:48.870622  1531 pending_rounds.cc:85] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 10
I20260709 13:03:48.870960  1531 pending_rounds.cc:107] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:03:48.871259  1531 raft_consensus.cc:2889] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.854720  1528 rpcz_store.cc:276] 0709 13:03:47.615023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.616117 (+  1094us) service_pool.cc:224] Handling call
0709 13:03:48.133126 (+517009us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:48.689733 (+556607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.703357 (+ 13624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.825772 (+122415us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54000a46d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:48.825924 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283988480}
I20260709 13:03:48.829984  7297 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:48.857998  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52006.9us
I20260709 13:03:48.861999  1604 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:48.866920  1684 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:48.875445  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:48.880805  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.878474  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.878394  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.884125  1603 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:48.869769  1535 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.894162  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.895961  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:48.904320  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.911842  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.910655  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.913306  1606 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
W20260709 13:03:48.886622  7294 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:03:48.874287  7295 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:48.914458  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:48.926621  1528 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:48.918520  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:48.922771  1535 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:48.890784  7198 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.929908  7198 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.915531  7220 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:03:48.932504  1609 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:48.903826  7323 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.932907  1603 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:48.890544  7394 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 13:03:49.037796  7198 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.029493  7138 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:49.028891  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 113574us
I20260709 13:03:48.881271  7068 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:48.928097  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:49.241209  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 176910us
I20260709 13:03:49.049809  7199 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:48.921177  6801 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 13:03:49.058534  7295 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:48.911369  7297 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:03:49.232244  1535 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 12.
W20260709 13:03:49.236217  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 315354us
I20260709 13:03:49.194901  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2643) took 1032 ms. Trace:
W20260709 13:03:49.271117  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 343096us
I20260709 13:03:49.311580  1527 rpcz_store.cc:276] 0709 13:03:48.162949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.645410 (+482461us) service_pool.cc:224] Handling call
0709 13:03:48.645645 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.752172 (+106527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.752200 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.752243 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:48.752271 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.194567 (+442296us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540032f5d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:49.194630 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.194820 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244560640}
W20260709 13:03:49.309329  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 257113us
I20260709 13:03:49.322299  1610 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:49.331204  1682 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:03:49.333017  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.333731  1678 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:49.238718  7312 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.335220  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.336103  1678 raft_consensus.cc:2410] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:03:49.251395  7390 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.191s	user 0.003s	sys 0.006s
W20260709 13:03:49.310719  7387 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.518s	user 0.015s	sys 0.000s
I20260709 13:03:49.325002  7380 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.239348  7113 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.308889  7004 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:49.361011  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.365480  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.325030  7000 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:49.340580  7382 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:03:49.260008  7266 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:03:49.337666  7260 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:49.366086  1603 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:49.355016  7293 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.367211  7000 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.381588  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.368880  7301 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:03:49.394685  7266 consensus_queue.cc:1243] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:49.395287  6994 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:49.364183  6783 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:49.409188  7301 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:49.409653  7301 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:49.410542  7301 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.361538  7113 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.380534  7000 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.369740  7004 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.360988  7380 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.422757  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:49.414780  7396 log.cc:927] Time spent T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:03:49.415951  7294 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.379523  7293 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.431685  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:49.430660  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45061.8us
I20260709 13:03:49.421903  7302 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:49.423929  7246 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.421991  7297 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.437690  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:49.432160  7248 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.443925  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:49.387091  7295 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.437949  7302 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:49.457592  7302 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:49.463166  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 111372us
I20260709 13:03:49.466599  7292 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:49.451808  7248 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.445446  7095 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.433352  7294 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.472390  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2162) took 1566 ms. Trace:
W20260709 13:03:49.476365  7393 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 13:03:49.463692  6854 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.463521  7068 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.470438  7407 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:49.477098  7259 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:49.484926  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.486418  7401 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:03:49.522022  7397 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:49.523896  7113 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.468783  7292 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:49.525619  7292 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.529381  7294 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.475241  7248 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.497052  1532 rpcz_store.cc:276] 0709 13:03:47.905551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.432610 (+527059us) service_pool.cc:224] Handling call
0709 13:03:48.470106 (+ 37496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.481044 (+ 10938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.481081 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.481568 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.643238 (+161670us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:48.714146 (+ 70908us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.720487 (+  6341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.720562 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.472121 (+751559us) raft_consensus.cc:1685] finished
0709 13:03:49.472153 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.472311 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92425,"prepare.queue_time_us":75073,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":8560,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2879,"thread_start_us":160420,"threads_started":1,"wal-append.queue_time_us":396747}
I20260709 13:03:49.445676  7246 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.445509  7297 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.470074  7209 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:03:49.505518  6854 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.508232  7405 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:03:49.514063  7000 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.514904  7407 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.499711  6684 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:49.534422  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60185.8us
I20260709 13:03:49.501668  7092 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.564823  6684 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.572842  6684 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.566524  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:49.565236  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.577885  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.578440  1676 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:49.578827  1676 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:49.498139  7095 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.579537  1676 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.556730  6854 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.597887  1676 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:49.600376  6684 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.570785  7407 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:49.579419  7198 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.580152  7349 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.620303  7406 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.591709  7092 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.620860  7406 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.624481  7323 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.626847  1533 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:03:49.629456  7246 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.615762  7349 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.636549  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:49.637825  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:49.617573  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 299917us
W20260709 13:03:49.644896  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 207294us
I20260709 13:03:49.649400  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:49.667728  1533 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.644495  7293 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.675027  1533 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:49.675506  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:49.666080  1676 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:49.679970  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:49.659082  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2625) took 1538 ms. Trace:
I20260709 13:03:49.681238  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:49.666136  1527 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:49.682960  7000 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.681591  1602 rpcz_store.cc:276] 0709 13:03:48.120413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.264188 (+143775us) service_pool.cc:224] Handling call
0709 13:03:48.269025 (+  4837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.269248 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:48.499961 (+230713us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.502915 (+  2954us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.519849 (+ 16934us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180043c780. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:48.766526 (+246677us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b180043c780. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c522 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:03:49.480397 (+713871us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b180043c780. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f6ee07 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f89455 00007f4698071060 00007f4698083716 00007f4698094287 00007f4698094208
0709 13:03:49.658716 (+178319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.658775 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:49.658825 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.658891 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.659021 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11773,"prepare.queue_time_us":120895,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":102,"raft.queue_time_us":18943,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":3466,"spinlock_wait_cycles":44948352,"thread_start_us":384851,"threads_started":2}
I20260709 13:03:49.684077  1528 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:49.685937  1535 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:49.640285  7257 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:49.615471  7198 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.690932  7198 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.683535  7000 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.714956  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.717758  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.719137  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.719635  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.720476  1682 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
W20260709 13:03:49.721302  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 130630us
I20260709 13:03:49.722558  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:49.727275  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.687572  7257 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.740132  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:49.738122  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95424.1us
I20260709 13:03:49.738514  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.743932  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.738760  1680 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:03:49.740700  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:49.745749  1683 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.660311  7323 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.748008  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:49.749851  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 183430us
I20260709 13:03:49.745388  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:49.753228  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:49.754745  1576 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:49.763571  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:49.743501  7257 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:49.768467  7303 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.768920  7423 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.768857  7413 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:03:49.769678  7198 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:49.770331  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:49.774655  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.775452  1602 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:49.742179  7309 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.777608  1610 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:49.722433  7000 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.801199  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:49.799892  7246 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:49.800011  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54683.7us
I20260709 13:03:49.749930  7418 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.804351  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:49.805752  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:49.784482  7303 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.785998  7406 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.788425  7414 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.756150  7113 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:03:49.787827  7292 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:03:49.814544  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:49.807384  7416 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:49.821764  7220 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:49.824693  7399 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.389s	user 0.003s	sys 0.000s
I20260709 13:03:49.839102  7220 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:49.825201  7323 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.790943  7294 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:03:49.840094  7220 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.825773  7092 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.827294  7394 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:49.841320  7220 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:49.841329  7394 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.843688  7394 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.844485  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2819) took 1060 ms. Trace:
I20260709 13:03:49.844980  1601 rpcz_store.cc:276] 0709 13:03:48.783598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.786965 (+  3367us) service_pool.cc:224] Handling call
0709 13:03:48.787353 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:48.797863 (+ 10510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.797891 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:48.814148 (+ 16257us) log.cc:844] Serialized 52 byte log entry
0709 13:03:49.145557 (+331409us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:49.255259 (+109702us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.328268 (+ 73009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.328348 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.824113 (+495765us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:49.844110 (+ 19997us) raft_consensus.cc:1685] finished
0709 13:03:49.844245 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.844414 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30687,"prepare.queue_time_us":163387,"prepare.run_wall_time_us":7178,"raft.queue_time_us":47510,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":16529,"spinlock_wait_cycles":13063680,"thread_start_us":330942,"threads_started":1,"wal-append.queue_time_us":591212}
I20260709 13:03:49.847671  7000 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:49.828517  7410 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:03:49.858399  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.815760  7303 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.861258  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:49.816072  7068 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:49.836885  7411 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:49.813422  7199 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:49.850117  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.851650  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.852213  7349 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.852425  6743 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:49.832567  7428 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:49.818921  7414 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.853444  7246 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.803669  7309 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.866559  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:49.888963  7092 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:49.898010  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 130538us
I20260709 13:03:49.798856  7423 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.856418  1427 catalog_manager.cc:5697] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.910185  7429 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:49.922791  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56317.5us
I20260709 13:03:49.919970  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.919555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.919538  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:49.811947  7418 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.935061  1498 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:49.915251  7349 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.918463  7246 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.941218  7246 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.939242  7349 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.950906  7349 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:49.910349  7198 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:49.959097  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.962181  1679 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:49.911912  6743 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:49.915132  7414 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.926836  7323 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.917279  7434 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:49.913498  6801 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:49.914243  7248 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.931232  7433 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.028363  7198 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.018429  7434 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.057646  7248 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.032128  7309 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:50.038339  7418 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.039196  7407 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.916465  7428 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:50.058832  7401 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:50.041486  7257 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.014834  7323 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.007135  7092 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:50.043970  7312 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:50.002740  6854 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:49.928704  6996 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
W20260709 13:03:50.049490  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 245204us
I20260709 13:03:50.051139  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.058861  1530 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:50.065995  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.058327  7434 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.041741  7423 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:50.082520  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 147547us
I20260709 13:03:50.120005  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:50.121706  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:50.066198  7260 consensus_meta.cc:287] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 13:03:49.932629  7429 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.073897  7406 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.099319  7394 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:50.102759  7312 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.128023  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.128604  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.147558  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.148504  1610 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:50.129357  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.130311  7198 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.151912  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.096844  7436 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.095849  7248 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.135569  1532 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:50.137902  1681 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:50.127420  1602 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:03:50.155046  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.146490  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.168541  1607 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:50.124117  7418 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.130345  7428 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.087203  6743 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.146857  7068 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:50.141896  7437 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.172447  7440 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:50.165748  7421 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.175252  7248 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.193377  7437 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.170856  7436 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.201913  1609 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:50.203111  7437 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.164573  7198 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.204421  7440 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.194303  7068 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.165970  7406 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.221370  7248 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.203856  7436 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.204713  7421 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.222426  7440 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.224109  7246 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.207647  7433 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:50.179328  7418 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.224817  7068 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.240530  7436 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.250669  7436 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.252766  7436 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.207980  7092 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:03:50.248698  7443 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:50.249342  7246 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.263440  7323 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.266731  7440 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.268412  7418 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.269369  7257 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:50.284888  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.292979  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.294706  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.296131  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.298310  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.299105  1603 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.297065  1679 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:50.306912  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:50.320211  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 176113us
I20260709 13:03:50.321909  1679 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:50.322940  1603 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:03:50.322412  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.227957  7303 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.327627  7303 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:50.304680  7407 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.329017  7068 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.331481  7068 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.333153  7429 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.335620  1675 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:50.337085  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109657us
I20260709 13:03:50.337193  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.305611  7440 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.336767  6783 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:50.341588  7407 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.256106  7433 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.345459  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.342058  6783 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.337764  7068 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.342432  7312 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.342180  7407 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.344818  7246 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:50.351953  7198 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.351354  1498 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:50.356554  7382 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:50.356976  7382 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.357333  7382 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.361203  7406 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.345329  7440 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.362951  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.363099  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.366689  7380 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.361748  6783 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:50.380066  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.354020  7453 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.382089  7406 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:50.383220  7248 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:50.349285  7414 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.389251  7447 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.390148  7414 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.389874  7447 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.391527  7004 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.392922  7440 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.354897  7068 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.397719  7301 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.379261  7312 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.400215  7248 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.400902  7248 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.401250  7000 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:50.401798  7000 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.403313  7248 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.399736  7068 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.373588  7382 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.409559  7420 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:50.410096  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.421296  7382 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:50.421605  7210 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:03:50.421712  7454 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.424192  7420 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.426921  7349 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:50.412292  7000 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.429343  7394 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.441473  7394 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.443094  7349 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.430315  7433 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.430788  7220 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.445467  7349 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.405874  7447 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.436120  7208 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:50.449519  7295 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:50.452111  7420 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.457156  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.458491  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.459523  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.460703  1676 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:50.461000  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.461839  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.462113  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.462713  1680 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:50.460681  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.464314  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.465371  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.466399  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.467542  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.473058  1676 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:50.477157  7000 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.483096  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.483892  1531 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:50.486639  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:50.487682  1527 raft_consensus.cc:2368] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20.
I20260709 13:03:50.478330  7437 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:50.490983  7437 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.493093  7437 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.495023  6743 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.489631  7000 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.499825  1529 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:03:50.512813  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:50.522130  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.523100  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.524237  1531 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:50.524535  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.524716  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.525099  1528 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:50.526037  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.523325  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.527323  1535 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:50.528218  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.527339  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.529168  1531 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:50.529502  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.447567  7454 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.530907  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.534317  1527 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:50.535257  1528 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:50.536324  7095 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:50.551688  7439 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 13:03:50.553197  7407 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.554734  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.555454  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.555475  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.568291  1676 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.568619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.568960  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.569255  1532 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:50.570147  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.570705  1678 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.572692  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.572961  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.573761  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.573894  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.574417  1683 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:50.574761  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.575167  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.556381  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:50.576321  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.557322  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.575840  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.581444  1532 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:50.577437  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:50.582587  6996 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:50.582800  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.582343  1427 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.561686  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.563545  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.585476  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.585572  1676 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:50.564687  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.586236  1527 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:50.586522  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.586892  6854 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.587057  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.583889  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.587922  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.588143  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.558317  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.588819  1529 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:50.518967  7000 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.589159  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:50.588558  1531 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:50.583139  6996 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:50.593669  1501 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.597057  1678 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:50.604488  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:50.605178  1678 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:50.606454  1683 raft_consensus.cc:1240] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:50.608392  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.604769  1501 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:50.609305  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.612491  1609 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:50.612912  7454 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.589052  1527 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:50.616864  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:50.620852  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:50.622442  7433 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.624814  7433 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:50.625240  7433 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.626538  1678 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
W20260709 13:03:50.627270  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 283324us
I20260709 13:03:50.639439  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.646937  1679 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.609763  7246 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.675204  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.676558  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.677982  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.679499  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.680549  1607 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:50.681553  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.682179  1607 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:50.682677  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43619us
I20260709 13:03:50.683423  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.614159  7437 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.684926  1535 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:50.686439  1679 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:50.677289  1608 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:50.695401  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.698483  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.699621  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.700440  1605 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.699677  1608 raft_consensus.cc:2393] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:50.638566  7447 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:50.718475  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.617923  7000 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:50.723222  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.725805  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.728854  1607 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:50.728979  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.730005  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.731379  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.732197  1606 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.669377  7297 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.734081  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.743438  1605 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:50.592898  6996 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:50.744899  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51903.1us
I20260709 13:03:50.838655  6684 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:50.839442  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.843557  1605 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.759302  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.847013  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:50.764992  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56931us
I20260709 13:03:50.848774  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.766117  7440 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:50.767763  7292 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:50.768540  6994 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:50.775027  7421 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:50.781288  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 106433us
I20260709 13:03:50.870586  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:50.790647  7448 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:50.797591  7113 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.728492  7399 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:50.801178  7302 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.803603  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.719152  7437 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.667959  7394 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.725361  7447 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.735991  7000 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:50.811463  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.812733  7413 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.816596  7266 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.820523  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.824302  1526 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 13. Current term is 15. Ops: []
I20260709 13:03:50.825246  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:50.955495  1533 raft_consensus.cc:2393] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:50.827234  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:50.828090  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:50.829025  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.830199  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:50.834571  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:50.841284  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.745157  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:50.960633  1607 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:03:50.748780  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55797.6us
I20260709 13:03:50.845012  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:50.852371  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:50.871850  1574 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:50.880645  6684 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:50.867929  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:50.886003  1605 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:50.898702  1606 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:50.860737  7456 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:50.965838  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 113637us
I20260709 13:03:50.967200  1535 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:50.970580  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 125623us
I20260709 13:03:50.975250  1529 raft_consensus.cc:2393] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:03:50.976792  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 105014us
I20260709 13:03:50.977739  6684 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.981494  1604 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:50.978130  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:50.983271  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:50.984076  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82767.7us
I20260709 13:03:50.948349  7447 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:50.890687  7438 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:03:50.993258  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:50.995236  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:50.971148  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.005330  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:50.880942  7292 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:51.015018  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 158) took 37291 ms (client timeout 15000 ms). Trace:
I20260709 13:03:51.015273  1648 leader_election.cc:400] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20.
I20260709 13:03:51.015585  1648 leader_election.cc:403] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:51.016878  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.017078  6994 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:51.018050  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.018886  1610 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:51.033527  7000 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:51.035707  7466 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:50.965751  7266 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.038087  7266 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.038251  7437 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.040093  7394 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:50.903752  7113 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.998457  7432 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:51.047009  7432 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.047436  7432 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:50.990703  7420 consensus_queue.cc:1059] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:03:51.049499  7420 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:51.049906  7420 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:51.050823  7420 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:51.053934  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 48698.1us
I20260709 13:03:51.055513  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.056864  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:50.942795  7433 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:50.992841  7349 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:51.057572  7349 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.057967  7349 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.058838  7433 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.060269  1535 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:51.061117  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:51.062474  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 67298.7us
I20260709 13:03:51.064759  1576 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:51.046546  7113 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:51.068840  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52025us
W20260709 13:03:51.072528  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79324.4us
I20260709 13:03:51.073573  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.075255  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.080565  6684 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.081020  6684 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:51.081754  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71255.3us
I20260709 13:03:50.981021  7416 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.081328  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.081346  6684 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:51.085147  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 114073us
I20260709 13:03:51.085673  1498 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.087086  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.085907  1501 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:50.999711  7434 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.093253  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.082325  7433 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.012648  7301 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:51.095691  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.103960  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.080624  7420 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.091621  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:51.015473  1430 rpcz_store.cc:269] 0709 13:03:13.723716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.724523 (+   807us) service_pool.cc:224] Handling call
0709 13:03:51.014926 (+37290403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:45.288689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:45.289451 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:45.289505 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:03:45.289524 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:45.294008 (+  4484us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:45.294099 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:45.294126 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:03:45.349864 (+ 55738us) tablet.cc:701] Row locks acquired
0709 13:03:45.368715 (+ 18851us) write_op.cc:260] PREPARE: finished
0709 13:03:45.422396 (+ 53681us) write_op.cc:270] Start()
0709 13:03:45.435242 (+ 12846us) write_op.cc:276] Timestamp: P: 1783602225383368 usec, L: 0
0709 13:03:45.446760 (+ 11518us) op_driver.cc:348] REPLICATION: starting
0709 13:03:45.461672 (+ 14912us) log.cc:844] Serialized 6745 byte log entry
0709 13:03:46.149814 (+688142us) op_driver.cc:464] REPLICATION: finished
0709 13:03:46.377549 (+227735us) write_op.cc:301] APPLY: starting
0709 13:03:46.377673 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:46.662929 (+285256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:46.663070 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:47.123198 (+460128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:47.123753 (+   555us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:03:47.123851 (+    98us) write_op.cc:312] APPLY: finished
0709 13:03:47.180474 (+ 56623us) log.cc:844] Serialized 155 byte log entry
0709 13:03:47.378985 (+198511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:47.436622 (+ 57637us) write_op.cc:454] Released schema lock
0709 13:03:47.446037 (+  9415us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:47.561058 (+115021us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:47.567452 (+  6394us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32124,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":227341,"apply.run_cpu_time_us":45807,"apply.run_wall_time_us":1104288,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":55066,"prepare.run_cpu_time_us":15981,"prepare.run_wall_time_us":335766,"raft.queue_time_us":254880,"raft.run_cpu_time_us":34647,"raft.run_wall_time_us":126193,"replication_time_us":696882,"spinlock_wait_cycles":1410816,"thread_start_us":578245,"threads_started":5,"wal-append.queue_time_us":389087,"wal-append.run_cpu_time_us":33102,"wal-append.run_wall_time_us":2392752}]]}
I20260709 13:03:51.084492  7440 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:51.071784  7441 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:51.076925  7295 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:50.966006  7413 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.094647  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:51.083122  7418 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:51.084811  7112 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20.
I20260709 13:03:51.205987  7413 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.093429  7437 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:51.118902  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.089809  7394 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:51.211798  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 92993.6us
I20260709 13:03:51.087265  7416 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.089232  7457 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:51.219621  7295 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.094321  7210 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.096370  7000 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:51.200729  7095 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.131837  7440 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.242862  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.243206  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.243567  1684 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:51.244426  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.244673  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.129671  7418 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:51.244982  1684 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 12.
I20260709 13:03:51.245468  7440 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.077441  7198 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:03:51.097985  7412 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:51.254009  7418 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.258419  7259 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:51.260298  7112 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:51.097608  7454 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.097427  7456 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:51.129628  7297 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.261663  7456 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.261955  7292 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:51.261741  7297 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.262897  7456 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.167712  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.129213  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.097298  7138 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:51.185513  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 114416us
I20260709 13:03:51.127203  7294 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:51.105332  7323 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:51.126725  7433 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:51.157203  7257 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:51.112982  7301 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.126955  7429 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:03:51.205099  7463 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:03:51.206714  1677 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:51.094607  7004 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.214010  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.096901  7113 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:51.211254  7437 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.219368  7416 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.207492  7208 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.244956  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.260803  7112 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:51.175004  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:51.322187  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 158121us
I20260709 13:03:51.274243  1680 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:51.278853  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:51.281946  7447 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:51.285279  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 186114us
I20260709 13:03:51.339208  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.227756  7000 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.300580  6684 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.328639  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.340420  1604 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:51.312844  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 99064.3us
W20260709 13:03:51.318472  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73599.5us
I20260709 13:03:51.342872  1498 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.253302  7095 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:51.332959  7461 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.370s	user 0.004s	sys 0.000s
I20260709 13:03:51.321486  7454 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:51.358726  7412 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:51.358741  7454 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.360770  7454 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.337815  7113 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.368685  7113 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.352500  6854 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.371605  6854 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.373754  6854 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.317085  7004 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.335052  7432 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.375805  7004 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.376399  1609 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:51.377939  7432 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.376926  7454 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.298058  7294 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.346766  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.351118  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:51.351289  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 72547.5us
I20260709 13:03:51.344673  1498 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.386001  1605 raft_consensus.cc:1240] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:51.317179  7323 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.398706  6684 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.322538  7429 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:03:51.395522  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48851.4us
I20260709 13:03:51.324129  7437 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.394526  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.348613  7297 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.399524  1532 raft_consensus.cc:2393] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:51.404523  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.345712  7000 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.305585  7257 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.348822  7259 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:51.391884  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47417.3us
I20260709 13:03:51.381815  7199 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.415514  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.357926  7433 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.355079  6743 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:51.399461  7432 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:51.401325  7004 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.417402  7264 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:51.418869  7220 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:51.403748  7429 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:51.421590  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.421836  7260 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:51.422108  7292 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.424404  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.425128  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.427877  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.450155  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.429200  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.410071  7112 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.400764  7295 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.413560  6854 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:51.430095  7068 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.476770  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.488847  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.492105  1678 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
W20260709 13:03:51.435516  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 143265us
W20260709 13:03:51.436311  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.022s
I20260709 13:03:51.436154  7479 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:51.337028  7208 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:51.498652  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.014s	sys 0.023s
I20260709 13:03:51.420828  7454 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.451730  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.414911  7259 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.461992  7323 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.500566  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.461449  6854 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.438453  6743 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.496201  7220 consensus_queue.cc:1243] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:51.486652  7349 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.489478  7442 consensus_queue.cc:1059] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:03:51.544461  7481 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:03:51.475682  7092 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:51.554215  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 125081us
W20260709 13:03:51.554930  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 135379us
W20260709 13:03:51.556942  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 105312us
W20260709 13:03:51.559513  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62913.4us
I20260709 13:03:51.594013  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:51.594285  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119064us
I20260709 13:03:51.531379  7292 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:51.542233  7476 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:03:51.568172  6783 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:03:51.600099  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.601053  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.602509  1501 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.575340  6743 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.568549  6854 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:51.576582  7474 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:51.576988  7301 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.500485  7294 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.564874  7259 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.463586  7199 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.596484  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.598805  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:51.553800  7394 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.603297  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.621901  1607 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:03:51.528674  7429 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.607177  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.632601  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.604651  7092 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.617354  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:51.610404  7138 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:51.621037  7095 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.634614  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.616701  1605 raft_consensus.cc:2368] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
W20260709 13:03:51.652701  7477 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:03:51.654163  1605 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:51.641690  1574 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.656582  7438 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:51.637868  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:51.657249  7198 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:51.657701  1609 raft_consensus.cc:2393] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:51.657657  7198 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.658147  7198 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.646831  1648 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.659315  7113 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.649533  7257 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.660349  7257 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.640159  7210 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:03:51.659859  7113 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.661684  7210 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:51.662055  7210 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:51.662849  7210 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.663408  7113 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:51.655915  7420 consensus_meta.cc:287] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 13:03:51.633474  7394 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.614372  7199 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.665129  7199 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.665335  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.667620  7441 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.625011  7447 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.668011  7441 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:51.668555  7441 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.659771  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.676260  1648 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.677476  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.678141  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.683125  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.684161  1679 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:51.695282  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.695703  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:51.696558  1605 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:51.698271  7493 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:51.698957  1648 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.700151  7493 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.713023  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.708420  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.713135  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:51.715664  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.716233  7447 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:51.716324  1529 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:51.716934  7447 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.717412  7447 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.717896  1529 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:03:51.706277  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.719290  1531 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:51.724840  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:51.726676  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.723781  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.717664  7421 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:51.728229  7421 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:51.729146  7421 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.736768  1526 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:03:51.737231  1526 pending_rounds.cc:85] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 11
I20260709 13:03:51.737447  1526 pending_rounds.cc:107] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:03:51.737656  1526 raft_consensus.cc:2889] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.740773  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:51.741581  1678 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.743547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:51.744174  1676 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
W20260709 13:03:51.744469  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.676075  7429 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:51.645888  7068 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:51.749554  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:51.674559  7442 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.673451  7349 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:51.753959  1647 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:51.730520  7421 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.651815  7418 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.672003  7208 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:51.762424  1678 raft_consensus.cc:2468] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:51.713291  7210 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.705894  7409 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.711705  7438 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:51.776468  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 118470us
I20260709 13:03:51.777616  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.779330  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:51.685659  7292 consensus_queue.cc:1175] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6031790cc44edfba5c3964e6f27c6e" responder_term: 19 status { last_received { term: 19 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 19 index: 8 } }
I20260709 13:03:51.714354  7434 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:51.782361  7004 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:51.783077  1498 leader_election.cc:400] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:03:51.789459  1678 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:51.771351  7266 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:51.879153  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 96216.8us
I20260709 13:03:51.785593  1601 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:51.851646   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:51.880722  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.770566  7068 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:51.902267  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.902529  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.903446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:51.785377  7503 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.918205  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.918394  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:51.902601  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:51.915840  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.788003  7095 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:51.883946  7489 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:03:51.896591  7490 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:03:51.877171  7004 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.883584  7266 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.931298  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:51.937601  1529 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:51.785265  7092 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.941874  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:51.942523  1526 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:51.903566  7294 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:51.933252  7004 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:51.980813  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 234771us
I20260709 13:03:51.931864  7266 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:51.978911  7497 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:03:51.985589  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.005404  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:03:52.006183  1529 raft_consensus.cc:606] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:51.932126  7095 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:51.972704  7198 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:51.924247  7503 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:52.113850  7504 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:03:52.125914  7496 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:03:52.126969  7095 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:52.129479  7418 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.129694  7416 consensus_meta.cc:287] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.000s
W20260709 13:03:52.129834  6854 consensus_meta.cc:287] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.000s
I20260709 13:03:52.130122  7416 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:52.130740  7473 log.cc:927] Time spent T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:03:52.135807  7493 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.136893  7441 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.011508  7068 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.140329  7503 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.141708  7498 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:03:52.142307  7198 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.146625  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
W20260709 13:03:52.176549  7000 consensus_meta.cc:287] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.000s
I20260709 13:03:52.202879  1535 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:52.135314  7199 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:52.176808  7463 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:03:52.204991  1683 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:52.176426  7412 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.207410  1675 raft_consensus.cc:606] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.207816  1675 raft_consensus.cc:614] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:52.209743  7199 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.210340  1605 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.194645  6854 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.212108  1532 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 13: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:52.212880  7412 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.213725  6854 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.215533  7412 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:52.220233  7501 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:03:52.263461  1607 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:52.311896  7416 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.317627  7437 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.005s
I20260709 13:03:52.318290  7437 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.323738  7416 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.324885  7416 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.206902  7000 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.337018  7454 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.348755  7454 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.351466  7454 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.330421  7441 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.328004  7416 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.339262  1602 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:52.353391  7454 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.354139  7454 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.360658  6854 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.218241  7447 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.361459  6854 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.363440  1526 raft_consensus.cc:1240] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.365464  7447 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.371057  7259 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.740s	user 0.003s	sys 0.006s
I20260709 13:03:52.377319  7259 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.378379  7454 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.427943  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.360713  7004 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:52.432803  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.016s	sys 0.069s
W20260709 13:03:52.433320  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.017s	sys 0.069s
W20260709 13:03:52.433619  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 634376us
I20260709 13:03:52.339020  7000 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.447768  1677 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:52.449071  7457 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:52.449579  7112 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.452199  7502 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:52.456947  7210 consensus_meta.cc:287] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.003s
I20260709 13:03:52.446925  7416 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:52.460737  7416 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:52.448628  7421 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
W20260709 13:03:52.444720  7429 consensus_meta.cc:287] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.002s
W20260709 13:03:52.442689  7479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.020s	sys 0.066s
I20260709 13:03:52.469063  7502 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.469084  7493 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.472146  7493 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.472735  7259 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:52.475270  7493 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:52.449594  6854 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.480077  7494 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.484493  7495 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:52.487888  7004 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.492828  7495 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.495098  7495 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.496088  7502 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.498718  7394 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.512570  1681 raft_consensus.cc:2410] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 22 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:03:52.509943  7437 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.515031  7266 consensus_meta.cc:287] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:03:52.517621  7266 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.519065  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.519649  1531 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.528339  7266 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:52.529533  7416 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.551749  7499 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.579s	user 0.000s	sys 0.009s
I20260709 13:03:52.553395  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:52.580399  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 662026us
I20260709 13:03:52.554075  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.554939  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:52.560899  7491 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.987s	user 0.011s	sys 0.009s
W20260709 13:03:52.563064  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.567358  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:52.568403  7515 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:03:52.595534  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.568807  1679 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:52.570339  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.571048  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.572381  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.571722  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.580399  7138 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:52.553689  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.599053  1530 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.599526  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.600216  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.583958  1532 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:52.543746  1531 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:52.586701  1574 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.592275  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2813) took 1155 ms. Trace:
I20260709 13:03:52.593061  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:52.597898  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.598176  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.601548  1681 rpcz_store.cc:276] 0709 13:03:51.421381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.488467 (+ 67086us) service_pool.cc:224] Handling call
0709 13:03:52.576538 (+1088071us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002d32d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:52.576642 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346924928}
I20260709 13:03:52.611568  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:52.614104  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.614045  1676 raft_consensus.cc:1240] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.595028  7208 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:52.625356  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2878) took 1534 ms. Trace:
I20260709 13:03:52.625967  1610 rpcz_store.cc:276] 0709 13:03:51.091135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.092327 (+  1192us) service_pool.cc:224] Handling call
0709 13:03:51.095631 (+  3304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.352933 (+257302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.352981 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.353616 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:03:51.548666 (+195050us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:51.548712 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.548798 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.560331 (+1011533us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694eb2c85 00007f4694eb36a2 00007f4697c251db 00007f4697c20aaf 00007f4697c1486e 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221 00007f4697c1d1d9 00007f4697c1d169
0709 13:03:52.625000 (+ 64669us) raft_consensus.cc:1685] finished
0709 13:03:52.625032 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.625276 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27386,"raft.queue_time_us":17001,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":7997,"spinlock_wait_cycles":37382912,"thread_start_us":450783,"threads_started":2,"wal-append.queue_time_us":204099}
I20260709 13:03:52.630828  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:52.639168  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 653641us
I20260709 13:03:52.640563  1576 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.610615  7493 consensus_queue.cc:1059] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:03:52.645337  1605 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:52.621083  6996 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:52.653479  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.653224  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.654178  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.656683  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.625528  7208 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.662211  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.658722  1684 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:52.660894  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.667867  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.669385  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.670982  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.671847  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.671031  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.672580  1608 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
W20260709 13:03:52.679774  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70625.3us
I20260709 13:03:52.647017  7301 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:52.645220  7092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.031s	sys 0.112s
W20260709 13:03:52.687239  7092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.032s	sys 0.112s
I20260709 13:03:52.685779  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:52.688256  1608 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.658316  7349 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.684263  1680 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:52.662886  7138 raft_consensus.cc:2804] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:52.685612  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99051us
I20260709 13:03:52.693075  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.693216  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:52.693713  1606 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:52.657735  6996 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:52.696723  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 65983.4us
I20260709 13:03:52.686012  1501 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.678509  7394 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.672452  7511 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.662590  7113 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:52.703655  1608 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:52.706449  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.707156  1606 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.690973  7199 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.692476  7349 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.726606  7349 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.727469  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2689) took 1025 ms. Trace:
I20260709 13:03:52.727844  1535 rpcz_store.cc:276] 0709 13:03:51.702454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.704952 (+  2498us) service_pool.cc:224] Handling call
0709 13:03:51.722476 (+ 17524us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:51.722664 (+   188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.203413 (+480749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.727215 (+523802us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540003fa54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:52.727408 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107350144}
I20260709 13:03:52.715497  7429 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.729866  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39172 (request call id 2814) took 1308 ms. Trace:
I20260709 13:03:52.730042  7429 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.730275  1677 rpcz_store.cc:276] 0709 13:03:51.421619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.476444 (+ 54825us) service_pool.cc:224] Handling call
0709 13:03:52.729680 (+1253236us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400030cd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:52.729811 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226174720}
I20260709 13:03:52.734740  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35640 (request call id 2694) took 1131 ms. Trace:
I20260709 13:03:52.735582  7349 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.739627  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:52.740442  1675 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.741398  7257 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:52.742003  7257 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:52.743240  1675 raft_consensus.cc:614] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:52.743057  7257 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.735193  1601 rpcz_store.cc:276] 0709 13:03:51.603827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.604108 (+   281us) service_pool.cc:224] Handling call
0709 13:03:51.606166 (+  2058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.879880 (+273714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.734531 (+854651us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001c7ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:52.734683 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412118784}
I20260709 13:03:52.746434  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:52.745368  7349 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:52.750617  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44235.3us
I20260709 13:03:52.754455  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.756186  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:52.710233  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:52.711460  7506 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.775s	user 0.000s	sys 0.010s
I20260709 13:03:52.759075  1601 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:52.759488  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.711959  7208 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:52.703378  7210 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.715801  7437 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:52.716414  7138 raft_consensus.cc:697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:52.708926  7511 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.724524  6996 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.706182  7394 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.703264  7407 consensus_queue.cc:1059] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:03:52.755700  7209 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:52.784297  7220 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:52.774590  7004 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:52.785241  7004 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.785182  7220 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:52.787503  7004 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.762957  7301 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:03:52.755059  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:52.790884  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.756103  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:52.755719  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.793558  1604 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:52.749246  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:52.794823  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 45640.8us
I20260709 13:03:52.796048  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.797262  1675 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.797961  7456 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.798391  7456 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:52.798766  7456 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.799593  7407 raft_consensus.cc:3055] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:52.800055  7407 raft_consensus.cc:740] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:52.800397  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.801559  1675 raft_consensus.cc:614] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:52.800823  7407 consensus_queue.cc:260] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.803121  7407 raft_consensus.cc:3060] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.702772  7525 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.772224  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.830672  1680 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:52.833163  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.780298  7429 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.787941  7220 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:52.806669  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:52.763803  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.815925  1604 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:52.757295  1606 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:52.843174  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:52.864049  1603 raft_consensus.cc:1240] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.840130  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.840256  1535 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:52.841681  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:52.783710  7257 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.879483  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.880484  1527 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.843655  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.864923  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.809816  7511 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.849472  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.848080  1610 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 17: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:52.872566  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:52.848009  7440 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:52.871379  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.772778  1530 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:52.883067  1601 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:52.830029  7421 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:03:52.892637  7516 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:03:52.894089  7516 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:52.894552  7516 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:52.884567  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.872745  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.866043  6854 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:52.898439  7494 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.898865  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.899132  7494 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:52.885872  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.899936  7394 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.900887  7494 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:52.878397  7068 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:03:52.841440  7138 consensus_queue.cc:237] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.906960  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.909818  1533 raft_consensus.cc:1240] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:52.895730  7516 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.914182  7297 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.916602  7421 consensus_queue.cc:1243] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:52.865543  7412 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:03:52.919682  7412 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:52.920433  7412 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:52.921557  7412 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.922827  7412 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:52.925719  7519 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:03:52.927074  7529 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:52.928213  7516 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.930440  1527 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
W20260709 13:03:52.886685  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 193540us
I20260709 13:03:52.931550  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2236) took 1013 ms. Trace:
I20260709 13:03:52.932054  1526 rpcz_store.cc:276] 0709 13:03:51.917841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.980584 (+ 62743us) service_pool.cc:224] Handling call
0709 13:03:51.999507 (+ 18923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.363962 (+364455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.931295 (+567333us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540020a154. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:52.931489 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836352768}
I20260709 13:03:52.933677  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:52.935499  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:52.936198  1534 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.889505  1647 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.936997  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:52.937325  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.829339  7456 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:52.940801  1675 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:52.942509  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.943255  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.943771  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:52.943830  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:52.944123  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:52.911749  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2228) took 1007 ms. Trace:
I20260709 13:03:52.956095  1574 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.958633  1533 rpcz_store.cc:276] 0709 13:03:51.904581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.908818 (+  4237us) service_pool.cc:224] Handling call
0709 13:03:52.577394 (+668576us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:03:52.577561 (+   167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.910307 (+332746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.911503 (+  1196us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400440a54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:52.911683 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766294784}
I20260709 13:03:52.961314  1498 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.963141  1679 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:52.964196  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.966208  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.969640  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.952615  7511 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:52.952749  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 63317.5us
I20260709 13:03:52.982215  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:52.974507  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:52.982450  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.983258  1679 raft_consensus.cc:606] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.983690  1679 raft_consensus.cc:614] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:52.984797  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:52.976698  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.989141  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:52.989843  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 2231) took 1073 ms. Trace:
I20260709 13:03:52.990248  1534 rpcz_store.cc:276] 0709 13:03:51.916561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.917087 (+   526us) service_pool.cc:224] Handling call
0709 13:03:52.935338 (+1018251us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800000c98. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d03f0a0 00007f469d03e984 00007f46965b96d4 00007f46965b9662
0709 13:03:52.989767 (+ 54429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532736}
I20260709 13:03:52.972849  7297 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:52.952710  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 187149us
I20260709 13:03:52.988727  1576 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.966706  7441 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:52.967553  6854 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.961920  7437 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:52.956175  7301 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:53.036559  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 79394.8us
I20260709 13:03:52.950994  7440 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:53.113669  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 137056us
I20260709 13:03:52.971781  7068 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:53.113166  1610 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:03:53.126907  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 138270us
I20260709 13:03:53.127766  1576 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:52.992733  7503 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:53.129029  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 144324us
W20260709 13:03:53.127781  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 106386us
I20260709 13:03:52.971593  7447 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:53.130892  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 94126.9us
W20260709 13:03:53.118335  7508 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:52.968564  7349 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:03:53.020377  7494 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.193758  7394 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.194284  7394 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.196063  6854 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.196195  7479 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.196501  7349 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:53.196751  7394 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.196966  7349 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:53.035270  6783 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:53.036448  7208 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:53.138315  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:53.040679  7433 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:53.145386  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.129230  7511 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:53.137760  7441 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:53.198518  7208 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:53.207188  7441 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:53.199156  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60954us
I20260709 13:03:53.197866  7349 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.204603   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:53.180374  7220 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:53.181026  7259 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:53.181577  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 46856.3us
W20260709 13:03:53.188735  7533 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:03:53.192344  7532 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:53.127897  7437 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.197698  7456 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:52.966032  7323 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.168s
I20260709 13:03:53.205969  6684 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:53.205823  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 78143.6us
I20260709 13:03:53.233579  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:53.146309  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 2882) took 2044 ms. Trace:
I20260709 13:03:53.213420  7349 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:53.212875  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:53.224584  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.112843  7297 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.203898  7509 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.202450  7413 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:53.234318  1602 rpcz_store.cc:276] 0709 13:03:51.102359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.103305 (+   946us) service_pool.cc:224] Handling call
0709 13:03:51.103575 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.353686 (+1250111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.145972 (+792286us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400247f54. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:53.146231 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841257216}
I20260709 13:03:53.204977  6743 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.202895  7537 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:53.199198  7440 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.262064  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:53.269773  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57032us
I20260709 13:03:53.280972  7302 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:53.230736  7437 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:53.202206  7407 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:53.196630  6854 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.196769  7479 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.294019  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:53.298044  1533 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:53.298453  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:53.300733  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.301692  1527 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:53.302760  6684 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:53.231261  7259 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.207743  7208 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.235936  7257 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:03:53.269748  7138 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.307854  7259 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.260108  7502 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:03:53.291595  7220 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:53.294898  7525 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:53.313398  7394 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:53.281558  7509 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.269227  7297 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.313925  7302 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:53.315987  7535 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:03:53.350611  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 215536us
I20260709 13:03:53.360594  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:53.327906  7442 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.286844  6743 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.373593  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:53.405510  7394 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:53.406361  7394 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.365744  7525 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:53.346578  7220 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.412330  7551 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.369174  7535 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:53.430276  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56800.5us
W20260709 13:03:53.430810  1574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34325 timed out after 1.705s (SENT) [suppressed 25 similar messages]
I20260709 13:03:53.419020  7548 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.370839  7442 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.435549  7440 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:53.444918  7545 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:03:53.436967  7257 consensus_queue.cc:1243] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:53.432979  7456 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:53.476738  7220 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.477005  7559 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:53.474615  6854 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.478080  7559 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:53.478478  7559 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:53.479050  7544 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:53.479590  7539 log.cc:927] Time spent T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:03:53.432488  7302 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.420809  7525 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.450233  7004 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:53.481226  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50470.3us
W20260709 13:03:53.492695  7534 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:03:53.479945  6996 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.510978  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:53.507748  7479 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.444533  7548 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:53.586903  7412 consensus_meta.cc:287] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.664s	user 0.016s	sys 0.002s
W20260709 13:03:53.587685  7516 consensus_meta.cc:287] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.011s
I20260709 13:03:53.583830  7509 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.582813  7301 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:53.595397  7301 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.512262  7004 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.506559  7442 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.475266  7456 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.529718  7559 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.601641  7413 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.601863  7559 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:53.603493  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:53.607548  7260 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:53.616269  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.621384  1605 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:53.616217  7301 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:53.636098  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 301273us
I20260709 13:03:53.617509  7421 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:53.632984  7561 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:53.633132  7199 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:53.655885  7199 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:53.656841  7199 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.659463  7260 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.637935  7138 consensus_queue.cc:1059] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:53.665179  7138 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:53.665693  7138 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:53.666806  7138 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.649672  7535 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.633175  7297 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.654863  7437 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.632802  7511 consensus_queue.cc:1059] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:03:53.642980  7421 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:53.633414  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 54860us
I20260709 13:03:53.635251  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.724992  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:53.725468  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.728372  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.729518  1681 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:53.731635  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.733666  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.734423  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:53.734724  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:53.736598  1531 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:53.678166  7138 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:53.744524  7297 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:53.681527  7441 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:53.747104  7441 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:53.747687  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.731999  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.745597  7297 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.744786  7301 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.733716  1675 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:53.749147  7441 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.683928  7525 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.763252  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:53.764598  1531 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:53.766830   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:53.768210  7421 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.771080  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:53.774331  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:53.776870  7349 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:53.777432  7349 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.777727  7199 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:53.778362  7199 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.778859  7199 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.780408  7441 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.780704  6783 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:53.777858  7349 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:53.781394  6783 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.782900  7511 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:53.784940  7297 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:53.787212  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 353810us
I20260709 13:03:53.787784  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.801180  7210 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:53.801766  7210 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:53.803107  7210 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.804208  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.806435  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.807343  1677 raft_consensus.cc:2410] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:03:53.810958  1677 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:53.813881  7210 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.817289  7548 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:53.820324  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.822800  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.823591  1534 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:53.826517  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.826759  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.827523  1526 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:53.829929  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:53.831036  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 579986us
I20260709 13:03:53.832078  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:53.827642  1534 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:53.833318  1527 raft_consensus.cc:2376] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16. Re-sending same reply.
I20260709 13:03:53.834425  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.837566  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2300) took 2096 ms. Trace:
I20260709 13:03:53.838168  1683 rpcz_store.cc:276] 0709 13:03:51.740634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.741105 (+   471us) service_pool.cc:224] Handling call
0709 13:03:51.741322 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.207241 (+465919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.836898 (+1629657us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002d41d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:53.837309 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065897216}
I20260709 13:03:53.839581  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.834587  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.844089  6743 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.853696  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:53.854846  6743 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.855494  6743 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:53.856042  6743 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.868149  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:53.869699  7540 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.589s	user 0.003s	sys 0.000s
I20260709 13:03:53.871011  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2301) took 1222 ms. Trace:
I20260709 13:03:53.871479  1676 rpcz_store.cc:276] 0709 13:03:52.648547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.651588 (+  3041us) service_pool.cc:224] Handling call
0709 13:03:52.744542 (+ 92954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.744714 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.744740 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.744779 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:52.744823 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.744879 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.870663 (+1125784us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b540041b750. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f46980788ad 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:53.870838 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213126400}
I20260709 13:03:53.872939  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:53.885433  7394 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.841917  1675 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:53.888230  7456 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.898408  7421 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.909760  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:53.891292  7394 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.918803  7394 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.922585  7004 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.917676  1535 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:53.939090  6743 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:53.943185  7199 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.947490  7394 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:53.948163  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.949105  7199 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.949857  7409 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.950620  7409 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.951870  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.952280  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.953347  1606 raft_consensus.cc:2368] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:53.954044  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.954298  7429 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:53.954768  1601 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:03:53.955145  7429 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.955971  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.956606  1603 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:53.957672  7429 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.959779  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.962139  7409 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:53.967533  6743 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:53.968555  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:53.975014  7264 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.982412  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:53.985932  7264 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:53.987249  7437 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:53.988565  7264 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:53.989372  1418 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 443ffcfd9be74d9891a8cb9596947ca3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 7 but the committed config has opid_index of 11
I20260709 13:03:53.989565  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:03:53.997957  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 58) took 13577 ms (client timeout 15000 ms). Trace:
I20260709 13:03:54.001156  1610 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.008675  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:54.034616  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54894.7us
I20260709 13:03:54.045457  1603 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:54.047616  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.050410  6783 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:54.043641  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 50352.9us
I20260709 13:03:54.053205  1681 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:54.054633  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.055425  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.056208  1535 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:54.052740  7349 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.058831  7349 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.060163  6783 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:53.998495  1427 rpcz_store.cc:269] 0709 13:03:40.420519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.420784 (+   265us) service_pool.cc:224] Handling call
0709 13:03:53.997697 (+13576913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:51.558057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:51.584766 (+ 26709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:51.584817 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:03:51.584842 (+    25us) tablet.cc:662] Decoding operations
0709 13:03:51.585558 (+   716us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:51.585655 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:51.585694 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:51.586111 (+   417us) tablet.cc:701] Row locks acquired
0709 13:03:51.586136 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:03:51.586326 (+   190us) write_op.cc:270] Start()
0709 13:03:51.586470 (+   144us) write_op.cc:276] Timestamp: P: 1783602231586261 usec, L: 0
0709 13:03:51.586500 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:03:51.615582 (+ 29082us) log.cc:844] Serialized 1301 byte log entry
0709 13:03:52.503077 (+887495us) op_driver.cc:464] REPLICATION: finished
0709 13:03:52.536241 (+ 33164us) write_op.cc:301] APPLY: starting
0709 13:03:52.537170 (+   929us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:52.574703 (+ 37533us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:52.574907 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:52.637434 (+ 62527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:52.637618 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:03:52.637665 (+    47us) write_op.cc:312] APPLY: finished
0709 13:03:52.637898 (+   233us) log.cc:844] Serialized 40 byte log entry
0709 13:03:52.638070 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.638174 (+   104us) write_op.cc:454] Released schema lock
0709 13:03:52.638216 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:52.638618 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.638647 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2698026,"reported_tablets":6,"spinlock_wait_cycles":7936,"child_traces":[["op",{"apply.queue_time_us":12811,"apply.run_cpu_time_us":7180,"apply.run_wall_time_us":122393,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":514793,"prepare.run_cpu_time_us":14483,"prepare.run_wall_time_us":153996,"raft.queue_time_us":281053,"raft.run_cpu_time_us":5792,"raft.run_wall_time_us":11145,"replication_time_us":916415,"thread_start_us":729038,"threads_started":4,"wal-append.queue_time_us":147540,"wal-append.run_cpu_time_us":46113,"wal-append.run_wall_time_us":1862626}]]}
I20260709 13:03:54.055636  1527 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:03:54.042706  7441 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.068670  7441 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.071287  7441 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.055127  1603 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:54.074191  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.075070  1602 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.072587  1677 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:54.075455  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.076318  1606 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.076648  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:54.077790  1604 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:03:54.082255  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.084256  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.085656  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.088891  1601 raft_consensus.cc:2393] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.090281  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.099748  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.100363  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.101171  1684 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.101337  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.103497  1675 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:54.102258  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.100497  7138 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:54.111204  7138 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:54.111641  7138 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.111954  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.112687  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.113356  1676 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.113926  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.114732  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.096206  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.113946  1605 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:54.118397  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:54.130932  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.130692  1677 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:54.134168  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.136152  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.139183  6783 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.143807  1527 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:54.145829  1675 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:54.150731  6783 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.152179  1681 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:54.153707  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.139743  7199 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:54.162973  6783 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:54.174661  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61097.9us
W20260709 13:03:54.184629  7579 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:54.175662  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.185770  7349 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:54.188925  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.189435  1681 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:54.189908  7349 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:54.190457  7349 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.190894  7349 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.192009  7547 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:54.193502  7051 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:54.189810  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.197568  1684 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:54.151245  7138 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.198599  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.201655  1676 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:54.202020  1605 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:54.194079  7051 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:03:54.205559  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.206152  7051 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:54.206578  7543 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:03:54.208587  1647 leader_election.cc:400] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:54.208950  1647 leader_election.cc:403] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.207782  7051 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.203236  7441 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.211059  1603 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.213490  7494 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:54.214891  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:54.216392  7294 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:54.216884  7294 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.217228  7294 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.218107  7441 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.223153  1535 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:54.224606  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:54.225490  7456 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:54.226388  7456 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:54.226754  7456 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.227165  7456 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.227283  7294 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.228200  7543 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:54.228615  7543 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:54.230211  7543 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.239351  7294 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.231742  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.233245  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.235072  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.237993  7441 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.240093  7543 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.244596  1534 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:54.245012  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 56225.9us
I20260709 13:03:54.246039  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.246726  1535 raft_consensus.cc:2410] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:54.252983  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.254235  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.254683  7409 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.255249  7409 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.256256  7437 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:54.256721  7437 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.256536  7531 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:54.257164  7437 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.258373  7564 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.259104  7564 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.255811  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.223544  7349 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.270860  1576 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.266037  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.259991  7210 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21.
I20260709 13:03:54.256302  7429 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:54.282879  1679 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:54.275746  7531 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:54.284998  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.285660  7531 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.286173  7409 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.286410  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.286899  7210 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:54.286669  7531 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.287307  7210 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.287444  1682 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:03:54.287760  7210 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.288882  6743 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:54.289441  1529 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:54.289810  7198 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:54.290411  6783 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:54.290799  6783 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.291638  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.291471  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.291716  6783 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:54.290428  7409 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.296562  7409 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.290375  7198 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.290787  7294 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:54.304961  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59101us
I20260709 13:03:54.306859  1534 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:54.308303  7493 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:54.293514  7429 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.308219  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.325294  7564 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.298434  7198 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.332423  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.303691  7294 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.336061  7264 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:54.335987  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47932.6us
I20260709 13:03:54.341491  7532 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:54.342403  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.336833  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46237.4us
I20260709 13:03:54.336738  1681 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:54.347800  1675 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:54.345176  7494 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.347880  7264 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.358464  7264 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.358702  7092 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.359311  7092 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.360528  1574 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.362243  7199 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:54.362787  7199 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.362898  7456 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.364239  7532 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.364065  7199 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.366937  7532 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.368427  7092 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.355280  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.358481  7494 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.370254  1677 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.369899  7323 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:54.370824  7323 consensus_queue.cc:1059] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:54.363644  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:54.346565  7294 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.385450  7433 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:54.396330  7433 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:54.397706  7433 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.385226  7429 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.383719  7550 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:54.404022  7550 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:54.405617  7550 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.407351  7550 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:54.408633  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45224.7us
I20260709 13:03:54.409718  7511 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:54.410429  7511 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:54.388504  7437 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.418422  7437 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.389892  7494 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.420953  7349 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.426759  7138 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.432687  7564 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.433298  7564 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.435523  7564 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.447707  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.448266  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.448509  1684 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
W20260709 13:03:54.453845  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 79465us
I20260709 13:03:54.366886  7456 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.460683  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:54.465190  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.449795  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.487759  6743 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:54.489398  1647 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.460280  7493 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.493772  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.477568  7409 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.505970  7257 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:54.486078  7441 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.512614  7441 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.515046  7441 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.501927  7511 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.515839  7511 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:54.516156  7582 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.062s	user 0.000s	sys 0.004s
I20260709 13:03:54.495108  7349 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:54.476984  7394 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.470259  7264 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.524871  1678 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:03:54.525878  7264 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.526886  7210 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.517017  7532 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:54.529786  7532 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.530072  1682 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:54.530221  7532 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.518731  1531 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:54.520448  7349 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.531081  7349 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.531399  7210 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.522930  7394 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.536676  7564 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:54.496454  7437 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:03:54.532814  7257 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:54.499219  7493 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.539577  7564 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:54.572466  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 227302us
I20260709 13:03:54.575352  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.566501  7564 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.632889  6783 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:54.635531  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 266196us
W20260709 13:03:54.646493  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 71252.7us
I20260709 13:03:54.631736  7531 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:54.653998  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 164693us
I20260709 13:03:54.658396  6783 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.664438  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.672147  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.678289  7494 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:54.694430  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 57708.7us
I20260709 13:03:54.630239  7257 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.548312  1428 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:54.706429  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.691308  7511 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:54.704092  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 213626us
W20260709 13:03:54.709955  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45658.6us
I20260709 13:03:54.682118  7531 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.714931  6743 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:54.711247  7409 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:54.731437  7590 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:54.731303  7587 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:54.732275  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.733083  1607 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:54.736545  1428 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.737666  7598 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:03:54.738713  7598 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:54.739094  7598 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:54.740083  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.740346  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.740818  1610 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:54.741642  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:54.743106  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.743256  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.740762  1605 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
W20260709 13:03:54.749063  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 77622.9us
I20260709 13:03:54.743945  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.751065  1602 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:54.738945  1428 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.762280  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.767721  7209 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:54.768213  7209 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:54.768766   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:54.770315  7493 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.775941  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.776808  6783 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:54.777177  6783 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.777452  6783 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.732336  7587 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:54.726851  7429 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.785336  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.790402  7294 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:54.799120  7585 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:54.800158  1428 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.802062  1428 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:54.804144  7429 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.810711  7594 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:54.776085  7409 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:54.812304  7543 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:54.811534  6743 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:54.812873  7543 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.815771  6743 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:54.816339  6743 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.816730  6743 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.782153  7587 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
W20260709 13:03:54.836922  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45564.6us
I20260709 13:03:54.839058  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:54.842612  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 82740.8us
I20260709 13:03:54.845093  7532 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.847177  7595 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:54.793777  7564 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.847795  7595 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:54.857049  1602 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:03:54.863039  6783 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.841848  7543 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.869278  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.870254  6783 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.860198  7595 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:54.877307  6743 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.881503  6743 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.887180  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.803702  1428 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 19, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.891278  7564 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:54.894062  7433 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:54.888247  7543 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:54.891265  1428 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.900662  7323 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:54.900882  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.905548  7209 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.909343  7543 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:54.909657  1498 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.899675  1428 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 16, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.915138  1526 raft_consensus.cc:1275] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:03:54.915556  1526 pending_rounds.cc:85] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 10
I20260709 13:03:54.915808  1526 pending_rounds.cc:107] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:03:54.916106  1526 raft_consensus.cc:2889] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.917791  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.918021  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.918778  1526 raft_consensus.cc:2393] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:54.920149  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.908655  7349 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.910714  7550 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.924746  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.932685  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.935336  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.936200  1676 raft_consensus.cc:2368] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18.
I20260709 13:03:54.935086  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:54.928851  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.929435  7598 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.955088  7598 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.959368  7349 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.961457  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.963260  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.965444  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.966099  1609 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.969357  7294 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:54.972443  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:54.936201  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.941076  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.977365  1526 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.946138  1532 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:54.947221  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.941339  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.944365  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.941304  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.941561  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:54.981609  1604 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.948908  1607 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:54.924160  1428 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.952839  7257 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:54.943292  7587 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:54.950500  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:54.941012  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:54.952996  1601 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:54.952448  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.943579  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.985898  7493 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:55.008088  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:55.009919  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.013091  1533 raft_consensus.cc:2393] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:55.013294  1610 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 16: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:54.987986  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.013270  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.015604  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.014281  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:03:55.017040  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:54.927089  7209 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.949061  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.020494  7494 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.990407  1428 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.008045  7294 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.027194  7595 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.027470  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.028391  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.102571  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:55.103973  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.034498  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:54.998044  7550 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.020527  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.108081  1529 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.988524  7531 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.112293  1501 leader_election.cc:400] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18.
I20260709 13:03:55.112767  1501 leader_election.cc:403] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.990353  7587 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.090746  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.038257  1604 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:55.030906  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.040764  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:55.120951  1532 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.031881  1527 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:55.043803  1609 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:55.103928  1526 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
W20260709 13:03:55.122114  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.122815  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.123401  1526 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.029592  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:54.988349  7257 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.036952  7584 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.116066  1603 raft_consensus.cc:1240] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:03:55.116295  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:55.116955  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.117193  1601 raft_consensus.cc:1240] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:55.124357  1533 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.110150  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.019307  7429 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.139375  1676 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:55.140374  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.036712  7394 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.106591  7437 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:55.147718  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:55.132392  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.136176  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.037737  7493 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.142952  1679 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:55.144170  1647 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.144991  1678 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:03:55.145588  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.154291  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.144403  7531 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.161736  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.162923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.163496  1534 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:55.149587  7604 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:55.164203  7597 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:55.155685  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.165097  7604 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:55.166698  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.167166  7429 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:55.167862  7429 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.170437  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.170917  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.172006  7264 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:55.172336  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.149669  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.127146  7294 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.173420  1528 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 16: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:55.124385  7198 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.174122  7198 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.150127  1535 raft_consensus.cc:2410] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:03:55.174822  7294 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.167196  7604 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.176726  7493 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.176882  7604 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.178169  7604 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.178894  7257 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.174477  1528 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:03:55.039732  7532 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.211979  1532 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:55.201272  7323 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.016428  7441 consensus_queue.cc:1048] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:03:55.107190  7494 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:55.201184  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49685.4us
I20260709 13:03:55.202438  1535 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:03:55.220775  1535 pending_rounds.cc:85] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 12
I20260709 13:03:55.221041  1535 pending_rounds.cc:107] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:03:55.221277  1535 raft_consensus.cc:2889] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:55.203774  1498 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.221724  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:55.205981  1526 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:03:55.224541  1527 raft_consensus.cc:1240] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:55.206723  1675 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:55.147500  7409 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:55.145563  7599 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.172610  7595 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:55.184955  1428 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.209542  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.208678  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:03:55.238552  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.145013  7584 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.212134  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.217114  1680 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:55.218740  1529 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:55.234364  1648 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.238957  1610 raft_consensus.cc:2410] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:55.245134  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.212335  7264 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.224963  7596 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:55.259179  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:55.264462  1607 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:55.263079  6743 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:55.217768  7437 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:55.264936  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61240.8us
I20260709 13:03:55.264946  6743 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.265740  1498 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.231032  7409 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.268445  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.246596  7433 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.271978  1606 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:55.270643  6743 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:55.246938  7532 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.272945  6743 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.271169  6783 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:55.251135  7550 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18.
I20260709 13:03:55.258580  7294 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.230388  7323 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.268611  7198 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.271867  7409 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.272149  7596 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.276537  7264 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.287882  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.292378  1428 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:55.301770  1428 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 19, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:55.304211  1528 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:55.306102  7323 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.281723  7433 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.308842  7433 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.309170  7584 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.283864  7092 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.284240  7294 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.312336  7294 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.300148  7004 consensus_queue.cc:1059] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:03:55.313994  7004 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:55.314383  7004 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:55.316721  7596 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.319479  7433 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:55.272495  7599 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.321605  7433 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:55.321667  7599 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.293074  7494 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.280375  7532 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.324461  1527 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:03:55.324821  7532 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.326239  7594 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.326745  7594 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.327893  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.328790  1678 raft_consensus.cc:2410] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:03:55.329326  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.315261  7004 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.330401  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.330772  1533 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:55.322603  7433 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.331218  1681 raft_consensus.cc:2410] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:03:55.332886  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.333763  1679 raft_consensus.cc:2410] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:55.333666  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.335048  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.339771  1530 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:03:55.347569  7594 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:55.348654  7409 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.349767  7004 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.351086  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:55.369069  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 100716us
I20260709 13:03:55.350775  7409 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:55.370575  7532 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.370639  7584 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.384944  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 350810us
I20260709 13:03:55.389549  1675 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:55.390290  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.394555  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.398128  1683 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:55.379523  7456 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.399863  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.400720  1676 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:55.383726  7543 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:55.403357  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 84277.2us
I20260709 13:03:55.405689  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.406442  1677 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:55.398873  7584 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.408638  7584 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.414659  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.415357  1607 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:55.417322  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.393000  7532 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.418037  1609 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:55.419493  7532 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.419557  1681 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:55.425155  1647 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.428794  1648 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.303939  1428 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 17, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:55.425107  7441 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.427425  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:55.400722  7596 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.446995  1603 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.445369  1576 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.454566  7441 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.456947  7441 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.465461  1647 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.467935  7616 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:55.468405  7616 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.468762  7616 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:55.471983  7595 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:55.472560  7595 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.473238  7409 consensus_queue.cc:1059] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:55.473526  7595 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.479328  6783 raft_consensus.cc:3055] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:55.479766  6783 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.447332  7209 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.489719  7209 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:55.490196  7209 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:55.492599  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47371.1us
I20260709 13:03:55.493705  1576 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.494292  1428 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.495126  1576 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.496639  7349 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.497403  7349 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:55.498739  7349 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:55.496059  1428 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:55.503430  1428 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 15, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:55.501195  7598 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:55.505210  6783 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.509606  1601 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:55.499854  7349 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:55.501283  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:55.481699  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:55.516134  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 144931us
I20260709 13:03:55.519155  1603 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:55.524899  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:03:55.526508  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44867.8us
I20260709 13:03:55.528082  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:55.533089  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.529124  1647 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.538568  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.541575  7349 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:55.532572  7493 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:55.544376  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.532701  7511 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:55.545176  1528 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:55.545226  7511 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:55.532454  7597 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:55.546279  7597 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:55.546416  7511 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.547214  7597 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.548408  6783 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:55.554905  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 178370us
I20260709 13:03:55.555835  1498 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.553807  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.558401  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.562767  7198 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:55.563346  7198 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:55.564126  1499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.564167  7441 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.564903  7441 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.565313  7441 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.560463  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.574074  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:55.574713  1530 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.581113  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.581324  1498 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.582094  1532 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 13.
I20260709 13:03:55.550449  7596 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:55.563764  7198 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:55.559568  7349 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:55.609148  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.533541  7532 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:03:55.536902  7604 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:03:55.570294  7593 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:55.615839  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:55.532797  7616 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.556741  7493 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.618417  7402 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.619585  7531 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:55.550407  7257 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:03:55.610906  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.624585  1533 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:55.637097  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.636862  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.645277  1532 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:55.615118  7543 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:55.658828  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:03:55.657866  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73635.5us
I20260709 13:03:55.659474  1526 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:03:55.659588  1530 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:55.660979  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.661661  1532 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:55.611187  7596 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.662756  1682 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:55.667663  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.668355  1535 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
W20260709 13:03:55.669440  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53688us
I20260709 13:03:55.672439  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:55.667353  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:55.678771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.679270  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.649618  7437 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:55.650535  7511 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.681107  7437 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:55.681707  7610 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.682194  7610 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.682523  7610 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.683396  7437 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:55.664813  7209 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.685182  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.620293  7429 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:55.647847  7593 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:55.735391  1534 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 13.
I20260709 13:03:55.736850  1498 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:55.739703  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.741103  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:55.743932  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 78376us
W20260709 13:03:55.758239  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 90997.4us
I20260709 13:03:55.684814  7394 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:55.803725  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.805960  1676 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:03:55.807718  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 48293.7us
I20260709 13:03:55.650338  7402 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:55.817806  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 81043.9us
I20260709 13:03:55.777396  7394 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:55.805169  7437 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:55.820745  7621 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:55.772632  7138 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:03:55.841777  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95836.1us
I20260709 13:03:55.826702  7437 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:55.858057  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 181417us
I20260709 13:03:55.828356  7493 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.861837  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.862514  1677 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:55.868489  7209 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:55.854717  7437 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.877964  7402 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.854628  7593 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.880721  1601 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:55.830077  7596 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.867573  7441 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.899525  1605 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 22: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:55.902292  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:55.903741  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:55.904325  1607 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:03:55.904629  1677 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 20.
I20260709 13:03:55.903636  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:55.905445  1604 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
W20260709 13:03:55.920917  7622 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:03:55.901916  7409 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:03:55.924191  7349 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:55.909307  7617 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:03:55.926644  7610 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.927290  7630 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:03:55.906629  7441 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.922056  7198 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.935206  7198 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.940630  7610 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.927623  7437 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:55.947223  7437 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:55.818080  1428 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 16, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.007700  1428 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.010077  1428 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.012022  1428 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.014094  1428 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 11 to 14, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:56.016893  1428 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.018883  1428 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.020910  1428 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 16, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:56.024629  1428 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 15, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.029369  1428 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.036906  1428 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 16, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.040108  1428 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.042063  1428 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.044279  1428 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:56.046034  1428 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:03:56.047462  1428 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.049755  1428 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:03:56.094645  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 195627us
I20260709 13:03:56.096423  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:56.097388  7437 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:56.097834  7437 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.098484  7437 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.123796  7437 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.125974  7437 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:56.201368  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 382675us
I20260709 13:03:56.211910  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:56.213524  7630 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.214026  7630 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.216158  7630 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.217108  7610 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:56.217500  7610 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.217845  7610 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.226222  1602 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:56.248497  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:56.249413  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:56.251834  7610 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.260787  7610 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.266616  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:56.268111  7610 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:56.268565  7610 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:56.268903  7610 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.283239  7610 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:56.289638  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:03:56.291278  7610 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:56.300595  7294 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.301673  7294 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:56.307866  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 105683us
I20260709 13:03:56.316015  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:56.321165  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:56.322484  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:56.328619  7456 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.329160  7456 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.330905  7494 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.331235  7456 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.331471  7494 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.333613  7590 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:56.334429  7494 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.435783  7632 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.436676  7632 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.439419  7632 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.449509  7550 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.450388  7550 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.453035  7616 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.453598  7550 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.331873  7456 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:56.522775  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.003s
W20260709 13:03:56.523313  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.010s	sys 0.004s
I20260709 13:03:56.533480  7323 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.534227  7323 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.537767  7323 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.569304  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.569904  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.570182  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.570766  1675 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:56.589906  1684 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:56.602823  7456 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:56.605221  7604 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.606089  7604 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.609599  7604 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:56.615456  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.007s	sys 0.009s
I20260709 13:03:56.617092  7604 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.617722  7604 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.551407  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:56.558074  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:03:56.629760  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 71900.9us
W20260709 13:03:56.630642  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.010s	sys 0.009s
I20260709 13:03:56.634244  1535 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:56.634672  1532 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:03:56.634809  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.635936  1526 raft_consensus.cc:2393] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:56.638401  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.639307  1532 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:56.645458  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2294) took 1004 ms. Trace:
I20260709 13:03:56.660208  6783 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.648728  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2291) took 1007 ms. Trace:
I20260709 13:03:56.666939  6783 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.628266  7604 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.666728  1529 rpcz_store.cc:276] 0709 13:03:55.625141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.656923 (+ 31782us) service_pool.cc:224] Handling call
0709 13:03:55.673743 (+ 16820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.803672 (+129929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.803707 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.808619 (+  4912us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.846782 (+ 38163us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:56.628308 (+781526us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.628618 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.628709 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.628750 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:56.628761 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.629033 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97692,"prepare.queue_time_us":375518,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":378922,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":415129,"threads_started":2,"wal-append.queue_time_us":44859}
I20260709 13:03:56.673895  6783 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.674430  1529 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:56.679190  1427 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 7 to 11, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 14 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.669780  7598 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.684958  7598 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.687289  7598 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.682240  1427 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 16 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.696215  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.706279  7437 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:56.707006  7437 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.640169  7004 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.631721  7590 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.645596  7547 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:56.718572  1534 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:56.667249  1527 rpcz_store.cc:276] 0709 13:03:55.624285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.624389 (+   104us) service_pool.cc:224] Handling call
0709 13:03:55.624657 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.658869 (+ 34212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.658898 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.670885 (+ 11987us) log.cc:844] Serialized 26 byte log entry
0709 13:03:56.631370 (+960485us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:56.631437 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.631565 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.631638 (+    73us) raft_consensus.cc:1685] finished
0709 13:03:56.631657 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.631820 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45534,"raft.queue_time_us":37858,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9586,"thread_start_us":829906,"threads_started":1,"wal-append.queue_time_us":208163}
I20260709 13:03:56.711872  7437 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.712428  1529 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:56.722632  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:56.729974  1679 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.737789  6783 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:56.740288  1530 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:56.715765  7547 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.723620  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:56.759076  1678 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.723096  1532 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 14.
I20260709 13:03:56.750351  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:56.710150  7598 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:56.732570  7632 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.761739  1681 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:56.741590  7550 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:56.764055  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.764734  1529 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:56.767633  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 443540us
I20260709 13:03:56.769869  1679 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:56.763005  7547 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.789431  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.772987  7550 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.772346  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.791978  1529 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:56.796481  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:56.797212  1609 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
W20260709 13:03:56.797585  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 132620us
I20260709 13:03:56.799444  1532 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:03:56.800573  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:56.803244  1527 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:56.803896  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.822918  7652 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.823621  7652 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.826383  7652 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:56.826560  7511 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.064s	sys 0.038s
I20260709 13:03:56.808432  7294 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.766958  7598 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.811348  7550 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.798610  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:56.765794  7632 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.821082  1604 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:03:56.807626  1678 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:56.845018  1529 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:56.828837  7409 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:56.836323  7511 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.064s	sys 0.038s
I20260709 13:03:56.818518  7456 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:56.849994  7456 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.851182  1535 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
W20260709 13:03:56.854067  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 55579.6us
I20260709 13:03:56.843097  7493 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:56.857168  7437 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:56.859236  7493 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.864665  7493 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.865365  7456 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.875046  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.875828  1526 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.876551  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.878000  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.859453  7437 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:56.877344  7493 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.849283  7409 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.906850  7493 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.908473  7409 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.891242  7598 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.893278  7632 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.844880  7547 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:56.911677  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.881381  1576 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:56.913353  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:56.913710  7199 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:56.914307  7199 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:56.913458  7547 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.896781  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.915624  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:56.916904  7630 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:56.917495  7630 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:56.918280  7630 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.915162  7199 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.920439  7138 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:56.920960  7138 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.922926  7138 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.925173  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:56.925917  1679 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.926971  7349 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.927493  7349 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.929786  7349 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:56.935138  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 3010) took 1033 ms. Trace:
I20260709 13:03:56.935626  1603 rpcz_store.cc:276] 0709 13:03:55.901401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.934264 (+1032863us) service_pool.cc:224] Handling call
0709 13:03:56.934624 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.934805 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.934835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.934877 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:56.934911 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.934969 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.935081 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:56.937668  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:56.941171  7493 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:56.943288  7594 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:56.943876  7595 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:56.950294  1606 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.922966  7437 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:56.956611  1602 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:56.957897  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:56.958828  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.959712  1529 raft_consensus.cc:2410] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:56.960465  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.960601  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.960988  1529 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.961256  1531 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 14: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:56.962019  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.964377  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:56.965101  1609 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 14: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:56.965461  1526 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
W20260709 13:03:56.973014  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35640 (request call id 2771) took 1294 ms (client timeout 1683 ms). Trace:
W20260709 13:03:56.974138  1605 rpcz_store.cc:269] 0709 13:03:55.678727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.678973 (+   246us) service_pool.cc:224] Handling call
0709 13:03:56.972694 (+1293721us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000fffd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:56.972898 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361040768}
I20260709 13:03:56.974110  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:56.975364  7610 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:56.976796  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.977620  1526 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:56.978770  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:56.982084  1679 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:56.985040  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:56.986189  1535 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:56.990643  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:56.990794  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:56.992147  1526 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.977362  7610 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:56.999616  7610 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.002266  7138 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:57.005678  1526 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:56.999945  7394 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.009089  7349 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.028160  7138 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:57.029350  7394 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.045024  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.048781  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:57.049674  1530 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.056205  7210 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.056903  7210 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.055768  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.064352  7604 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:57.067126  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.070413  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.071616  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.072453  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.072661  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.074102  7323 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:57.074836  7323 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.077459  1603 raft_consensus.cc:1240] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:57.079025  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.079928  1602 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:57.088307  7595 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:57.092092  7594 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:57.094091  7594 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:57.059841  7210 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:57.098522  7610 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:57.099316  7610 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:57.029399  7349 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.105813  1601 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:57.111810  7349 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.114157  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.114861  1531 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:03:57.115711  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.117056  1531 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:57.123453  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:57.137137  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.030439  7138 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.159462  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.160557  1526 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:57.166754  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.172807  1606 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:57.166916  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.166330  1681 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:57.165987  7210 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:57.177536  7595 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:57.178903  1531 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:57.172086  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:57.180050  1602 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:57.124660  7598 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:57.190214  1526 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:57.194087  1534 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:57.178092  7210 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.188016  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:57.182536  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.204321  1677 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 20: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:57.128902  7409 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:03:57.201277  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:57.203112  1602 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:57.206112  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:57.208101  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.213927  7210 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:57.214653  7632 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:57.215049  7632 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:57.215416  7632 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:57.220628  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.195188  7652 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.225117  7652 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.219581  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.228806  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:57.268283  6783 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:57.204162  7595 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:57.197570  7543 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:57.276485  1602 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:03:57.278954  1602 pending_rounds.cc:85] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 8
I20260709 13:03:57.279294  1602 pending_rounds.cc:107] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:03:57.279604  1602 raft_consensus.cc:2889] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.286813  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:57.227478  7421 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:57.283528  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60539.8us
I20260709 13:03:57.291712  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:57.292938  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:57.294310  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.295722  7624 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:57.296254  7624 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.296674  7624 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.297684  7621 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:57.298132  7621 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.298702  7621 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.299031  1530 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:57.301683  1529 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:57.228593  7198 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:57.304461  7198 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.307366  7198 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:57.307542  2233 debug-util.cc:398] Leaking SignalData structure 0x7b0800294e00 after lost signal to thread 434
I20260709 13:03:57.290899  7595 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:03:57.310912  2233 debug-util.cc:398] Leaking SignalData structure 0x7b080014c2c0 after lost signal to thread 1467
I20260709 13:03:57.311290  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:57.312641  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff820 after lost signal to thread 1559
I20260709 13:03:57.312584  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.314016  1601 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:57.207279  7594 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:03:57.321436  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:57.322183  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.323962  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.324877  1601 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:03:57.273506  7210 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:57.274842  7511 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:57.337581  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002fefc0 after lost signal to thread 1634
I20260709 13:03:57.338470  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:57.347150  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002fefa0 after lost signal to thread 1635
W20260709 13:03:57.348821  2233 debug-util.cc:398] Leaking SignalData structure 0x7b0800178ba0 after lost signal to thread 1708
W20260709 13:03:57.349222  2233 debug-util.cc:398] Leaking SignalData structure 0x7b08002bac60 after lost signal to thread 1709
W20260709 13:03:57.350832  2233 debug-util.cc:398] Leaking SignalData structure 0x7b080034dfc0 after lost signal to thread 2236
W20260709 13:03:57.351220  2233 debug-util.cc:398] Leaking SignalData structure 0x7b080025aca0 after lost signal to thread 2237
I20260709 13:03:57.290184  7092 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.291404  7421 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.309106  7550 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:57.398093  1677 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:57.400164  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:57.361397  1678 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:57.372454  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.374737  7456 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.408949  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.384528  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:57.288574  7543 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.345342  7652 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.394825  7421 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:57.415313  7294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.032s	sys 0.096s
W20260709 13:03:57.439057  2178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.022s	sys 0.033s
W20260709 13:03:57.439592  2178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.023s	sys 0.033s
I20260709 13:03:57.309068  7595 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.413028  7198 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:57.359628  7511 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:57.417559  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.025s	sys 0.029s
I20260709 13:03:57.394346  7092 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.454332  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:57.470834  1678 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:57.412984  7616 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:03:57.468983  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.025s	sys 0.029s
W20260709 13:03:57.441810  7294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.032s	sys 0.096s
I20260709 13:03:57.415760  7456 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.452652  7610 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:57.467257  7594 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:57.496882  7658 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:03:57.499492  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.014s
W20260709 13:03:57.500175  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.010s
W20260709 13:03:57.535483  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.010s
W20260709 13:03:57.500594  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.010s
I20260709 13:03:57.532613  1678 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 21.
W20260709 13:03:57.536568  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.010s
W20260709 13:03:57.536863  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.015s
W20260709 13:03:57.537178  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 546573us
I20260709 13:03:57.473470  7198 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:57.550697  7421 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.552812  7511 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.560510  7323 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:57.574651  1576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.006s	sys 0.034s
W20260709 13:03:57.589582  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.014s	sys 0.019s
W20260709 13:03:57.590896  1576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.034s
W20260709 13:03:57.592060  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.014s	sys 0.019s
W20260709 13:03:57.591734  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 323971us
I20260709 13:03:57.621291  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:57.574432  7630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.054s	sys 0.044s
W20260709 13:03:57.588438  7658 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:57.623852  1648 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:57.636629  1681 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:57.636878  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:57.639405  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.639928  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:57.640059  1527 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:03:57.650616  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:57.642781  7594 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:57.656724  7594 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.657168  7594 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:57.657927  7421 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:57.659150  1533 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:03:57.664674  7543 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:57.668598  7659 log.cc:927] Time spent T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:03:57.669400  7456 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.673501  7092 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:57.674252  7624 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:57.635973  7630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.055s	sys 0.044s
I20260709 13:03:57.681934  7198 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:57.622750  7511 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.688162  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48315.6us
I20260709 13:03:57.633826  7210 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:03:57.701824  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:57.707304  1576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.707810  1574 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:57.709278  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:57.659238  7621 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.723853  1526 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:57.645985  7604 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:57.590591   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:57.719276  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:03:57.737318  1679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.015s	sys 0.043s
W20260709 13:03:57.740406  1679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.015s	sys 0.044s
I20260709 13:03:57.723615  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:57.741240  1528 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:03:57.715811  7199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.018s	sys 0.041s
I20260709 13:03:57.699414  7394 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:57.715058  7210 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:57.747314  6783 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:57.745182  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:57.756629  6783 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.723160  7616 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.757066  6783 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.757776  1527 raft_consensus.cc:1240] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:57.688241  7511 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:57.748375  7199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.018s	sys 0.041s
I20260709 13:03:57.750324  7394 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.715171  7198 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.739830  7604 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:57.751119  7349 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:57.851223  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.022s
W20260709 13:03:57.862416  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.001s	sys 0.022s
I20260709 13:03:57.750918  7610 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:57.862558  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 331664us
W20260709 13:03:57.797766  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 387235us
I20260709 13:03:57.883271  7604 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:57.723552  7665 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:03:57.875726  2178 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:57.904918  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 610655us
I20260709 13:03:57.910895  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:57.906507  1498 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.916525  1498 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.918021  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:57.861235  7437 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:57.882860  7394 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:57.882546  7349 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.851745  7210 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:57.929087  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:57.940493  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 159) took 20599 ms (client timeout 15000 ms). Trace:
I20260709 13:03:57.782322  7616 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.930235  6783 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.864212  7630 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:03:57.945744  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.008s	sys 0.020s
I20260709 13:03:57.933904  1609 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:57.952558  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.021s
I20260709 13:03:57.903492  7621 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:57.953218  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 196067us
I20260709 13:03:57.902849  7665 consensus_queue.cc:1243] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:57.957991  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:57.911011  7662 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:57.957855  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 217110us
I20260709 13:03:57.895278  7198 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:57.930249  7092 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:57.930397  7590 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:57.930639  7550 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:57.991708  1576 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:57.987862  6783 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:03:57.941123  1428 rpcz_store.cc:269] 0709 13:03:37.311435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.322394 (+ 10959us) service_pool.cc:224] Handling call
0709 13:03:37.761664 (+439270us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b54002bffb8. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de38173 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:03:57.910908 (+20149244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:56.065746 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:56.066459 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:56.066509 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:03:56.066528 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:56.069370 (+  2842us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:56.069499 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:56.069536 (+    37us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:03:56.072205 (+  2669us) tablet.cc:701] Row locks acquired
0709 13:03:56.072267 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:03:56.072441 (+   174us) write_op.cc:270] Start()
0709 13:03:56.072601 (+   160us) write_op.cc:276] Timestamp: P: 1783602236072381 usec, L: 0
0709 13:03:56.072639 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:03:56.073508 (+   869us) log.cc:844] Serialized 13332 byte log entry
0709 13:03:56.085007 (+ 11499us) op_driver.cc:464] REPLICATION: finished
0709 13:03:56.086789 (+  1782us) write_op.cc:301] APPLY: starting
0709 13:03:56.086895 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:56.110421 (+ 23526us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:56.110550 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:56.131440 (+ 20890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:56.131750 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:03:56.131792 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:56.132439 (+   647us) log.cc:844] Serialized 291 byte log entry
0709 13:03:56.133144 (+   705us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:56.133314 (+   170us) write_op.cc:454] Released schema lock
0709 13:03:56.133376 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:56.135059 (+  1683us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:56.135091 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":696000,"reported_tablets":57,"spinlock_wait_cycles":4582144,"child_traces":[["op",{"apply.queue_time_us":1477,"apply.run_cpu_time_us":40714,"apply.run_wall_time_us":46973,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146179,"num_ops":34,"prepare.queue_time_us":1293,"prepare.run_cpu_time_us":10952,"prepare.run_wall_time_us":15325,"raft.queue_time_us":725388,"raft.run_cpu_time_us":19874,"raft.run_wall_time_us":315552,"replication_time_us":12201,"thread_start_us":574665,"threads_started":5,"wal-append.queue_time_us":5837}]]}
I20260709 13:03:57.957564  7437 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:57.935874  7349 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:58.044342  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 52930us
I20260709 13:03:58.057216  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:58.039499  7662 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
W20260709 13:03:58.065547  7673 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:03:58.066478  7668 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:03:58.067893  7676 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:57.988461  7666 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.975533  7677 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:58.072583  1528 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:03:58.072160  6783 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:58.083810  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:58.087894  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 108524us
I20260709 13:03:58.046391  7610 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:57.995638  7621 consensus_queue.cc:1059] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:03:58.068998  7674 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.974316  7630 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:58.110201  7666 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:58.111874  7674 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.115813  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57254 (request call id 2804) took 1032 ms. Trace:
W20260709 13:03:58.134809  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 193611us
W20260709 13:03:58.123812  7667 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.364s	user 0.011s	sys 0.001s
I20260709 13:03:58.122884  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.125391  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.126147  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.126267  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.126952  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:58.136278  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 214366us
I20260709 13:03:58.147892  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.139526  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:58.151053  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:57.996341  7624 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.143918  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.145004  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:58.145139  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 3020) took 1016 ms. Trace:
I20260709 13:03:58.139148  1531 rpcz_store.cc:276] 0709 13:03:57.083819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.208669 (+124850us) service_pool.cc:224] Handling call
0709 13:03:57.269427 (+ 60758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.282432 (+ 13005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.282480 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.282983 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.862963 (+579980us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:57.863038 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.863134 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.115592 (+252458us) raft_consensus.cc:1685] finished
0709 13:03:58.115616 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.115748 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14272,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":20871,"thread_start_us":579513,"threads_started":1,"wal-append.queue_time_us":700864}
I20260709 13:03:58.145609  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:03:58.101639  7632 consensus_meta.cc:287] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.886s	user 0.010s	sys 0.004s
I20260709 13:03:58.108276  7437 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.151505  1684 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:58.144778  7138 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:58.211009  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:58.209756  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56589.8us
I20260709 13:03:58.156132  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 3011) took 1217 ms. Trace:
I20260709 13:03:58.290239  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:58.208454  1609 rpcz_store.cc:276] 0709 13:03:57.120418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.120665 (+   247us) service_pool.cc:224] Handling call
0709 13:03:57.121020 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.952711 (+831691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.136626 (+183915us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54001c7ad4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698079e01 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2 00007f46963b448c 00007f46963b38c6
0709 13:03:58.136841 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868884352}
W20260709 13:03:58.210942  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 65687.8us
I20260709 13:03:58.155544  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:58.215404  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.289419  1680 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:58.217383  7689 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:03:58.210093  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53839.7us
I20260709 13:03:58.293431  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 2391) took 1332 ms. Trace:
I20260709 13:03:58.293838  1676 rpcz_store.cc:276] 0709 13:03:56.961037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.961175 (+   138us) service_pool.cc:224] Handling call
0709 13:03:56.961556 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.961809 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:57.607769 (+645960us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.240393 (+632624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:58.293073 (+ 52680us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:58.293152 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.293242 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.293375 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":942647,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5567,"raft.queue_time_us":108846,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18633,"thread_start_us":1277785,"threads_started":3,"wal-append.queue_time_us":509206}
I20260709 13:03:58.289760  1677 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:58.290192  1604 rpcz_store.cc:276] 0709 13:03:56.933212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.116413 (+183201us) service_pool.cc:224] Handling call
0709 13:03:57.116748 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.153440 (+ 36692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.153489 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.173345 (+ 19856us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.620153 (+446808us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:57.620200 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.620271 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.150450 (+530179us) raft_consensus.cc:1685] finished
0709 13:03:58.150474 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.150624 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37072,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":14929,"thread_start_us":391353,"threads_started":1,"wal-append.queue_time_us":698183}
W20260709 13:03:58.289085  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 142971us
W20260709 13:03:58.298810  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 422188us
W20260709 13:03:58.300737  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.005s	sys 0.024s
W20260709 13:03:58.301056  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.024s
I20260709 13:03:58.207816  7590 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:58.238258  7594 consensus_meta.cc:287] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.001s
I20260709 13:03:58.214308  7677 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:58.130537  7610 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.168s
I20260709 13:03:58.219090  7616 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.238087  7630 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:03:58.316808  7682 log.cc:927] Time spent T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260709 13:03:58.281905  7493 consensus_queue.cc:1059] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:58.317467  7590 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.336587  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.320004  7511 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.341965  7590 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.320565  7543 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.342912  7543 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.346922  7543 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.323033  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.345117  7210 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.325254  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 3014) took 1383 ms. Trace:
I20260709 13:03:58.348578  1610 rpcz_store.cc:276] 0709 13:03:56.941784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.948119 (+  6335us) service_pool.cc:224] Handling call
0709 13:03:56.948531 (+   412us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:56.948958 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.948990 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:56.996808 (+ 47818us) log.cc:844] Serialized 78 byte log entry
0709 13:03:57.537185 (+540377us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:57.537227 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.537289 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.325023 (+787734us) raft_consensus.cc:1685] finished
0709 13:03:58.325045 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.325197 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26240,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"thread_start_us":539920,"threads_started":1,"wal-append.queue_time_us":644182}
I20260709 13:03:58.325145  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.350109  7674 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.350476  1604 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:58.326982  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.322368  7349 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.331455  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.236905  7294 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:58.333809  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.150172  7680 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:03:58.339191  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.316015  7677 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:58.356348  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 200895us
I20260709 13:03:58.314201  7624 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:58.355683  1574 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:03:58.360756  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 60103.5us
I20260709 13:03:58.238773  7632 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.368752  7616 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:58.364372  7624 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.372996  7624 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.376087  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:58.318089  7594 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.379230  7199 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.379688  1682 raft_consensus.cc:2368] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:58.374786  7543 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.380446  7680 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:58.380970  7680 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:58.381735  7594 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.381834  7680 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:58.383086  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 74744.3us
I20260709 13:03:58.358711  7294 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:58.388250  1675 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:58.150431  7662 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:03:58.377996  7694 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:58.363514  7677 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.342938  7394 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.390870  7543 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:58.391021  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 86714.9us
I20260709 13:03:58.383464  7674 raft_consensus.cc:3055] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:58.398643  7681 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:58.393018  6783 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:58.421052  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.384016  7210 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.398844  7294 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.389259  7199 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:58.424741  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.401262  7632 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.402488  7696 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:58.432590  7696 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:58.432967  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.433477  7696 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.434510  7198 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.434764  7696 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:58.396644  7323 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.436272  7323 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.438357  7323 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.438683  1527 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:58.396656  7004 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.426708  1647 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.398386  7693 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:03:58.440075  7610 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.440317  7693 consensus_queue.cc:1243] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 36f53e9bfce749bbba4a4b34829f563d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:58.440685  7610 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:58.408224  7604 consensus_meta.cc:287] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.003s
I20260709 13:03:58.442625  7594 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:58.443100  7604 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.445297  7604 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.417235  7680 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:58.448554  7681 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:58.421893  1529 raft_consensus.cc:2393] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:58.422979  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:58.455607  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.398351  7543 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.426548  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.427300  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.456964  1535 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:03:58.457274  7681 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.420718  7674 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:58.422191  7590 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.430267  7349 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:58.430531  7678 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.318s	user 0.000s	sys 0.003s
I20260709 13:03:58.431497  7294 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.439280  7004 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.453504  7210 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.419190  7624 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.452744  1527 pending_rounds.cc:85] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 9
I20260709 13:03:58.475049  1527 pending_rounds.cc:107] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:03:58.475426  1527 raft_consensus.cc:2889] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.460083  1529 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:03:58.460922  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.466321  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:58.476835  1526 raft_consensus.cc:2376] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18. Re-sending same reply.
I20260709 13:03:58.442714  7610 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.477232  7590 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.478021  7610 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.478526  7610 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.469245  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.467517  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.481691  7610 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.470337  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:58.482920  1535 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:58.471323  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 59) took 4293 ms. Trace:
I20260709 13:03:58.483560  1427 rpcz_store.cc:276] 0709 13:03:54.177950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.178193 (+   243us) service_pool.cc:224] Handling call
0709 13:03:58.471230 (+4293037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:56.888414 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:56.889137 (+   723us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:56.889179 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:03:56.889201 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:56.907343 (+ 18142us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:56.907451 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:56.907481 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:56.907828 (+   347us) tablet.cc:701] Row locks acquired
0709 13:03:56.907849 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:56.908081 (+   232us) write_op.cc:270] Start()
0709 13:03:56.908220 (+   139us) write_op.cc:276] Timestamp: P: 1783602236907995 usec, L: 0
0709 13:03:56.908248 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:03:56.908974 (+   726us) log.cc:844] Serialized 918 byte log entry
0709 13:03:57.671175 (+762201us) op_driver.cc:464] REPLICATION: finished
0709 13:03:58.116945 (+445770us) write_op.cc:301] APPLY: starting
0709 13:03:58.117039 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:58.118753 (+  1714us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:58.118853 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:58.229084 (+110231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:58.233529 (+  4445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:03:58.233571 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:58.233758 (+   187us) log.cc:844] Serialized 32 byte log entry
0709 13:03:58.233916 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:58.234009 (+    93us) write_op.cc:454] Released schema lock
0709 13:03:58.234052 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:58.234443 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:58.234470 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":572099,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":445488,"apply.run_cpu_time_us":5150,"apply.run_wall_time_us":117457,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":180331,"prepare.run_cpu_time_us":3393,"prepare.run_wall_time_us":22660,"replication_time_us":762758,"spinlock_wait_cycles":3968,"thread_start_us":433953,"threads_started":2}]]}
I20260709 13:03:58.391904  7652 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.473500  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35646 (request call id 3037) took 1147 ms. Trace:
I20260709 13:03:58.487944  7652 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.487900  1605 rpcz_store.cc:276] 0709 13:03:57.326473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.328077 (+  1604us) service_pool.cc:224] Handling call
0709 13:03:57.328443 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.328877 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.328912 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.329490 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.738104 (+408614us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:57.738150 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.738222 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.430099 (+691877us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b24002b2398. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694e129c4 00007f4694e10acb 00007f4694fcbdc9 00007f4694fcba55 00007f4694fcb09d 00007f4697bfd10e 00007f4697c1488c 00007f4697c13bb6 00007f4697c137d8 00007f4697c1d221
0709 13:03:58.471934 (+ 41835us) raft_consensus.cc:1685] finished
0709 13:03:58.471957 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.473435 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1276,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":39345024,"thread_start_us":408206,"threads_started":1,"wal-append.queue_time_us":782656}
W20260709 13:03:58.495565  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.502519  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.506901  1647 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.513123  2212 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:58.513770  7610 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:58.515340  1534 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:58.514350  7610 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.521467  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:58.508215  7409 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.511871  7632 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:58.526298  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.527462  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.522176  1535 raft_consensus.cc:2376] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22. Re-sending same reply.
I20260709 13:03:58.526314  1606 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:03:58.530001  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.511871  7604 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.530746  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:58.534332  1603 raft_consensus.cc:2393] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 22: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:58.537706  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.543081  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.544199  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.545022  1610 raft_consensus.cc:2410] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:03:58.545513  7210 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.546038  7705 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.546167  7210 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.546594  7705 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.556587  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.558219  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.560177  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.592449  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.597837  1498 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.517279  7674 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.598351  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.608835  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.539278  7604 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.601542  7456 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.596136  7621 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.614483  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.615232  1604 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.617951  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.596490  7705 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.623634  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.625867  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.636068  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.636837  1606 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:03:58.641605  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43896.7us
I20260709 13:03:58.645005  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.629931  7674 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.649247  7677 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.651542  7701 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:03:58.652388  7716 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:58.652184  7701 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.652971  7708 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.629170  7210 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.653476  7708 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.654554  7701 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.655632  7708 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.656714  7604 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:58.652297  7698 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:58.630707  7550 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:58.658838  1602 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:58.622498  7621 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.659297  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:03:58.660017  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60255.9us
I20260709 13:03:58.616212  7456 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.714763  1604 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:03:58.715497  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 55870.6us
W20260709 13:03:58.716223  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57008.7us
W20260709 13:03:58.716624  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57671.4us
I20260709 13:03:58.719769  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:58.720909  7708 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:58.721347  7708 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.721773  7708 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.722894  7621 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.720234  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.721468  7701 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:58.728964  1647 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:58.734774  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:58.741397  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:58.750491  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:58.757496  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.761289  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.718770  7092 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:58.761447  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.771468  1682 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:58.768414  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.772446  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.768532  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:58.769217  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:58.773888  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.775949  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.777042  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.731807  7604 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.746572  7494 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:58.756409  7550 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:58.786351  1678 raft_consensus.cc:1240] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:03:58.740351  7621 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.746588  7610 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.789623  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.748138  7210 raft_consensus.cc:2804] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:58.780174  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.809355  1531 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:03:58.790866  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.792238  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:58.793227  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.794622  1679 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:58.811596  1528 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:58.718659  7138 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:03:58.830250  1533 pending_rounds.cc:85] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 8
I20260709 13:03:58.830726  1533 pending_rounds.cc:107] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:58.831084  1533 raft_consensus.cc:2889] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.777213  7598 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:58.797617  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.784586  1684 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:03:58.821772  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:58.836655  1684 pending_rounds.cc:85] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Aborting all ops after (but not including) 10
I20260709 13:03:58.837014  1526 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:03:58.773005  7092 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.777539  7394 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.775876  7707 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.837082  1684 pending_rounds.cc:107] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:03:58.849099  1684 raft_consensus.cc:2889] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.848743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.852345  1678 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:03:58.863819  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.867477  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.872104  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.770720  7198 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:03:58.877611  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.887164  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.838193  7092 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:58.801025  7199 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.795641  7349 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.085s
I20260709 13:03:58.844700  7665 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:58.889891  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:58.888355  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:58.891036  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:58.909065  1680 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.891587  7598 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:58.895105  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 91353.5us
I20260709 13:03:58.887805  1677 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:03:58.879359  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.799583  7604 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.821655  7621 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:58.900499  7719 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:58.890578  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:58.878159  7433 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.922245  1678 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:58.906641  7394 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.904670  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:58.879117  7707 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:58.963375  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58881.7us
I20260709 13:03:58.936280  7294 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:58.964752  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:58.954424  7349 consensus_queue.cc:1243] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer e3ab72f324d545a6b4ecb1025df1f7c0 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:03:58.918304  7199 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.918865  7665 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.971771  7294 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:58.975802  7621 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:03:58.980834  7721 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:03:58.980676  7543 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.958209  7394 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.012775  7666 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
W20260709 13:03:58.985743  7720 log.cc:927] Time spent T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.257s	user 0.002s	sys 0.000s
I20260709 13:03:58.956601  7433 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.024164  7652 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.024901  7394 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.026187  7433 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.986621  7708 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.032704  1676 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:59.034021  7708 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:58.965363  7511 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:58.998164  1607 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:58.937759  7724 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.256s
I20260709 13:03:58.931280  7598 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.044375  1574 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.039126  7624 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.016103  1576 leader_election.cc:400] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:59.036852  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.049569  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.068635  7004 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.065182  7604 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:59.084059  7323 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:59.067588  7665 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.084730  7323 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:59.071501  7294 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.066437  7199 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.085610  7323 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:59.070528  7680 consensus_meta.cc:287] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:03:59.072433  7707 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.089149  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.090227  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:03:59.092139  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55398us
I20260709 13:03:59.094805  1501 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.095878  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.096079  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.098378  1607 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:59.090154  7673 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:03:59.100658  1576 leader_election.cc:403] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:59.007138  1680 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:03:59.057171  7598 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.014828  7630 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:03:59.017658  7456 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.012115  7210 raft_consensus.cc:697] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:59.062487  7746 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:59.046017  7709 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.019s
I20260709 13:03:59.054486  7610 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:59.102564  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:59.107369  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102738us
I20260709 13:03:59.110498  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.110875  1526 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:03:59.113095  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.125833  1530 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:59.119619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.109555  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.121984  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.126793  1532 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 14.
I20260709 13:03:59.127247  1528 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:03:59.104341  7004 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:59.135084  7680 consensus_queue.cc:1059] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:59.144229  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.145470  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.100364  7665 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:59.143185  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.151803  1528 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:59.111917  7707 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.118476  7511 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 17. Current term is 18.
I20260709 13:03:59.150413  1526 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:59.151187  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.064503  7092 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.175874  1527 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:03:59.177269  7092 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.154014  7665 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.180328  7665 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.180990  7456 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:59.149091  7294 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:59.182308  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:59.156992  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:59.183768  1681 raft_consensus.cc:606] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.184154  1681 raft_consensus.cc:614] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.185420  7610 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:59.174690  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.002s	sys 0.003s
I20260709 13:03:59.185889  7610 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:59.186007  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.003s	sys 0.003s
I20260709 13:03:59.189200  7004 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.188805  1427 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:59.189697  7004 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.194927  1501 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.195779  7456 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:59.180358  7707 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.196810  7437 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:59.197211  7437 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:59.197877  7707 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.198086  7437 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:59.199443  7437 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.201452  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.205749  1501 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.191821  7004 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.208410  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.131898  7746 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.211663  7004 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.212623  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.211120  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.147253  7349 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:59.218691  7698 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.150341  7726 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:59.219669  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 68010.2us
I20260709 13:03:59.219669  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.216722  7746 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:59.232826  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.229030  7210 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.220541  7349 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.235592  7349 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:59.238245  1530 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:03:59.240991  1527 raft_consensus.cc:1240] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:59.240923  7004 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:59.241561  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.242126  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.246790  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:59.247418  1681 raft_consensus.cc:606] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.247789  1681 raft_consensus.cc:614] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.248569  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.249096  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.249832  1684 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:03:59.250355  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.251654  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.252064  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:59.249208  1683 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:03:59.253104  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.253963  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.251165  1676 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:03:59.255705  7294 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:59.259227  7294 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:59.260317  7294 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.262893  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36926
I20260709 13:03:59.263461  7751 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:59.265026  7696 raft_consensus.cc:3055] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:59.265452  7696 raft_consensus.cc:740] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:59.266305  7696 consensus_queue.cc:260] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.267452  7677 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.267655  7696 raft_consensus.cc:3060] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:59.271853  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:59.274317  1681 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:59.275261  1681 raft_consensus.cc:614] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.276413  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.277083  1535 raft_consensus.cc:3060] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:59.277220  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.278090  7004 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.279572  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.264015  7746 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.284767  7004 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:59.286880  7004 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:59.287519  7004 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.285722  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.273022  7698 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.293010  7604 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.293349  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.293681  7604 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.296501  7092 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:59.297101  7092 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:59.297581  7092 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:59.292418  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.301715  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:59.302832  1681 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.303447  1681 raft_consensus.cc:614] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.308199  7752 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.308862  7752 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.311277  7752 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.312412  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.314546  1608 raft_consensus.cc:2393] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:03:59.315955  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.317679  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.324482  7004 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.330816  7726 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.331754  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.334549  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:03:59.342909  1682 raft_consensus.cc:606] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.357512  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.332397  7433 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:59.324083  7652 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.323817  7752 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:59.360749  7761 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:03:59.358994   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:59.363791  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.312678  7698 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.349782  7621 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.347221  7616 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.388377  7616 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:03:59.392568  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 245913us
I20260709 13:03:59.393323  1576 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:59.393582  7349 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.394627  7630 consensus_queue.cc:1059] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:59.395634  7630 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:59.400776  7621 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.403528  7621 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.369835  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:59.350275  7543 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:03:59.384807  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.407769  1682 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.410285  1576 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:59.384837   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:59.368454  7004 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.408100  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.406755  1535 raft_consensus.cc:2468] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:59.428404  1526 raft_consensus.cc:2393] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:59.433079  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:59.436571  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.395991  7630 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:59.426604  7349 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.440867  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.427471  7199 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:59.428982  7604 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:59.434707  7543 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:03:59.462481  7543 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:03:59.454825  7590 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.432173  7394 consensus_queue.cc:1059] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:03:59.467214  7698 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.467965  7394 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:59.468473  7394 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:59.469179  7762 tablet_replica.cc:333] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:03:59.469595  7394 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.480729  7630 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.441581  7138 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.442520  7735 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:03:59.444330  7665 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.489964  7092 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.521878  1532 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:59.522897  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.523048  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.439307  7746 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.525198  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.470676  7762 raft_consensus.cc:2243] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.526281  7762 raft_consensus.cc:2272] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.526428  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.527649  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.530846  7762 ts_tablet_manager.cc:1916] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:59.505426  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:03:59.505426  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:03:59.509328  7765 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:03:59.513196  7630 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:59.531386  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.509598  7610 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.499500  1682 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
W20260709 13:03:59.532266  1574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.547798  1532 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:03:59.533280  7092 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.533954  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:03:59.554009  1675 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:59.541308  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.541726  1601 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:59.542114  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.545406  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:03:59.493783  7394 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:59.531917  1533 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:59.548893  1501 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:59.556370  1531 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:03:59.556092  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.579056  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.571877  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:03:59.590677  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49446.9us
I20260709 13:03:59.583988  7707 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:59.584101  7550 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:59.608825  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.610600  1574 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.612066  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.613704  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.615388  7511 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:59.615806  7511 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.587082  7665 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:59.599539  7681 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.616974  1574 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:03:59.622519  7199 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:59.624082  7610 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.618633  7511 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.655205  7693 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:59.655750  7693 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:03:59.656772  7693 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.632136  7199 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.661016  7199 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.663830  7616 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:03:59.616376  7708 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:59.668301  7708 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.668691  7708 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:59.680919  7756 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.463s	user 0.006s	sys 0.003s
I20260709 13:03:59.612962  7138 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:59.683992  7138 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:03:59.684430  7138 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:59.684862  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68000.1us
I20260709 13:03:59.633095  1675 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:03:59.644595  7198 raft_consensus.cc:2804] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:59.686554  7198 raft_consensus.cc:697] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:03:59.646524  7755 log.cc:927] Time spent T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.429s	user 0.002s	sys 0.000s
I20260709 13:03:59.617417  7550 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:59.651701  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.688822  7550 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.652343  7751 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:03:59.690835  7751 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.692093  7680 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:59.606204  7707 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:03:59.694819  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61237.5us
W20260709 13:03:59.705659  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 268235us
I20260709 13:03:59.709558  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:03:59.710141  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.711047  7511 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.713214  7511 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.713474  7770 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:59.705785  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.736147  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:03:59.740648  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.737974  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:59.701103  7707 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:59.757222  7632 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:59.758158  7632 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:59.761358  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.763449  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.770856  1648 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.767895  1501 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:03:59.772120  1648 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.736961  7698 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.687798  7198 consensus_queue.cc:237] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.764047  7632 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:59.777882  7323 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:59.771375  7594 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:59.801764  1648 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.803300  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.778071  7616 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:59.812956  7749 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:59.780299  7703 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.818288  7674 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:59.837920  1682 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:59.780398  7696 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.804544  7323 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:03:59.823159  7708 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.830729  1604 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:59.831790  1601 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:59.834332  7770 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:03:59.780135  7632 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:59.795923  7610 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:59.835321  1603 raft_consensus.cc:1240] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:59.784732  7652 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:59.849336  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 268083us
I20260709 13:03:59.795735  7771 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:59.854346  7708 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.855221  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:03:59.748315  7511 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:03:59.885151  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:59.885599  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.859172  7771 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.893433  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.882727  7138 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.897763  7749 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:59.912338  7323 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.851714  7770 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.930487  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:03:59.932472  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:03:59.930398  7421 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:59.949331  1604 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:59.950623  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 212724us
I20260709 13:03:59.951547  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:03:59.896955  7771 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.896736  7594 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:03:59.896972  7700 consensus_queue.cc:1059] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:03:59.944281  7421 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:03:59.972462  1675 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:59.978803  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.954432  7734 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.988299  7770 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:03:59.932415  7632 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:03:59.993311  7726 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:59.994925  7778 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:59.997403  1527 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:59.974257  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:03:59.997944  1498 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:03:59.999579  7004 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:00.000743  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:03:59.983640  7776 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:00.005709  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.008543  7543 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.010205  7138 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.011054  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.015708  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.021987  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.021313  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.023180  7199 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.025455  1608 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:00.025972  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.027274  1680 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:04:00.027948  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.029050  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.039978  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.011096  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 60) took 1155 ms. Trace:
W20260709 13:04:00.049518  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 246264us
W20260709 13:04:00.084735  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 102917us
I20260709 13:04:00.052862  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.085579  1677 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:00.053161  1684 raft_consensus.cc:1240] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:00.094318  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.039815  7421 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.127766  7349 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.128624  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.129218  1677 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.129045  7349 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.131639  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.131878  7421 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.132890  7751 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:00.137775  7394 consensus_meta.cc:287] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.003s
I20260709 13:04:00.138799  7693 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.150744  7349 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.052561  1427 rpcz_store.cc:276] 0709 13:03:58.855552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.883842 (+ 28290us) service_pool.cc:224] Handling call
0709 13:04:00.010974 (+1127132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:59.288651 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:59.297052 (+  8401us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:59.297105 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:59.297132 (+    27us) tablet.cc:662] Decoding operations
0709 13:03:59.297545 (+   413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:59.297645 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:59.297692 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:59.297923 (+   231us) tablet.cc:701] Row locks acquired
0709 13:03:59.297959 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:03:59.298172 (+   213us) write_op.cc:270] Start()
0709 13:03:59.298324 (+   152us) write_op.cc:276] Timestamp: P: 1783602239298093 usec, L: 0
0709 13:03:59.298353 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:03:59.299248 (+   895us) log.cc:844] Serialized 535 byte log entry
0709 13:03:59.756365 (+457117us) op_driver.cc:464] REPLICATION: finished
0709 13:03:59.989889 (+233524us) write_op.cc:301] APPLY: starting
0709 13:03:59.990014 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:59.991250 (+  1236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:59.991355 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:59.992213 (+   858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:59.992401 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:03:59.992455 (+    54us) write_op.cc:312] APPLY: finished
0709 13:03:59.992686 (+   231us) log.cc:844] Serialized 24 byte log entry
0709 13:03:59.992865 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:59.992959 (+    94us) write_op.cc:454] Released schema lock
0709 13:03:59.992994 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:59.993373 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:59.993410 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":213690,"apply.run_cpu_time_us":3493,"apply.run_wall_time_us":23020,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":93855,"prepare.run_cpu_time_us":11342,"prepare.run_wall_time_us":73595,"raft.queue_time_us":326298,"raft.run_cpu_time_us":28613,"raft.run_wall_time_us":204155,"replication_time_us":457809,"thread_start_us":442408,"threads_started":4,"wal-append.queue_time_us":104901}]]}
W20260709 13:04:00.153439  7774 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:04:00.153666  7698 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:00.101279  7594 consensus_queue.cc:1059] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:04:00.160225  7703 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.160529  7493 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:00.160895  7493 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.161685  7493 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.162750  7493 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:00.163622  7788 log.cc:927] Time spent T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:00.163865  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:00.162839  7782 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:00.169553  1681 raft_consensus.cc:2468] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:04:00.171368  1683 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:00.174168  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.181874  7779 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:04:00.135727  7751 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.099000  7749 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.188650  1607 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:04:00.193277  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 2355) took 1101 ms. Trace:
I20260709 13:04:00.194254  1607 pending_rounds.cc:85] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 16
I20260709 13:04:00.194761  1607 pending_rounds.cc:107] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 13:04:00.195348  1607 raft_consensus.cc:2889] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:00.189579  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58534.7us
I20260709 13:04:00.194342  1529 rpcz_store.cc:276] 0709 13:03:59.082525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.097949 (+ 15424us) service_pool.cc:224] Handling call
0709 13:03:59.098359 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:59.098852 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.098894 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:59.408302 (+309408us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180043e9a0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f5a2a6 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a
0709 13:03:59.520071 (+111769us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b2c00000708. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696972a11 00007f4696982372 00007f46980b4a01 00007f469807943a 00007f469807883e 00007f469d03d419 00007f46965b4bd4 00007f46965b4b62 00007f46965b4a91 00007f46965b4a0c 00007f46965b3cc2
0709 13:03:59.520835 (+   764us) log.cc:844] Serialized 52 byte log entry
0709 13:03:59.840141 (+319306us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:59.859966 (+ 19825us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.860344 (+   378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.860449 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.183688 (+323239us) raft_consensus.cc:1685] finished
0709 13:04:00.183728 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.183909 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1770,"prepare.queue_time_us":24360,"raft.queue_time_us":654,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":27587,"spinlock_wait_cycles":53240448,"thread_start_us":256152,"threads_started":1,"wal-append.queue_time_us":399775}
I20260709 13:04:00.197391  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.098021  7708 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:00.205960  1677 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:04:00.208163  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:00.222121  7703 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:00.212628  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.220588  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.226981  1576 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:00.282709  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55823.1us
I20260709 13:04:00.283708  1576 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:00.281213  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 180433us
I20260709 13:04:00.284687  7349 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:04:00.287380  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66881us
I20260709 13:04:00.210860  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:00.290107  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.222501  7199 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.297493  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:00.298573  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.302618  7349 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.307614  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.309813  1677 raft_consensus.cc:2410] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:04:00.307139  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.314271  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:00.315970  1529 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:00.218266  7693 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:04:00.316005  7349 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:00.207398  7708 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.294234  7594 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:00.292323  7783 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:00.300271  7700 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:00.342424  7349 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.287906  7770 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:00.300473  7790 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:00.308847  7604 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.289717  7598 consensus_queue.cc:1059] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 21.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:04:00.349391  7707 consensus_meta.cc:287] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:04:00.325543  7198 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.347746  7349 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.329711  7594 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.350886  7770 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:00.370693  7701 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:00.415457  7701 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.394734  7707 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.418730  7701 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:00.412961  7795 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:04:00.413764   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:00.420270  1603 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:00.363129  7604 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.426760  7604 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.361683  7790 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.429647  7790 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.338368  7771 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.396119  7594 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.432583  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:04:00.435015  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 112760us
I20260709 13:04:00.402359  7770 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:00.405800  7703 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:00.440585  7703 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.442757  7703 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.446549  7771 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.447436  1606 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:00.453157  7791 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:00.419878  7707 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.478413  7595 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:00.479049  7595 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:00.509277  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.519727  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.523644  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.524605  1607 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:00.534291  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.476174  7762 ts_tablet_manager.cc:1929] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:04:00.549983  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.553910  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.554780  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.551667  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.555920  1533 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:00.530586  7421 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:04:00.553364  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 70555.8us
I20260709 13:04:00.551360  7632 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.559391  7421 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.567042  1605 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:00.567446  1605 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.567907  7421 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.568224  1605 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.568878  7594 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.569373  1605 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.571138  7594 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.571489  7616 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:00.572889  7749 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:00.561625  7762 log.cc:1199] T 443ffcfd9be74d9891a8cb9596947ca3 P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/443ffcfd9be74d9891a8cb9596947ca3
I20260709 13:04:00.584298  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.585065  1608 raft_consensus.cc:2393] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:04:00.585846  7799 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:04:00.571905  7616 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.598661  7762 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36926 (request call id 0) took 1339 ms. Trace:
W20260709 13:04:00.590173  7798 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:04:00.592514  7800 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:04:00.600155  7797 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:00.564149  7708 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.596498  7770 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.599129  7762 rpcz_store.cc:276] 0709 13:03:59.259600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.262606 (+  3006us) service_pool.cc:224] Handling call
0709 13:03:59.446859 (+184253us) ts_tablet_manager.cc:1151] Deleting tablet 443ffcfd9be74d9891a8cb9596947ca3
0709 13:03:59.468857 (+ 21998us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:59.984656 (+515799us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.465260 (+480604us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:00.598581 (+133321us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":171365,"thread_start_us":89959,"threads_started":1}
I20260709 13:04:00.607506  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:00.612380  1606 raft_consensus.cc:1240] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:00.632280  1610 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:04:00.639006  1609 raft_consensus.cc:1240] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:00.600759  7797 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.643560  7797 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.646064  7696 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:00.647432  7703 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:00.647817  7703 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.649375  7703 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.654098  1530 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:00.655151  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.655640  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:00.655980  1527 raft_consensus.cc:2410] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:04:00.656141  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:04:00.656672  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.656751  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:00.658360  1528 raft_consensus.cc:1240] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:00.660161  7700 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.660331  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:00.660751  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.662352  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.663451  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:00.660682  7700 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.660179  1675 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:00.666142  7700 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.666462  7543 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:00.667378  7543 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.668798  7595 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:00.668929  7456 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:00.670178  1681 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.670812  7770 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.671671  7746 raft_consensus.cc:3055] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:00.672052  7746 raft_consensus.cc:740] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.672860  7746 consensus_queue.cc:260] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.678794  7616 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.680739  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.685668  1426 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:00.689041  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 61947.5us
I20260709 13:04:00.692364  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:00.710985  1675 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:00.712109  7590 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:00.712853  7590 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.713357  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:00.714054  1527 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:00.711584  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.705190  1679 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:00.715354  7590 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.716619  1528 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:00.718330  7701 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:00.718783  7701 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.719103  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.719280  7701 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.719843  1677 raft_consensus.cc:2393] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 19: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:00.720583  1683 raft_consensus.cc:1275] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:00.718503  7746 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:00.723223  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.724136  7616 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.723922  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:00.688949  1426 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 13 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:00.732825  7543 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.734117  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 443ffcfd9be74d9891a8cb9596947ca3 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:00.737124  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:00.692838  7806 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:04:00.743937  1684 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:04:00.747982  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:00.754226  7665 consensus_queue.cc:1059] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:00.748502  1681 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:00.755509  7770 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:00.755975  7770 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.756903  7770 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.751065  1426 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.765533  7739 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:00.766114  7739 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.767757  7665 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:00.767699  7739 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.769745  7739 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.770809  7665 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:00.771771  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.775868  1682 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:04:00.777223  7701 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.782958  1576 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:00.758335  1574 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.784902  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:00.786098  1574 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.789726  1605 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:00.796607  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.797449  7349 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.798631  1574 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.800696  1678 raft_consensus.cc:2368] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23.
I20260709 13:04:00.803081  7349 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:00.805161  1675 raft_consensus.cc:1240] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:04:00.791348  7735 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:00.810141  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.822216  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.823370  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.797654  7394 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:00.798492  7511 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.844707  7349 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.856164  7797 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.856817  7797 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.864573  7797 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.864259  7804 consensus_queue.cc:1059] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:04:00.866499  7785 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:04:00.867115  7804 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:00.867676  7804 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.869096  7804 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:00.870661  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 72116.4us
I20260709 13:04:00.870767  7735 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:00.839993  7770 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.871858  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.874275  1574 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:00.874608  7666 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:00.875769  7771 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:00.876991  7735 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.864286  7349 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.795578  7632 consensus_queue.cc:1059] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:00.781266  1426 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 17, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:00.883939  7632 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:00.884572  7632 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:00.885707  7632 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.885113  1426 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 21, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 21 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.796440  7680 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:04:00.888715  1576 leader_election.cc:400] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23.
I20260709 13:04:00.890594  1576 leader_election.cc:403] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:00.893999  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49431.9us
I20260709 13:04:00.901054  1678 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:04:00.897104  7665 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.910287  7746 consensus_queue.cc:1048] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:00.838719  7294 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:04:00.905076  7804 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.924804  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:00.904089  7632 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:00.937224  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 363953us
I20260709 13:04:00.942731  7004 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:00.943332  7004 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:00.937216  7698 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.959494  7004 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:00.957201  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.923185  7707 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:00.961139  1648 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:00.943570  7323 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.002554  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:01.015970  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 73042.9us
I20260709 13:04:00.947142  7092 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:04:01.015481  7138 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:00.964617  7739 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.997570  7616 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.024796  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.023844  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.024266  7004 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:04:01.023720  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.003077  7323 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.030439  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.032541  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.033180  1528 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.035439  1531 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:00.962519  7698 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.039474  7323 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:01.028630  7815 log.cc:927] Time spent T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:04:01.051373  1678 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:01.053730  1530 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:01.057698  1533 raft_consensus.cc:2393] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:01.022886  7493 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:01.070230  7004 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:01.068542  7790 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:01.071719  7004 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.072146  1501 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:01.077210  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.078404  7703 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.087294  1528 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:01.066229  7751 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:01.098183  7092 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:01.106980  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.111590  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.111866  1604 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:04:01.112504  1682 raft_consensus.cc:2410] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:04:01.113502  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.114187  1684 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 20: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:01.113080  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.113044  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.118058  1679 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:04:01.119357  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:04:01.120442  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.085566  7543 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:04:01.093683  7751 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:01.126255  1526 raft_consensus.cc:2393] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 17: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:01.128219  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.128599  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.129257  1608 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:04:01.098479  7785 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.133453  7004 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.084348  7726 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:04:01.083747  7610 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:04:01.129359  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.142603  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.134560  7785 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.149473  7785 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.150367  1605 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:01.153954  7806 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:01.154332  7826 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.154582  7806 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:01.155035  7826 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.159425  7665 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23.
I20260709 13:04:01.138109  7323 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.164198  1610 raft_consensus.cc:2410] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:04:01.164881  7751 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.121526  7092 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:01.126103  7790 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.176651  7790 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.178730  7698 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.178835  7790 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.060269  1426 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.180794  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.181447  1532 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:01.168440  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.157465  7826 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.169757  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:01.190801  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.166487  7701 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.220813  1602 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:01.206595  7511 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:01.219434  7751 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:01.199321  7323 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.225551  7511 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.175544  7806 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.229844  7610 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:01.260257  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.239179  7511 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:01.292426  7825 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:01.305456  7708 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:01.305938  7708 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:01.309538  1532 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:01.180850  1426 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 18, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.280654  7806 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:01.322638  1532 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:01.326246  7349 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:04:01.306893  7708 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.333263  7708 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:01.338595  7323 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:01.339550  7828 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:01.240340  7092 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.343907  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.357515  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:01.344637  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.278085  7610 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:01.345567  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68963.4us
I20260709 13:04:01.346176  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.366703  7511 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.352671  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.372228  1681 raft_consensus.cc:2393] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 24: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:01.367929  7610 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.370062  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.347219  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.374214  1530 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:01.377452  1574 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.379537  7493 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.380221  7493 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.383342  7493 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.386756  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.395619  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.396286  1530 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:04:01.397511  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.397637  1501 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.398151  1681 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:04:01.399246  7831 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.399319  1501 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:01.400095  7831 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:01.400450  7831 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.400588  7610 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:01.400787  7831 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:01.401229  7610 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.401687  7610 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.406324  1501 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.407037  7746 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.407743  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.407537  7746 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.409081  7323 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:01.410213  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.410354  7746 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.410490  7323 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:01.411757  1498 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.412668  1426 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 10 to 12, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 12 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.416884  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.417390  1530 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
I20260709 13:04:01.417016  1501 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.421494  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:04:01.432847  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 85664.7us
I20260709 13:04:01.437781  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.438453  1530 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:01.436131  1574 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.440443  7590 raft_consensus.cc:2764] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:04:01.440584  7323 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:01.442205  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.448909  7349 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:01.449405  7349 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.449775  7349 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:01.446787  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 51478.8us
I20260709 13:04:01.465926  7829 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.466557  7829 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.440876  7703 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.442448  7823 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.470851  7823 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.468930  7829 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.477844  7831 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.481328  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.481995  1684 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:01.482048  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.482677  1675 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:01.482889  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.483455  1684 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:01.459429  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.499457  1648 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.444188  7493 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:01.501992  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.504869  1530 raft_consensus.cc:2393] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 23: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:01.503290  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.504953  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.513751  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:01.514197  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45688.8us
I20260709 13:04:01.455107  7746 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:01.514416  1683 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:01.516567  1501 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.517541  1501 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.518774  1501 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:01.520746  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.517024  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:01.523938  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.524773  1676 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:01.520710  7349 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.526777  1605 raft_consensus.cc:2393] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 22: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:01.486541  7823 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.535058  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.535880  1530 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.541206  7349 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.493000  7323 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:01.543088  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:01.544981  1678 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.507534  7726 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:01.530174  7092 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:01.513094  7632 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.515046  7665 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:01.561419  1530 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:01.520313  7543 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.585515  1574 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.581039  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.586702  1533 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:01.525915  7698 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:01.539218  7493 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:01.532938  7511 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.597488  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:01.600490  1677 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:01.595889  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:01.540652  7746 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:01.552839  7294 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:01.611677  1678 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:01.581409  7806 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.615943  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:01.581626  7092 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.621521  1604 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:01.582082  7665 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.603989  7771 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:01.595582  7698 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.556344  7323 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:01.609620  7834 log.cc:927] Time spent T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:01.630173  7665 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.640249  7698 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.621345  7806 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:01.641391  7831 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.626181  7092 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:01.657959  7806 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.657544  1604 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:01.620311  7790 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:01.621853  7632 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.610724  7817 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:01.642074  7771 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:04:01.633065  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 119953us
I20260709 13:04:01.660512  1498 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:01.667413  1677 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
W20260709 13:04:01.646966  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 103950us
I20260709 13:04:01.664088  7817 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.664125  7493 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.666214  7746 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.673648  7831 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:01.664520  7632 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:01.732784  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 204941us
I20260709 13:04:01.709302  7817 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:01.740952  7839 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:04:01.731114  7771 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.743610  7323 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:01.744822  7842 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:04:01.748759  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.723519  7610 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.735077  1426 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 9 to 17, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 17 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.731478  7749 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:01.767243  7749 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.732263  7831 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:01.768800  7831 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.769595  7749 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.772800  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.783172  1607 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 23: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
W20260709 13:04:01.783589  7751 consensus_meta.cc:287] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.006s
I20260709 13:04:01.801368  1529 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
W20260709 13:04:01.801609  7837 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.445s	user 0.005s	sys 0.000s
I20260709 13:04:01.803911  7739 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:01.804486  7739 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.806597  7739 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.807663  7806 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.810614  7610 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.815778  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.801761  1529 pending_rounds.cc:85] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 10
I20260709 13:04:01.817488  1529 pending_rounds.cc:107] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:04:01.817235  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:01.817791  1529 raft_consensus.cc:2889] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.819986  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.819335  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:01.821331  1676 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:01.821902  7092 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.766518  7665 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.829648  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:04:01.833122  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 5adb51b03e1142c4b3d2fe81051fecb9: Illegal state: Replica 36f53e9bfce749bbba4a4b34829f563d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:04:01.834129  7828 log.cc:927] Time spent T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:01.827206  7823 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.834882  7823 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:01.837245  7823 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.763470  1426 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.840790   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:01.847705  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:01.854163  1601 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:01.855754  7092 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.864977  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.867657  1532 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:01.868911  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:01.869604  1532 raft_consensus.cc:2368] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24.
I20260709 13:04:01.822813  7806 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.881033  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.884944  1682 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:01.885286  1676 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:01.886482  1603 raft_consensus.cc:2393] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:01.889599  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:01.890314  1682 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:01.875414  7830 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.891721  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:01.951819  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61892.2us
I20260709 13:04:01.952378  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.952852  1574 leader_election.cc:400] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24.
I20260709 13:04:01.953109  1603 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:01.953302  1574 leader_election.cc:403] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:04:01.954612  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:01.952562  1676 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:01.955715  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:01.956462  1604 raft_consensus.cc:2368] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:04:01.887184  7823 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:01.897466  7665 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.992163  1607 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:04:01.960167  7855 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:04:02.000128  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:02.001636  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.002247  1683 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.956990  7830 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.005564  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.006541  7830 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.978241  7632 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:01.988101  7698 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.008872  7698 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.009377  1647 leader_election.cc:400] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:04:02.009684  1647 leader_election.cc:403] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:04:02.010654  1647 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.011387  7701 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18.
I20260709 13:04:02.012073  7701 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.016547  1535 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 23: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
W20260709 13:04:01.969482  7836 log.cc:927] Time spent T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.616s	user 0.004s	sys 0.000s
I20260709 13:04:01.973662  7823 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.022282  7823 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:01.966434  7708 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:04:01.987175  7817 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.024736  1675 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:02.027107  1684 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:02.029062  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.030247  7323 raft_consensus.cc:2764] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:04:02.031270  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.033432  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.033751  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:02.034056  1684 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:02.034323  1535 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.035117  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.035917  1675 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:02.036013  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.036588  1604 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:02.038213  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:02.038858  1675 raft_consensus.cc:606] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:02.039393  1675 raft_consensus.cc:614] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:02.035101  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44789.8us
I20260709 13:04:02.046119  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.047087  1601 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:02.048906  1682 raft_consensus.cc:2368] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24.
I20260709 13:04:02.051568  1535 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:02.053694  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.047480  7701 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.052744  7693 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24.
I20260709 13:04:02.052906  7824 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:04:02.059922  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 67473.7us
I20260709 13:04:02.073710  7199 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:02.060439  7701 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.068516  7817 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:02.077754  7701 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:02.072327  1576 leader_election.cc:400] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 for earlier term 23. Current term is 24.
I20260709 13:04:02.080699  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:02.082479  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:02.083088  1684 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.083405  1684 raft_consensus.cc:614] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:02.084946  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.087874  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.088405  1610 raft_consensus.cc:2393] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 23: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.085816  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.089022  1605 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 23: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.089701  1683 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:02.073081  7511 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:04:02.091593  1609 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.059594  7594 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:02.094153  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:02.091420  7698 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:04:02.098186  7594 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:02.098603  7785 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:02.099107  7594 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.105934  1501 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.107627  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:02.108314  1683 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.099144  7785 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:02.122956  7785 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.123653  7698 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.131985  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9463f88e50794193abace66439f1975b"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:02.142365  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.143703  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:02.145208  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.146932  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.147399  1601 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.146458  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.149297  1609 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:02.153733  1601 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:02.148787  7817 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.157601  7806 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:02.163669  7806 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.164083  7806 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:02.169006  7864 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:04:02.170365  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:02.171320  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.172488  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.173231  7590 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:02.184510  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.185949  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:02.155139  7846 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:04:02.194394  7698 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:02.195099  7698 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.195559  7698 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.179493  7739 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:02.204079  7739 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.204499  7739 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.211515  1609 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:02.219007  1535 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:02.186770  7751 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.221315  1683 raft_consensus.cc:606] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:02.183100  7590 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.223605  1683 raft_consensus.cc:614] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:02.224344  7590 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.231159  7830 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:02.231778  7830 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:02.238270  7823 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.246335  7823 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.225183  7846 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:02.199963  7806 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.285104  7830 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.258699  7846 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.286996  7846 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:02.233501  7594 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:04:02.298012  7867 log.cc:927] Time spent T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:02.302217  7846 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.304754  7823 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.309834  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.312933  1676 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:04:02.325131  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.334101  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.335022  1604 raft_consensus.cc:2393] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 23: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.349706  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.350911  1601 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.364686  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.365830  1676 raft_consensus.cc:2368] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 23. Current term is 24.
I20260709 13:04:02.367913  1501 leader_election.cc:400] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 23. Current term is 24.
I20260709 13:04:02.368358  1501 leader_election.cc:403] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:04:02.334625  7854 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:02.316107  7632 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:04:02.371095  1675 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:02.374979  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:02.375766  1675 raft_consensus.cc:606] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:02.377375  7868 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:02.385006  1675 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:04:02.388808   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:02.390584   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:02.370596  7846 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.404362  7817 raft_consensus.cc:993] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:02.408938  7595 raft_consensus.cc:993] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:02.373457  7854 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.378844  7823 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.427381  7806 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:02.380414  7708 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:04:02.428939  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:02.430259  7594 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.478884  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 59752.6us
I20260709 13:04:02.467749  7349 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:04:02.472452  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:04:02.467657  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 77842.3us
I20260709 13:04:02.391772  7198 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.479729  1604 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.483851  7698 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.488241  7698 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.494875  7198 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.496302  7595 raft_consensus.cc:1081] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:02.468382  7854 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:02.477280  7817 raft_consensus.cc:1081] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:02.504590  1604 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
W20260709 13:04:02.520279  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 104934us
I20260709 13:04:02.522480  1684 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:02.523365  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.497758  7594 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.530678  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:02.531675  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.533444  1609 raft_consensus.cc:2393] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.537607  1530 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:04:02.520287  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35646
I20260709 13:04:02.540980  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35646
I20260709 13:04:02.545277  1603 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.545836  1603 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.543924  1604 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.547178  1604 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.539965  1676 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:02.559403  7883 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.560249  7883 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.562990  7883 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.567456  1501 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.568990  7751 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:02.568828  7590 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.569494  7751 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:02.570387  7751 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.571228  7590 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.572230  7198 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.575382  7092 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.575450  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:02.576156  1531 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:02.575973  7092 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.580327  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:02.580902  1531 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:02.581825  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.582828  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.555610  1604 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.586108  7739 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.541985  7824 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:04:02.585773  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.591933  1676 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:02.592459  7092 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.593036  1501 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.593674  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.594383  1680 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
I20260709 13:04:02.598364  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:02.599035  1531 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.555716  7701 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:02.602973  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.607286  7092 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:02.607721  7092 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:02.608103  7092 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.612020  1533 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:02.614122  1501 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
I20260709 13:04:02.614492  1501 leader_election.cc:403] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:02.616400  7701 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:02.617359  7701 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.619585  1574 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:02.624835  1530 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:04:02.632303  7806 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:02.632740  7198 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:02.633206  7198 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.633555  7198 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.635855  1604 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.623960  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
W20260709 13:04:02.601755  7855 log.cc:927] Time spent T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:02.643765  1533 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.646643  1683 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:02.568792  7726 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:04:02.649807  1603 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.654227  1531 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:02.660257  7666 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:02.660935  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.661532  1601 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:02.670512  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.671880  1678 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:04:02.644217  7698 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:02.672856  7698 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.674491  1609 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:02.675146  7698 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.675418  7823 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 23. Current term is 24.
I20260709 13:04:02.678032  7708 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:02.680197  7787 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:02.681110  1681 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:02.681486  1681 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:02.685567  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:02.686122  1532 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.690054  1529 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:02.694618  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.634598  7616 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.682235  1681 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.709321  1681 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.695425  1677 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:02.688941  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:02.703763  1603 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.714357  7092 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.716917  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.717545  1683 raft_consensus.cc:3055] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:02.717870  1683 raft_consensus.cc:740] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:02.719599  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.720170  1609 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.725847  1681 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:02.718619  1683 consensus_queue.cc:260] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.733619  1683 raft_consensus.cc:3060] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.738708  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:04:02.716545  7880 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.003s
I20260709 13:04:02.655982  7594 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:02.695858  7879 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
I20260709 13:04:02.716710  7616 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.727300  7739 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:02.761534  1533 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:02.763993  1609 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:02.754459  7092 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.761539  1532 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
W20260709 13:04:02.775393  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.780907  1683 raft_consensus.cc:2468] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:04:02.776373  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:02.791435  1574 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:02.772143  7616 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:02.824541  1650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.775723  7886 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:02.777907  7437 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.770516  7854 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.804986  7665 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:04:02.835433  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 109115us
I20260709 13:04:02.825268  7666 raft_consensus.cc:2804] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:04:02.850934  7888 log.cc:927] Time spent T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:02.857410  7198 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.835300  7437 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:02.879659  7886 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:04:02.901947  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 213063us
I20260709 13:04:02.904528  7823 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:02.916610  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:02.925478  7823 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:02.952986  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.953819  1603 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:02.956804  7437 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.960757  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:02.961584  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:02.962389  1676 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
W20260709 13:04:02.965832  7898 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:02.967314  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:02.968082  1603 raft_consensus.cc:2368] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
W20260709 13:04:02.968559  7892 log.cc:927] Time spent T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:04:02.970690  1675 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:02.974139  7894 log.cc:927] Time spent T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:04:02.975672  7889 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:04:02.980675  7198 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:02.989262  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.990041  1603 raft_consensus.cc:2368] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
I20260709 13:04:02.920559  7665 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:02.995338  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:02.996394  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:02.997277  1526 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:02.997241  1603 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:02.928635  7666 raft_consensus.cc:697] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:03.016755  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:03.017788  1609 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:03.023053  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:03.028514  7891 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 13:04:03.029352  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:03.005101  7198 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:03.167575  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:03.168489  1684 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.025103  7854 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:03.180816  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 264139us
W20260709 13:04:03.162166  7880 log.cc:927] Time spent T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:04:03.185245  1679 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 15.
I20260709 13:04:03.158962  7198 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.164294  7708 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.194816  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:03.007332  7886 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.223839  7666 consensus_queue.cc:237] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:03.228552  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.199057  7708 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.193450  7198 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.232873  1609 raft_consensus.cc:2393] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 15: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:03.026324  7665 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.259711  1603 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:03.172433  7823 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.198228  1684 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:03.230702  7394 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:04:03.328644  1576 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:04:03.365190  7890 log.cc:927] Time spent T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.513s	user 0.003s	sys 0.004s
I20260709 13:04:03.375733  1603 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:03.379554  7708 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:03.384671  7904 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:04:03.391528  7666 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:03.392347  7666 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:03.393515  7666 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.391543  1498 leader_election.cc:400] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
W20260709 13:04:03.335407  7616 consensus_meta.cc:287] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.002s
W20260709 13:04:03.416375  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 223701us
I20260709 13:04:03.417148  1498 leader_election.cc:400] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22.
I20260709 13:04:03.419257  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:03.435407  7831 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:03.440956  7831 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:03.457803  1501 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:03.467217  7092 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:03.467968  7092 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:03.453498  7698 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:03.483434  7092 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.432168  7616 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.471454  7698 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:03.517391  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:03.533517  1682 raft_consensus.cc:2368] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
W20260709 13:04:03.532783  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 211724us
I20260709 13:04:03.532356  7698 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.567708  7698 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.466260   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.748458  1501 leader_election.cc:400] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:04:03.781028  1501 leader_election.cc:403] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:04:03.749203  1679 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:03.758163  7616 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:03.758575  7698 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:03.786749  7698 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.747972  7198 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.797583  7198 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:03.798151  1648 consensus_peers.cc:597] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e14d61cd3a034962afeaefb62f6d9986. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.801295  1526 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:03.804946  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:03.820448  1676 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:04:03.810364  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:03.812433  1530 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:03.831775  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:03.803821  7824 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:04:03.828791  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 548239us
I20260709 13:04:03.843045  7824 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.852227  1604 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:03.853876  1601 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:03.857959  1604 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:03.839910  7905 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:04:03.867753  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:03.869282  1610 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.835047  7739 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:04:03.891676  7698 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535) with higher term. Message: Invalid argument: T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:04:03.896884  7701 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:03.899744  1610 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
W20260709 13:04:03.907047  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 69107.9us
I20260709 13:04:03.907943  7824 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:03.908641  7787 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:03.910264  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:03.912957  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:03.913717  7092 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:03.914175  7092 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:03.918082  1528 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:03.918525  1526 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:03.920996  1677 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:03.921967  1682 raft_consensus.cc:1275] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:03.922511  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:03.923341  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:03.927023  1676 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.928078  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:03.914885  7092 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.931202  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:03.930624  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:03.937994  1609 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:03.941370  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:03.942622  1678 raft_consensus.cc:2393] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 19: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:03.942569  1609 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:03.939607  7783 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:03.947580  7783 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.947947  7783 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:03.951404  1676 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:03.911955  7787 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:03.955870  1684 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:03.962195  7787 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:03.970398  7787 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.974033  7783 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:03.985612  7783 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:04.047919  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 107403us
W20260709 13:04:04.033401  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 96948.7us
I20260709 13:04:04.072057  7437 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:04:04.098733  7790 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.106886  7595 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:04.123056  7918 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.124001  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:04.125258  7827 consensus_queue.cc:1059] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:04.125560  7915 consensus_queue.cc:1048] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:04.126597  7827 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:04.127842  7908 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:04.128288  7908 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:04.129730  7908 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.131706  7908 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:04.142015  7349 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:04.143550  7349 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:04.144331  1609 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:04.144878  7349 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.153285  1532 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:04.163740  7817 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:04.181345  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:04.182468  1684 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:04.141455  7827 consensus_queue.cc:1243] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:04:04.189189  7092 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:04.189641  7092 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:04.191100  7092 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.221364  7950 ts_tablet_manager.cc:933] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:04.228070  7594 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.229177  7594 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.235435  7751 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.242220  1604 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:04.244163  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78584.1us
I20260709 13:04:04.259123  1683 raft_consensus.cc:1240] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:04.262250  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:04.273244  7594 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:04.308645  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:04.310184  7693 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:04.298393  7950 tablet_copy_client.cc:323] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:04.323817  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:04.326830  1528 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:04.346217  1528 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:04.348767  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:04.361195  7092 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:04.383461  1684 raft_consensus.cc:2468] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:04:04.391801  1678 raft_consensus.cc:1240] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:04.399106  1530 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:04:04.399740  1530 pending_rounds.cc:85] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 13
I20260709 13:04:04.399290  1675 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:04.400069  1530 pending_rounds.cc:107] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:04:04.406463  1530 raft_consensus.cc:2889] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:04.419276  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:04.421821  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet e14d61cd3a034962afeaefb62f6d9986 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:04.422596  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet e14d61cd3a034962afeaefb62f6d9986 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-e14d61cd3a034962afeaefb62f6d9986
I20260709 13:04:04.427206  7933 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.427064  7886 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:04.430264  7905 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.430972  7905 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.436192  7905 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:04.436269  1604 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:04.489464  7952 log.cc:927] Time spent T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:04:04.491107  7953 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:04:04.501055  1576 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:04.505927  7092 consensus_queue.cc:1059] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:04.510865  7092 raft_consensus.cc:3055] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:04.511286  7092 raft_consensus.cc:740] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:04.511569  7914 raft_consensus.cc:2804] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:04.512321  7092 consensus_queue.cc:260] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.513254  7934 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.514494  7198 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:04:04.524488  7092 raft_consensus.cc:3060] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:04.527168  1607 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:04:04.527117  7827 consensus_queue.cc:1175] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f9fb126997be4ec79f8f60fcd6764b00" responder_term: 16 status { last_received { term: 14 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:04.526669  1681 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:04:04.532162  7934 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.524161  7914 raft_consensus.cc:697] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:04.535809  7934 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:04.536571  7914 consensus_queue.cc:237] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.538203  7693 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:04.508260  7595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58862 (request call id 0) took 2067 ms. Trace:
I20260709 13:04:04.540405  7595 rpcz_store.cc:276] 0709 13:04:02.427136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.430804 (+  3668us) service_pool.cc:224] Handling call
0709 13:04:02.553580 (+122776us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58000aa0d0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697fd50aa 00007f4698057447 00007f469807470a 00007f469807576a 00007f469807491b 00007f469808003c 00007f469807f6b3 00007f469d03fd29 00007f46965be1d4 00007f46965be162
0709 13:04:02.969820 (+416240us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5800899fd0. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4697fd50aa 00007f4698057447 00007f469807470a 00007f469807576a 00007f469807491b 00007f469808003c 00007f469807f6b3 00007f469d03fd29 00007f46965be1d4 00007f46965be162
0709 13:04:03.019600 (+ 49780us) log.cc:844] Serialized 506 byte log entry
0709 13:04:03.733223 (+713623us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b18003d7080. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f06c0a 00007f469e646219 00007f4694f8ea40 00007f4694f894e4 00007f4694f89455 00007f4697fd2b0b 00007f4698057b63 00007f469807f752 00007f469d03fd29
0709 13:04:04.486147 (+752924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":401601,"raft.queue_time_us":496184,"raft.run_cpu_time_us":1881,"raft.run_wall_time_us":72762,"spinlock_wait_cycles":1009020416,"thread_start_us":101254,"threads_started":1,"wal-append.queue_time_us":348557,"wal-append.run_cpu_time_us":2350,"wal-append.run_wall_time_us":1002322}
I20260709 13:04:04.544525  7790 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.545115  7790 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:04.547724  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46834.8us
I20260709 13:04:04.552356  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:04.556670  7790 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:04.558878  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:04.559607  1529 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:04.566212  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:04.567477  1610 raft_consensus.cc:2410] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for term 20 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 7.
I20260709 13:04:04.567103  1648 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:04.576180  7598 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.576519  1527 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:04.582639  7594 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:04.573758  7595 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:04:04.600678  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d120199a9d3441ab490816cfe76664f: Illegal state: Replica 36f53e9bfce749bbba4a4b34829f563d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:04.591857  1694 tablet_copy_source_session.cc:215] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:04.594115  7595 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.610827  7595 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:04.624927  1531 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:04.627341  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:04.636741  7905 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:04.682219  7950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14d61cd3a034962afeaefb62f6d9986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.687029  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:04.691299  1679 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:04.692675  1604 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:04:04.696698  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:04.698408  7934 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:04.699896  7909 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:04.714193  1527 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:04:04.719453  7908 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:04.721845  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:04.714555  1527 pending_rounds.cc:85] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 11
I20260709 13:04:04.727856  1527 pending_rounds.cc:107] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:04:04.728184  1527 raft_consensus.cc:2889] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:04.747987  7693 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:04.789604  1679 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:04.791925  1605 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:04.795872  7908 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:04.797101  7666 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:04.802753  7831 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:04.831800  1499 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1af5bea2a3c6428b9b6c07c96e3160ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.803366  7595 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.834926  7595 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:04.835841  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:04.838059  1678 raft_consensus.cc:2393] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 25: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:04.840989  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:04.858609  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:04.859884  1683 raft_consensus.cc:1240] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:04:04.862164  7817 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.948168  7198 consensus_queue.cc:1059] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:04.954305  1501 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:04.955221  7751 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:04.958491  1429 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 19, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:04.973971  7967 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:04.975916  7967 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:04.974610  7751 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.992977  7967 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:04.994529  7967 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:04.998188  7966 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:04:05.004738  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:36926
W20260709 13:04:05.008433  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 149) took 22877 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.011798  7827 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:05.019433  1432 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 178) took 42011 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.002501  1429 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 15 to 17, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.024300  1676 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:05.019946  1432 rpcz_store.cc:269] 0709 13:03:23.008126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.085092 (+ 76966us) service_pool.cc:224] Handling call
0709 13:04:05.019210 (+41934118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459082,"reported_tablets":58}
I20260709 13:04:05.031654  1429 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:04:05.008965  1426 rpcz_store.cc:269] 0709 13:03:42.130458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.134286 (+  3828us) service_pool.cc:224] Handling call
0709 13:04:05.008199 (+22873913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:02.038983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:02.039568 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:02.039606 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:02.039628 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:02.040576 (+   948us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:02.040636 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:02.040654 (+    18us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:04:02.041347 (+   693us) tablet.cc:701] Row locks acquired
0709 13:04:02.041374 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:04:02.041558 (+   184us) write_op.cc:270] Start()
0709 13:04:02.041642 (+    84us) write_op.cc:276] Timestamp: P: 1783602242041492 usec, L: 0
0709 13:04:02.041653 (+    11us) op_driver.cc:348] REPLICATION: starting
0709 13:04:02.042173 (+   520us) log.cc:844] Serialized 4033 byte log entry
0709 13:04:02.346951 (+304778us) op_driver.cc:464] REPLICATION: finished
0709 13:04:02.544710 (+197759us) write_op.cc:301] APPLY: starting
0709 13:04:02.553614 (+  8904us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:02.665651 (+112037us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:02.665751 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:02.918233 (+252482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:02.943126 (+ 24893us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:04:02.943201 (+    75us) write_op.cc:312] APPLY: finished
0709 13:04:02.943626 (+   425us) log.cc:844] Serialized 96 byte log entry
0709 13:04:02.943852 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:02.944002 (+   150us) write_op.cc:454] Released schema lock
0709 13:04:02.944083 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:02.944450 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:02.944485 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1280107,"reported_tablets":57,"spinlock_wait_cycles":31104,"child_traces":[["op",{"apply.queue_time_us":187654,"apply.run_cpu_time_us":16294,"apply.run_wall_time_us":402278,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45907,"num_ops":10,"prepare.queue_time_us":36941,"prepare.run_cpu_time_us":3925,"prepare.run_wall_time_us":19851,"raft.queue_time_us":172536,"raft.run_cpu_time_us":20033,"raft.run_wall_time_us":153989,"replication_time_us":305136,"thread_start_us":332357,"threads_started":4,"wal-append.queue_time_us":15444,"wal-append.run_cpu_time_us":33059,"wal-append.run_wall_time_us":1930379}]]}
I20260709 13:04:05.040622  1610 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:05.045729  1429 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.047000  7950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41288 (request call id 119) took 1002 ms. Trace:
I20260709 13:04:05.047410  1429 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.049759  1429 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.053527  1429 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 12 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.047325  7950 rpcz_store.cc:276] 0709 13:04:04.044896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.052600 (+  7704us) service_pool.cc:224] Handling call
0709 13:04:04.221851 (+169251us) ts_tablet_manager.cc:934] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
0709 13:04:04.680645 (+458794us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:04.835102 (+154457us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:04.846851 (+ 11749us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:05.046341 (+199490us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:05.046633 (+   292us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:05.046884 (+   251us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:05.046928 (+    44us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":22249,"tablet-copy.queue_time_us":167619,"thread_start_us":131800,"threads_started":2}
I20260709 13:04:05.059505  7950 tablet_copy_client.cc:806] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:05.060175  7950 tablet_copy_client.cc:670] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:05.065940  7950 tablet_copy_client.cc:538] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:05.069653  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 443ffcfd9be74d9891a8cb9596947ca3 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:05.069440  1429 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 14 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.094350  7950 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:05.095180  1429 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 13 to 16, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.096475  1529 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:04:05.096896  1529 pending_rounds.cc:85] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 10
I20260709 13:04:05.097141  1529 pending_rounds.cc:107] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:04:05.097370  1529 raft_consensus.cc:2889] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.097918  1429 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 12 to 17, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.099390  7693 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:05.099612  1429 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 13 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.101001  1429 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 12 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.131748  1676 raft_consensus.cc:1275] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:05.133888  7967 consensus_queue.cc:1048] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:05.344528  7983 ts_tablet_manager.cc:933] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:05.363497  7983 tablet_copy_client.cc:323] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:05.365917  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 1af5bea2a3c6428b9b6c07c96e3160ef from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:05.366559  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 1af5bea2a3c6428b9b6c07c96e3160ef from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-1af5bea2a3c6428b9b6c07c96e3160ef
I20260709 13:04:05.375538  1545 tablet_copy_source_session.cc:215] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:05.397614  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af5bea2a3c6428b9b6c07c96e3160ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.446062  7950 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:05.447127  7950 tablet_bootstrap.cc:492] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:05.447856  7950 ts_tablet_manager.cc:1403] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.354s	user 0.039s	sys 0.012s
I20260709 13:04:05.475288  7950 raft_consensus.cc:359] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:05.478605  7950 raft_consensus.cc:740] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:05.487121  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:05.488679  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 443ffcfd9be74d9891a8cb9596947ca3 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
W20260709 13:04:05.490113  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 179) took 20372 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.495301  1428 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.479382  7950 consensus_queue.cc:260] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:05.499818  7950 ts_tablet_manager.cc:1434] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
W20260709 13:04:05.490566  1429 rpcz_store.cc:269] 0709 13:03:45.117992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.118215 (+   223us) service_pool.cc:224] Handling call
0709 13:04:05.490040 (+20371825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:05.142538 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:05.143107 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:05.143154 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:04:05.143172 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:05.165857 (+ 22685us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:05.165976 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:05.166012 (+    36us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:05.173331 (+  7319us) tablet.cc:701] Row locks acquired
0709 13:04:05.173368 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:04:05.173549 (+   181us) write_op.cc:270] Start()
0709 13:04:05.173708 (+   159us) write_op.cc:276] Timestamp: P: 1783602245173481 usec, L: 0
0709 13:04:05.173752 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:04:05.174497 (+   745us) log.cc:844] Serialized 4809 byte log entry
0709 13:04:05.327393 (+152896us) op_driver.cc:464] REPLICATION: finished
0709 13:04:05.337113 (+  9720us) write_op.cc:301] APPLY: starting
0709 13:04:05.352095 (+ 14982us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:05.385178 (+ 33083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:05.385307 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:05.426539 (+ 41232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:05.440202 (+ 13663us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:04:05.440278 (+    76us) write_op.cc:312] APPLY: finished
0709 13:04:05.444289 (+  4011us) log.cc:844] Serialized 112 byte log entry
0709 13:04:05.445203 (+   914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.445353 (+   150us) write_op.cc:454] Released schema lock
0709 13:04:05.445426 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:05.446009 (+   583us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.448656 (+  2647us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69607,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":9376,"apply.run_cpu_time_us":18073,"apply.run_wall_time_us":108755,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":35587,"prepare.run_cpu_time_us":19011,"prepare.run_wall_time_us":85245,"raft.queue_time_us":47914,"raft.run_cpu_time_us":995,"raft.run_wall_time_us":10172,"replication_time_us":153495,"thread_start_us":119289,"threads_started":4,"wal-append.queue_time_us":87060}]]}
I20260709 13:04:05.501744  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-e14d61cd3a034962afeaefb62f6d9986 received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:05.502202  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-e14d61cd3a034962afeaefb62f6d9986 on tablet e14d61cd3a034962afeaefb62f6d9986 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:05.505771  1428 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 17, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.507000  1428 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 19, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.507970  1428 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.509882  1428 catalog_manager.cc:5697] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.514902  7983 tablet_copy_client.cc:806] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:05.516746  7983 tablet_copy_client.cc:670] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:05.514354  1428 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.525460  1428 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.533160  1428 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 17, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 17 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.534819  1428 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.529227  7983 tablet_copy_client.cc:538] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:05.545939  1428 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.552076  1428 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.557971  1428 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 20, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.565666  1428 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.567289  1428 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.570319  1428 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.578696  1428 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.564867  7983 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:05.595407  1428 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.597335  1428 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.616204  1428 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.617755  1428 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.618944  1428 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.637274  1428 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.638578  1428 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.640053  1428 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.641667  1428 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 16 to 22, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 22 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.643237  1428 catalog_manager.cc:5697] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.670148  1428 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.671729  1428 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.673193  1428 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 11 to 14, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 14 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.674576  1428 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.675771  1428 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.697742  1428 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.699257  1428 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 13 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.701059  1428 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.702232  1428 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:05.703994  1428 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.707834  1428 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 20, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
W20260709 13:04:05.828118  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 66555.3us
I20260709 13:04:05.840380   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:05.872285  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 56563.9us
I20260709 13:04:05.919291  2212 raft_consensus.cc:1217] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:04:06.022732  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:06.023485  1683 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:06.023811  1683 raft_consensus.cc:614] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.034237  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fb69c6ea77a4b5680f9f2b453332415"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:06.034905  1534 raft_consensus.cc:606] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:06.035478  1534 raft_consensus.cc:614] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.039484  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:06.040297  1534 raft_consensus.cc:606] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:06.045096  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:06.045768  1681 raft_consensus.cc:606] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:06.048781  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:06.049417  1681 raft_consensus.cc:606] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:06.049753  1681 raft_consensus.cc:614] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.051641   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:06.053488   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:06.067181  7983 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:06.068217  7983 tablet_bootstrap.cc:492] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:06.069006  7983 ts_tablet_manager.cc:1403] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.504s	user 0.030s	sys 0.028s
I20260709 13:04:06.104480  7983 raft_consensus.cc:359] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:06.116072  7983 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:06.116784  7983 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:06.128159  7983 ts_tablet_manager.cc:1434] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:04:06.130303  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1af5bea2a3c6428b9b6c07c96e3160ef received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:06.130831  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1af5bea2a3c6428b9b6c07c96e3160ef on tablet 1af5bea2a3c6428b9b6c07c96e3160ef with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:06.271473  1432 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:06.334689  7994 raft_consensus.cc:993] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:06.335275  7994 raft_consensus.cc:1081] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:06.348958  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 150) took 4106 ms. Trace:
I20260709 13:04:06.349169  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:06.349830  1606 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.353708  1606 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:06.358060  1432 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:06.371341  2212 raft_consensus.cc:1217] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:04:06.378499  7665 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.379148  7665 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.349422  1428 rpcz_store.cc:276] 0709 13:04:02.242304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.242461 (+   157us) service_pool.cc:224] Handling call
0709 13:04:06.348871 (+4106410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:05.916664 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:05.959556 (+ 42892us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:05.960447 (+   891us) write_op.cc:435] Acquired schema lock
0709 13:04:05.961132 (+   685us) tablet.cc:662] Decoding operations
0709 13:04:06.027229 (+ 66097us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.027312 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.027337 (+    25us) tablet.cc:685] Acquiring locks for 37 operations
0709 13:04:06.030530 (+  3193us) tablet.cc:701] Row locks acquired
0709 13:04:06.030542 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:04:06.030660 (+   118us) write_op.cc:270] Start()
0709 13:04:06.030750 (+    90us) write_op.cc:276] Timestamp: P: 1783602246030621 usec, L: 0
0709 13:04:06.030762 (+    12us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.031565 (+   803us) log.cc:844] Serialized 14509 byte log entry
0709 13:04:06.083318 (+ 51753us) op_driver.cc:464] REPLICATION: finished
0709 13:04:06.105529 (+ 22211us) write_op.cc:301] APPLY: starting
0709 13:04:06.105623 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:06.175219 (+ 69596us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:06.175346 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:06.265694 (+ 90348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:06.266214 (+   520us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=74,key_file_lookups=74,delta_file_lookups=74,mrs_lookups=0
0709 13:04:06.266283 (+    69us) write_op.cc:312] APPLY: finished
0709 13:04:06.266917 (+   634us) log.cc:844] Serialized 315 byte log entry
0709 13:04:06.267090 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.267359 (+   269us) write_op.cc:454] Released schema lock
0709 13:04:06.267430 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:06.273943 (+  6513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.273974 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6259,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":21907,"apply.run_cpu_time_us":48203,"apply.run_wall_time_us":168385,"cfile_cache_hit":150,"cfile_cache_hit_bytes":158713,"num_ops":37,"prepare.queue_time_us":67573,"prepare.run_cpu_time_us":8831,"prepare.run_wall_time_us":115256,"replication_time_us":52371,"spinlock_wait_cycles":21376,"thread_start_us":77647,"threads_started":2}]]}
I20260709 13:04:06.383801  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:06.396660  1534 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
I20260709 13:04:06.390470  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:06.397795  1676 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
I20260709 13:04:06.399361  7665 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:06.399420  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:06.404731  7967 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:06.407506  7967 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.407959  7967 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:06.382772  1606 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.413305  1606 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:06.414925  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:06.427229  1427 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 16 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.415586  1676 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:06.434412  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 443ffcfd9be74d9891a8cb9596947ca3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:06.437434  1427 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 22, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.445122  8002 raft_consensus.cc:993] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:06.445665  8002 raft_consensus.cc:1081] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:06.449506  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:06.450067  1534 raft_consensus.cc:3055] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:06.450349  1534 raft_consensus.cc:740] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:06.451071  1534 consensus_queue.cc:260] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.454041  1534 raft_consensus.cc:3060] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:06.440828  1431 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 177) took 62318 ms (client timeout 15000 ms). Trace:
W20260709 13:04:06.455778  1431 rpcz_store.cc:269] 0709 13:03:04.122870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.123066 (+   196us) service_pool.cc:224] Handling call
0709 13:04:06.440602 (+62317536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1051293,"reported_tablets":58}
I20260709 13:04:06.448467  7967 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.462214  7967 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:06.458930  1427 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 16 to 25, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.462316  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35646
I20260709 13:04:06.467631  1606 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.472671  1606 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:06.471680  1427 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 12 to 17, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.481141  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:06.481855  1683 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:06.466240  1534 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:06.491736  7999 raft_consensus.cc:1064] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:06.494761  7999 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:06.509346  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:06.510010  1530 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:06.513118  1574 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:06.514604  7989 raft_consensus.cc:2804] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:06.515138  7989 raft_consensus.cc:697] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:06.516045  7989 consensus_queue.cc:237] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.518388  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 26.
I20260709 13:04:06.520862  1683 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 26.
I20260709 13:04:06.534240  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:06.536672  7967 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:06.537281  7967 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:06.538118  7967 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.543973  2212 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:06.546108  8000 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:06.553383  1606 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.560178  1676 raft_consensus.cc:2468] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:06.571852  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:06.573689  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:06.574504  1676 raft_consensus.cc:3055] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:06.574891  1676 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:06.573611  1606 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:06.590332  1534 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:06.603678  1606 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:06.611505  1531 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:06.605357  1676 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.608292  8000 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:04:06.633872  1676 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:06.636888  1534 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:06.641007  7999 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:06.647663  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 443ffcfd9be74d9891a8cb9596947ca3 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:06.674484  1574 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:06.676826  8013 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:06.677397  8013 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:06.678287  8013 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:06.696194  1430 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.715075  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 180) took 4522 ms. Trace:
I20260709 13:04:06.713949  1676 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:06.715785  1427 rpcz_store.cc:276] 0709 13:04:02.192384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.208148 (+ 15764us) service_pool.cc:224] Handling call
0709 13:04:06.714983 (+4506835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.481934 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.482498 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.482531 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:04:06.482552 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:06.483107 (+   555us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.483164 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.483195 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:04:06.483683 (+   488us) tablet.cc:701] Row locks acquired
0709 13:04:06.483703 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:06.483841 (+   138us) write_op.cc:270] Start()
0709 13:04:06.483974 (+   133us) write_op.cc:276] Timestamp: P: 1783602246483795 usec, L: 0
0709 13:04:06.484005 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.508208 (+ 24203us) log.cc:844] Serialized 1706 byte log entry
0709 13:04:06.510847 (+  2639us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698074e28 00007f469baaf581 00007f469baaed58 00007f469bab39f1 00007f469bab39a9 00007f469bab3939 00007f469bab3901 00007f469bab2b2d 000000000038f354 000000000038f199
0709 13:04:06.514521 (+  3674us) op_driver.cc:464] REPLICATION: finished
0709 13:04:06.514971 (+   450us) write_op.cc:301] APPLY: starting
0709 13:04:06.515044 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:06.517219 (+  2175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:06.517241 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:06.526218 (+  8977us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:06.526562 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:04:06.526618 (+    56us) write_op.cc:312] APPLY: finished
0709 13:04:06.526877 (+   259us) log.cc:844] Serialized 49 byte log entry
0709 13:04:06.527053 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.527152 (+    99us) write_op.cc:454] Released schema lock
0709 13:04:06.527197 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:06.540101 (+ 12904us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.540141 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15911,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":6261,"apply.run_wall_time_us":25029,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":1890,"prepare.run_cpu_time_us":5905,"prepare.run_wall_time_us":29076,"replication_time_us":30313,"spinlock_wait_cycles":53970816}]]}
I20260709 13:04:06.781363  8010 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:06.809170  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.813974  2212 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:06.815410  1530 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:06.833142  1432 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:06.856339  1604 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:06.871295  1427 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 24, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.904426  1427 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.906128  1427 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 22, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.907559  1427 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 23. New cstate: current_term: 23 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.909133  1427 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.919296  1427 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.921325  1427 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 22, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.923115  1427 catalog_manager.cc:5697] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 14 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.932117  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 160) took 11075 ms. Trace:
I20260709 13:04:06.932799  1427 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.934590  1427 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.935995  1427 catalog_manager.cc:5697] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:06.938756  1427 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 19, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.942467  7993 raft_consensus.cc:1064] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:06.943933  1676 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:06.948575  7665 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:06.949371  7993 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:06.954952  1430 rpcz_store.cc:276] 0709 13:03:55.856623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.856945 (+   322us) service_pool.cc:224] Handling call
0709 13:04:06.931959 (+11075014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.819877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.820423 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.820458 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:06.820474 (+    16us) tablet.cc:662] Decoding operations
0709 13:04:06.820858 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.820907 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.820933 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:06.821220 (+   287us) tablet.cc:701] Row locks acquired
0709 13:04:06.821237 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:06.821385 (+   148us) write_op.cc:270] Start()
0709 13:04:06.821478 (+    93us) write_op.cc:276] Timestamp: P: 1783602246821331 usec, L: 0
0709 13:04:06.821497 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.824114 (+  2617us) log.cc:844] Serialized 925 byte log entry
0709 13:04:06.824834 (+   720us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698074e28 00007f469baaf581 00007f469baaed58 00007f469bab39f1 00007f469bab39a9 00007f469bab3939 00007f469bab3901 00007f469bab2b2d 000000000038f354 000000000038f199
0709 13:04:06.826675 (+  1841us) op_driver.cc:464] REPLICATION: finished
0709 13:04:06.827153 (+   478us) write_op.cc:301] APPLY: starting
0709 13:04:06.827224 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:06.828547 (+  1323us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:06.828569 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:06.829846 (+  1277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:06.829996 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:06.830037 (+    41us) write_op.cc:312] APPLY: finished
0709 13:04:06.830239 (+   202us) log.cc:844] Serialized 33 byte log entry
0709 13:04:06.830396 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.830482 (+    86us) write_op.cc:454] Released schema lock
0709 13:04:06.830520 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:06.830876 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.830905 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":518571,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":3696,"apply.run_wall_time_us":3696,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":3262,"prepare.run_wall_time_us":5107,"replication_time_us":5048,"spinlock_wait_cycles":4532608}]]}
I20260709 13:04:07.010581  1531 raft_consensus.cc:1275] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:07.021565  2212 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:07.024180  7997 consensus_queue.cc:1048] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:07.030700  7994 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:07.059643  1604 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:07.065521  7831 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:07.078061   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:07.082864  1681 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:07.084666  7994 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:07.088388  1534 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:04:07.094798  7665 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:07.099848  1534 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:07.104182  7665 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:07.140705  1683 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:07.148270  7997 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:07.158752  7996 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.168283  1606 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.172282  2212 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.178455  1684 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:04:07.193081  7989 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:04:07.268887  1432 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 21 to 26, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.279893  1432 catalog_manager.cc:5697] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 23 to 24, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.306824  1432 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 19 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:07.343539  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 95539.4us
I20260709 13:04:07.348636  1682 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:07.384898  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 105698us
I20260709 13:04:07.394526  1430 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.564867  1530 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:07.570349  2212 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:07.574530  1606 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:07.574889  7996 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:07.577555  1682 consensus_queue.cc:237] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:07.582846  7994 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.584121  2212 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.592250  1606 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:07.594173  8010 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:07.595853  2209 raft_consensus.cc:1275] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:07.601666  8012 consensus_queue.cc:1048] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:07.617322  8018 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.608498  1604 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.633173  2209 raft_consensus.cc:2955] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.636266  8037 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:07.646904  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1af5bea2a3c6428b9b6c07c96e3160ef with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:07.654688  1432 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.660422  1610 raft_consensus.cc:2955] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.691565  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e14d61cd3a034962afeaefb62f6d9986 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:07.696410  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af5bea2a3c6428b9b6c07c96e3160ef with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:07.701958  1427 catalog_manager.cc:5697] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 12 to 13, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:07.732203  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet e14d61cd3a034962afeaefb62f6d9986 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:07.743244  8040 tablet_replica.cc:333] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:07.744678  8040 raft_consensus.cc:2243] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.745956  8040 raft_consensus.cc:2272] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.761444  8040 ts_tablet_manager.cc:1916] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:07.790913  8041 tablet_replica.cc:333] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:07.792665  8041 raft_consensus.cc:2243] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.793531  8041 raft_consensus.cc:2272] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.819458  8040 ts_tablet_manager.cc:1929] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:04:07.825743  8040 log.cc:1199] T 1af5bea2a3c6428b9b6c07c96e3160ef P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/1af5bea2a3c6428b9b6c07c96e3160ef
I20260709 13:04:07.827952  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet 1af5bea2a3c6428b9b6c07c96e3160ef (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:07.811442  8041 ts_tablet_manager.cc:1916] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:07.949708  8041 ts_tablet_manager.cc:1929] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:04:07.956857  8041 log.cc:1199] T e14d61cd3a034962afeaefb62f6d9986 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/e14d61cd3a034962afeaefb62f6d9986
I20260709 13:04:07.958904  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet e14d61cd3a034962afeaefb62f6d9986 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
W20260709 13:04:08.260859  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 57312.8us
I20260709 13:04:08.427738   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:08.612550  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:08.613240  1604 raft_consensus.cc:606] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:08.620971  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:08.621569  1610 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:08.624735  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:08.625308  1610 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:08.632083  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:08.632710  1604 raft_consensus.cc:606] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:08.644488  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:08.645140  1531 raft_consensus.cc:606] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:08.647083   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:08.649151   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:08.721722  7989 raft_consensus.cc:993] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:08.722321  8032 raft_consensus.cc:1081] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:08.725374  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:08.725973  1682 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.726313  1682 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:08.728538  7989 raft_consensus.cc:993] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:08.729013  7989 raft_consensus.cc:1081] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:08.731348  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:04:08.731868  1531 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.732213  1531 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.735453  1682 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.738809  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:08.739405  1530 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:08.746698  1530 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:04:08.747391  1531 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.747903  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:08.748795  8018 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:08.749293  8018 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:08.750200  8018 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.759910  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:08.760208  1531 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:08.760601  1610 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:08.760951  1610 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:08.761129  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:08.761859  1681 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.761699  1610 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.762796  1610 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.766474  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:08.767009  1606 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:08.767336  1606 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:08.766100  1682 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:08.768018  1606 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.769155  8032 raft_consensus.cc:993] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:08.769309  1606 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:08.769624  8032 raft_consensus.cc:1081] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:08.769636  1681 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:08.772133  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:08.772645  1676 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.773005  1676 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:08.780004  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:08.781212  8042 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:08.781329  1676 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.781849  8042 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:08.785264  8042 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.789965  1676 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:08.795336  1610 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:08.818935  1606 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:04:08.833016  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:08.834276  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:08.835060  1530 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:08.836856  1610 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:04:08.837288  1610 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:08.841365  1610 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.843895  1610 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:08.833715  1427 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 15, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:08.866236  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 57514.6us
I20260709 13:04:08.875550  1530 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 27.
I20260709 13:04:08.883911  1610 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 27.
I20260709 13:04:08.885165  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:08.896205  8018 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:04:08.897236  8018 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:08.898159  8018 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.902179  8032 raft_consensus.cc:993] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:08.904832  8032 raft_consensus.cc:1081] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:08.911538  1530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:04:08.912138  1530 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.912482  1530 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.911922  1430 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.918577  1530 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.922026  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:08.922638  1678 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.928154  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:08.928846  1610 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:08.929216  1610 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:08.930227  1610 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.933527  1530 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:08.939154  1678 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:08.942428  1501 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:08.943405  8042 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:08.944013  8042 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:08.945472  8042 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:08.949937  1610 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:08.955344  1610 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:08.982388  1430 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 26 to 27, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 27 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.003178  1427 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.106945  8042 raft_consensus.cc:993] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:09.107517  8042 raft_consensus.cc:1081] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:09.146556  1530 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:09.150501  8012 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:09.153374  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:09.154006  1678 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.154357  1678 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:09.165850  1678 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:09.169324  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:09.170835  1530 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:09.171509  1530 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:09.180714  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:09.181569  1606 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:09.176115  1530 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:09.209785  1530 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:09.176015  1678 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:09.228353  1606 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 25.
I20260709 13:04:09.228916  1610 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:09.233601  8042 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:09.234048  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:09.239586  1530 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 25.
I20260709 13:04:09.256543  1604 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:09.244283  8054 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:09.266197  1678 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:09.279583  8025 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:04:09.290264  8018 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:09.314198  1531 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:04:09.315239  1676 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:09.315860  8018 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:04:09.324518  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 61885.2us
I20260709 13:04:09.346874  1604 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:04:09.350196  8018 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:09.370687  1681 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:04:09.398381  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 71191.6us
I20260709 13:04:09.398798  7996 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:04:09.441813  8054 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:09.475327  1610 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:04:09.481422  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d501527377474732bddb08ed904bd34d. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:09.488651  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 44524.2us
W20260709 13:04:09.492255  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 48212.1us
W20260709 13:04:09.505417  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 102566us
I20260709 13:04:09.489833  8012 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:04:09.532441  8054 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:09.584818  1530 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:09.588714  8060 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:09.601372  1604 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:09.609236  8079 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:09.650403   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:09.688589  8012 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:09.704854  1610 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:09.748699  8088 log.cc:927] Time spent T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:04:09.787552  1427 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:09.848217  1530 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:09.855789  1430 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 24 to 25, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 25 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.874240  8093 ts_tablet_manager.cc:933] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:09.904152  8093 tablet_copy_client.cc:323] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:09.906113  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet d501527377474732bddb08ed904bd34d from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:09.906584  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet d501527377474732bddb08ed904bd34d from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-d501527377474732bddb08ed904bd34d
I20260709 13:04:09.939170  1694 tablet_copy_source_session.cc:215] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:09.961962  1604 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:09.968679  1606 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:04:09.970458  8060 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:09.972429  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d501527377474732bddb08ed904bd34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.989920  1676 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:04:09.992096  1574 consensus_peers.cc:597] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: baf31533a97f4325919d60e19d73b3f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.994063  7989 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:09.998147  1530 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:09.999788  7989 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:10.009982  8077 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.025192  1528 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:04:10.027406  1676 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.028839  8060 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:10.043094  1531 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:10.100347  1530 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.123339  1683 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:04:10.124696  1499 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73161049b574469ea08e360e2def1aac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.124976  7996 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:10.126318  1606 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:10.129392  7996 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:10.144158  8090 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.174626  1432 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.169389  1683 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.200904  1535 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:10.212881  1499 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb1b18d08269419485367169ac7d79c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.218163  1676 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:10.219553  7996 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:10.220382  1427 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.225032  1604 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.227799  1610 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:10.229278  8069 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.232899  8079 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:10.239058  1610 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.240234  8093 tablet_copy_client.cc:806] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.241671  1678 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.246279  8093 tablet_copy_client.cc:670] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.252333  8093 tablet_copy_client.cc:538] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.271579  1427 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 15, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:10.363210  8093 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:10.500952  8108 ts_tablet_manager.cc:933] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:10.510532  8108 tablet_copy_client.cc:323] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:10.514753  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet baf31533a97f4325919d60e19d73b3f2 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:10.515420  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet baf31533a97f4325919d60e19d73b3f2 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-baf31533a97f4325919d60e19d73b3f2
I20260709 13:04:10.524868  1620 tablet_copy_source_session.cc:215] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:10.530872  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf31533a97f4325919d60e19d73b3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.553117  8110 ts_tablet_manager.cc:933] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:10.561096  8110 tablet_copy_client.cc:323] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:10.562693  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 73161049b574469ea08e360e2def1aac from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:10.563246  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 73161049b574469ea08e360e2def1aac from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-73161049b574469ea08e360e2def1aac
I20260709 13:04:10.583666  1545 tablet_copy_source_session.cc:215] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:10.587322  8110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73161049b574469ea08e360e2def1aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.587877  8093 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:10.589051  8093 tablet_bootstrap.cc:492] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:10.590194  8093 ts_tablet_manager.cc:1403] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.227s	user 0.046s	sys 0.007s
I20260709 13:04:10.594834  8108 tablet_copy_client.cc:806] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.597250  8108 tablet_copy_client.cc:670] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.610592  8108 tablet_copy_client.cc:538] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.593596  8093 raft_consensus.cc:359] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:10.624367  8093 raft_consensus.cc:740] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:10.632513  8093 consensus_queue.cc:260] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:10.642925  8093 ts_tablet_manager.cc:1434] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:04:10.669742  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-d501527377474732bddb08ed904bd34d received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:10.670217  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-d501527377474732bddb08ed904bd34d on tablet d501527377474732bddb08ed904bd34d with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:10.656337  8108 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:10.736763  8110 tablet_copy_client.cc:806] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.753201  8110 tablet_copy_client.cc:670] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.774474  8110 tablet_copy_client.cc:538] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.784356  8093 ts_tablet_manager.cc:933] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:10.819089  8110 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:10.828399  2209 raft_consensus.cc:1217] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:04:10.855770  8093 tablet_copy_client.cc:323] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:10.857839  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet bb1b18d08269419485367169ac7d79c5 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:10.859059  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet bb1b18d08269419485367169ac7d79c5 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-bb1b18d08269419485367169ac7d79c5
I20260709 13:04:10.868167  1545 tablet_copy_source_session.cc:215] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:10.871678  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1b18d08269419485367169ac7d79c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.903438   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:10.938380  8093 tablet_copy_client.cc:806] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.939096  8093 tablet_copy_client.cc:670] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.961900  8093 tablet_copy_client.cc:538] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.985798  8108 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.003669  8108 tablet_bootstrap.cc:492] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:11.004580  8108 ts_tablet_manager.cc:1403] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.348s	user 0.045s	sys 0.008s
I20260709 13:04:11.010704  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:11.011418  1535 raft_consensus.cc:606] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:11.022018  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:11.022629  1676 raft_consensus.cc:606] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:11.025635  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:11.026206  1604 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:11.029027  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:11.029598  1678 raft_consensus.cc:606] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:11.032558  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:11.033209  1604 raft_consensus.cc:606] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:11.034689  7989 raft_consensus.cc:993] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:11.032558  8108 raft_consensus.cc:359] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.035610  8108 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:11.035874   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:11.036368  8108 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.037602   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:11.035256  7989 raft_consensus.cc:1081] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:11.039835  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:11.040429  1678 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.040772  1678 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:11.043745  8093 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:11.052078  1678 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.057153  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:11.057797  1530 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:11.071714  1530 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 26.
I20260709 13:04:11.052078  8108 ts_tablet_manager.cc:1434] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:04:11.082394  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-baf31533a97f4325919d60e19d73b3f2 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:11.082780  1678 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:11.082914  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-baf31533a97f4325919d60e19d73b3f2 on tablet baf31533a97f4325919d60e19d73b3f2 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:11.084973  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:11.085610  1604 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:04:11.085891  1604 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:11.086804  1604 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.101737  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:11.087823  1604 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:11.121784  8012 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:11.122370  8012 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:11.123252  8012 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.145416  8059 raft_consensus.cc:993] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:11.146402  8059 raft_consensus.cc:1081] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:11.162664  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:11.163287  1535 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.163655  1535 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:11.207026  8110 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.208047  8110 tablet_bootstrap.cc:492] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:11.208762  8110 ts_tablet_manager.cc:1403] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.390s	user 0.031s	sys 0.023s
I20260709 13:04:11.233837  1427 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 25 to 26, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 26 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.208173  1604 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 26.
I20260709 13:04:11.248504  1535 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.255234  1535 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:11.257162  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:11.258713  1604 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:11.279856  1604 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:11.282455  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:11.288720  8112 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:11.289278  8112 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:11.290107  8112 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.301194  8084 raft_consensus.cc:993] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:11.342170  8120 raft_consensus.cc:1081] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:11.348021  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:11.348647  1531 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.349018  1531 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.387261  8110 raft_consensus.cc:359] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.388370  8110 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:11.389135  8110 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.426540  2212 raft_consensus.cc:1217] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:04:11.419087  1431 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.432796  1531 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.435221  1531 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:11.440184  8110 ts_tablet_manager.cc:1434] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.223s	user 0.008s	sys 0.001s
I20260709 13:04:11.442245  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:11.445408  1604 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.462919  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-73161049b574469ea08e360e2def1aac received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:11.463047  8059 raft_consensus.cc:1064] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:11.463492  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-73161049b574469ea08e360e2def1aac on tablet 73161049b574469ea08e360e2def1aac with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:11.466440  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:11.467132  1676 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:11.467499  1676 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:11.466691  8059 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:11.476883  1676 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.478211  1676 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:11.485041  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:11.485671  1679 raft_consensus.cc:3055] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:11.485972  1679 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:11.486688  1679 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.487883  1679 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.494583  1604 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:11.496438  1676 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:11.496248  1498 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:11.505155  7996 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:11.507792  1679 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:11.538347  8083 raft_consensus.cc:993] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:11.539055  8083 raft_consensus.cc:1081] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:11.542353  8112 raft_consensus.cc:993] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:11.543033  8112 raft_consensus.cc:1081] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
W20260709 13:04:11.564406  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 66493.3us
I20260709 13:04:11.573335  7996 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:11.574443  7996 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.600251  1604 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:11.600905  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:11.601480  1679 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.601810  1679 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.602491  8060 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:11.603303  2212 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:11.605229  8059 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:11.610132  1679 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.626577  1679 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:11.629014  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:11.629654  1610 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.648749  1610 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:11.654134  1606 raft_consensus.cc:1240] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:11.658645  1647 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:11.659622  8060 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:11.660351  8060 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:11.661538  8060 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.664934  1535 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:04:11.665963  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 161386us
I20260709 13:04:11.667404  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:11.667999  1535 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:11.668355  1535 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:11.669245  1535 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.672006  1535 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:11.679857  1535 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:11.683645  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:11.684473  1676 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.684906  1676 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:11.696597  8059 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:11.701391  8084 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:11.702713  1604 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:11.702924  1610 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:04:11.699633  1676 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.714586  1535 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:04:11.714397  8059 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:11.715968  8059 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:11.718497  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:11.719089  1530 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:11.739974  1530 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:11.749571  1676 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:11.757814  8093 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:11.763039  2212 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:11.776391  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:11.777122  1610 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:11.778074  1610 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:11.778966  1610 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.780108  1610 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:11.788050  1430 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:11.803877  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 73030.9us
I20260709 13:04:11.805785  1648 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
W20260709 13:04:11.873629  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 67934.3us
W20260709 13:04:11.813900  8144 log.cc:927] Time spent T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:11.814684  8093 tablet_bootstrap.cc:492] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:11.875264  8084 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:11.875890  8084 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:11.860996  2209 raft_consensus.cc:1217] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:04:11.876909  8084 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:11.878005  8093 ts_tablet_manager.cc:1403] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.835s	user 0.059s	sys 0.038s
I20260709 13:04:11.883425  1427 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 18 to 19, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.886904  1535 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:11.890470  1676 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:11.896654  1610 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:11.883445  8093 raft_consensus.cc:359] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.897632  8093 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:11.897560  8134 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:11.898383  8093 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:11.901096  8093 ts_tablet_manager.cc:1434] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:11.902769  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-bb1b18d08269419485367169ac7d79c5 received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:11.903213  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-bb1b18d08269419485367169ac7d79c5 on tablet bb1b18d08269419485367169ac7d79c5 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:11.996611  8083 raft_consensus.cc:1064] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:12.000445  1609 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:12.002928  8083 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:12.021967  1432 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.038594   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:12.039184  1679 consensus_queue.cc:237] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:12.047184  2209 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.048678  8084 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.049149  1531 raft_consensus.cc:1275] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.050825  8084 consensus_queue.cc:1048] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.060288  8136 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:12.061024  8129 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.065936  2209 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.082542  1531 raft_consensus.cc:2955] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.093948  1432 catalog_manager.cc:5697] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 19 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.133811  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet d501527377474732bddb08ed904bd34d with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:12.096932  1609 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:12.141036  1430 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.155730  2209 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.160341  8133 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.172489  1676 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:12.173053  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d501527377474732bddb08ed904bd34d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:12.174111  8134 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:12.179047  8134 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:12.222466  1679 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.228153  1530 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.231451  7989 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.260589  7989 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.265758  8155 tablet_replica.cc:333] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:12.276286  2209 raft_consensus.cc:1217] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:04:12.282368  8155 raft_consensus.cc:2243] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.283269  8155 raft_consensus.cc:2272] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.307775  1610 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:12.311779  8129 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:12.318102  1531 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:12.320472  8059 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:04:12.320021  8155 ts_tablet_manager.cc:1916] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:04:12.353756  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 94120.6us
I20260709 13:04:12.377990  7989 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:12.404012  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 125037us
I20260709 13:04:12.415984  1676 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.466666  8163 raft_consensus.cc:1064] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:12.517566  1610 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:12.523149  2212 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:12.525177  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47551.1us
I20260709 13:04:12.530012  8155 ts_tablet_manager.cc:1929] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:04:12.530462  8155 log.cc:1199] T d501527377474732bddb08ed904bd34d P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/d501527377474732bddb08ed904bd34d
I20260709 13:04:12.530292  8121 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.479681  8163 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:12.529688  1430 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:12.534248  8166 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:04:12.535673  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet d501527377474732bddb08ed904bd34d (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:12.564071  1529 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:12.600768  8180 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:12.602905  1610 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:12.610280  1535 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.625351  2209 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:12.639213  2212 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.648845  1683 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.651870  8113 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:12.639251  8167 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:04:12.672413  1609 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:12.676672  1683 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:12.689965  8113 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:12.692247  2209 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.693790  8162 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.702484  8159 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:12.720960  1679 raft_consensus.cc:2955] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.730304  1427 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.779143  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet baf31533a97f4325919d60e19d73b3f2 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:12.798408  8113 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:04:12.821120  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet baf31533a97f4325919d60e19d73b3f2 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:12.828342  8132 raft_consensus.cc:1064] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:12.831220  8132 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:12.904794  8172 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.910053  8187 tablet_replica.cc:333] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:12.911248  8187 raft_consensus.cc:2243] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.912189  8187 raft_consensus.cc:2272] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.918476  2212 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.912276  1610 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.952572  1683 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.962947  1432 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:12.994477  8187 ts_tablet_manager.cc:1916] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:12.995325  2212 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:13.017534  8172 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:04:13.024187  1604 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:13.032290  8134 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:04:13.048751  1683 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:13.057955  1531 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:13.054638  8113 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:04:13.073419  1603 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:13.073462  2209 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:13.083626  8172 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:04:13.100317  8134 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:13.119789  8113 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.128804  2209 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.134125  1604 raft_consensus.cc:2955] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.179805  1430 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.181033  8163 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.192909  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73161049b574469ea08e360e2def1aac with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:13.194783  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet 73161049b574469ea08e360e2def1aac with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:13.209426  8187 ts_tablet_manager.cc:1929] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:04:13.211789  8187 log.cc:1199] T baf31533a97f4325919d60e19d73b3f2 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/baf31533a97f4325919d60e19d73b3f2
I20260709 13:04:13.207788  1683 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.217397  1603 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.228072  8193 tablet_replica.cc:333] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:13.238258  8193 raft_consensus.cc:2243] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.242991  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet baf31533a97f4325919d60e19d73b3f2 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:13.249040  8193 raft_consensus.cc:2272] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.264456  1432 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 15 to 16, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.276934  2212 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.294430   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.302839  8193 ts_tablet_manager.cc:1916] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:13.356837  1531 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:13.358717  8193 ts_tablet_manager.cc:1929] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:04:13.359333  8193 log.cc:1199] T 73161049b574469ea08e360e2def1aac P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/73161049b574469ea08e360e2def1aac
I20260709 13:04:13.361531  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet 73161049b574469ea08e360e2def1aac (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:13.366709  2212 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:13.375766  8173 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:13.386392  8172 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.401993  2209 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.409983  1683 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:13.416445  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb1b18d08269419485367169ac7d79c5 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:13.417492  8163 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:13.422844  1683 raft_consensus.cc:2955] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:13.447417  1432 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 16 to 17, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.469157  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db0d135af1343458208be9b79d66635"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:13.469789  1531 raft_consensus.cc:606] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:13.475795  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet bb1b18d08269419485367169ac7d79c5 with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:13.506167  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8501e8317ed348cca428d77d106f937c"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:13.506891  1603 raft_consensus.cc:606] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:13.517377  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:13.517951  1682 raft_consensus.cc:606] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:13.625128   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:13.628576   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:13.634701  8194 tablet_replica.cc:333] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:13.637719  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 114342us
W20260709 13:04:13.693308  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 53402.5us
I20260709 13:04:13.695317  8194 raft_consensus.cc:2243] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.696312  8194 raft_consensus.cc:2272] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.692466  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 44212.3us
I20260709 13:04:13.706745  8194 ts_tablet_manager.cc:1916] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:04:13.737053  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 110242us
I20260709 13:04:13.773597  8132 raft_consensus.cc:993] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:13.775260  8132 raft_consensus.cc:1081] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:13.777410  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db0d135af1343458208be9b79d66635"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:13.777944  1603 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.778321  1603 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.800294  1603 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.804927  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:13.805532  1535 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:13.805851  1535 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:13.806850  1535 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.808091  1535 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.814936  8194 ts_tablet_manager.cc:1929] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.16
I20260709 13:04:13.831092  8194 log.cc:1199] T bb1b18d08269419485367169ac7d79c5 P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/bb1b18d08269419485367169ac7d79c5
I20260709 13:04:13.833936  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet bb1b18d08269419485367169ac7d79c5 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:13.815198  1535 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:13.817114  1603 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:13.818214  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:13.840888  1683 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.844838  8129 raft_consensus.cc:993] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:13.849386  8170 raft_consensus.cc:993] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:13.849692  1683 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:13.850528  8170 raft_consensus.cc:1081] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:13.852957  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:13.854653  8170 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:13.854708  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8501e8317ed348cca428d77d106f937c"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:13.855391  1683 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.855811  1683 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.857702  8129 raft_consensus.cc:1081] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:13.859491  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:13.860121  1534 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.860455  1534 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:13.855291  8170 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:13.869343  8170 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.887122  1683 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.891827  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:13.893481  1610 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:13.893877  1610 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:13.894618  1610 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.895805  1610 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.900780  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:13.901554  1535 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.917289  1534 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.921798  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:13.924625  1610 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:13.926172  1647 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:13.922437  1603 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:13.928997  8197 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:13.929587  8197 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:13.930720  8197 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.940554  1535 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:13.940873  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:13.941841  1683 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:13.941890  1679 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:13.943444  1679 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:13.944456  1679 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.945587  1679 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:13.941155  1534 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:13.958871  1679 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:13.955052  1430 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.960250  1501 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:13.961555  8132 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:13.962061  8132 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:13.962939  8132 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:13.956485  1603 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:13.989980  1431 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 22 to 23, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.011972  1432 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 20 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.379246  1682 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:14.386798  8170 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:14.425122  1531 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:14.429159  8195 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:14.432672  1604 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:14.434624  8173 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:14.481555  1679 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:14.484558  8113 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:14.500454  1610 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:04:14.502655  8197 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:14.526105  1531 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:04:14.527956  8197 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:14.629913   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.852437  1604 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:14.913276  1574 consensus_peers.cc:597] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c56ae97ed5df4be18120cf680fd57f57. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:14.914608  1683 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:14.934540  8195 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:14.978029  1535 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:14.979928  8161 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:15.014765  8161 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.016690  1535 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:15.020888  8218 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:04:15.042074  1683 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.044579  1679 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:15.071693  1432 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:15.086882  1648 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8501e8317ed348cca428d77d106f937c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.088702  1534 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:15.086971  1610 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:15.091231  8121 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:15.092746  8199 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:15.115643  8121 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.125442  1603 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:15.139367  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64585.4us
I20260709 13:04:15.149484  1535 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:15.194278  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 53840.7us
I20260709 13:04:15.226189  1534 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:15.276288  1603 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:15.277225  1676 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:04:15.277558  1499 consensus_peers.cc:597] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d120199a9d3441ab490816cfe76664f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.279007  8200 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:15.288671  8134 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:15.308357  1430 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.309055  8200 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.323251  1610 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.344524  1676 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.368492  8231 ts_tablet_manager.cc:933] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:15.376228  1679 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:15.401541  1430 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.453576  8231 tablet_copy_client.cc:323] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:15.455814  1603 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:04:15.460414  1648 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b6b1fc817984924ac96a7a2a29d76de. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.460978  8224 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:15.465245  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet c56ae97ed5df4be18120cf680fd57f57 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:15.465973  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet c56ae97ed5df4be18120cf680fd57f57 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-c56ae97ed5df4be18120cf680fd57f57
I20260709 13:04:15.467142  1534 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:15.469972  8121 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:15.487156  1620 tablet_copy_source_session.cc:215] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:15.501401  8231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ae97ed5df4be18120cf680fd57f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.545153  8223 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.557802  1535 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.589376  8231 tablet_copy_client.cc:806] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:15.622535  8231 tablet_copy_client.cc:670] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:15.632658  8231 tablet_copy_client.cc:538] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:15.633898  1430 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.637809  1603 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:15.641863  8237 ts_tablet_manager.cc:933] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:15.686944  8237 tablet_copy_client.cc:323] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:15.690347  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet 8501e8317ed348cca428d77d106f937c from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:15.690953  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet 8501e8317ed348cca428d77d106f937c from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-8501e8317ed348cca428d77d106f937c
I20260709 13:04:15.702502  8231 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:15.732357  1694 tablet_copy_source_session.cc:215] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:15.736322  8237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8501e8317ed348cca428d77d106f937c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.819826  8237 tablet_copy_client.cc:806] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:15.820484  8237 tablet_copy_client.cc:670] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:15.825542  8237 tablet_copy_client.cc:538] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:15.833781  8239 ts_tablet_manager.cc:933] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:15.849946  8237 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:15.865298  8239 tablet_copy_client.cc:323] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:15.867487  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 1d120199a9d3441ab490816cfe76664f from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:15.868116  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 1d120199a9d3441ab490816cfe76664f from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-1d120199a9d3441ab490816cfe76664f
I20260709 13:04:15.886790   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.888255  1545 tablet_copy_source_session.cc:215] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:15.892151  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d120199a9d3441ab490816cfe76664f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.960196  8239 tablet_copy_client.cc:806] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:15.960901  8239 tablet_copy_client.cc:670] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:15.968730  8239 tablet_copy_client.cc:538] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:16.025929  8231 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:16.027477  8231 tablet_bootstrap.cc:492] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:16.028656  8239 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:16.035849  8231 ts_tablet_manager.cc:1403] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.334s	user 0.032s	sys 0.024s
I20260709 13:04:16.067823  8231 raft_consensus.cc:359] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.077340  8231 raft_consensus.cc:740] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:16.078243  8231 consensus_queue.cc:260] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.098114  8243 ts_tablet_manager.cc:933] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:16.101651  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:16.102423  1603 raft_consensus.cc:606] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:16.121129  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:16.121742  1683 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:16.125257  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:16.125821  1534 raft_consensus.cc:606] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:16.127120   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:16.128753   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:16.131784  8231 ts_tablet_manager.cc:1434] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 13:04:16.132304  8243 tablet_copy_client.cc:323] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:16.143155  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet 4b6b1fc817984924ac96a7a2a29d76de from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:16.144412  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c56ae97ed5df4be18120cf680fd57f57 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:16.144918  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c56ae97ed5df4be18120cf680fd57f57 on tablet c56ae97ed5df4be18120cf680fd57f57 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:16.143718  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet 4b6b1fc817984924ac96a7a2a29d76de from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-4b6b1fc817984924ac96a7a2a29d76de
I20260709 13:04:16.169620  1694 tablet_copy_source_session.cc:215] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:16.179185  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6b1fc817984924ac96a7a2a29d76de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.221637  8237 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:16.222700  8237 tablet_bootstrap.cc:492] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:16.223497  8237 ts_tablet_manager.cc:1403] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.374s	user 0.049s	sys 0.007s
I20260709 13:04:16.229023  8237 raft_consensus.cc:359] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.249271  8237 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:16.252169  8237 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.253072  8243 tablet_copy_client.cc:806] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:16.253752  8243 tablet_copy_client.cc:670] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:16.263758  8237 ts_tablet_manager.cc:1434] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:04:16.265202  8199 raft_consensus.cc:993] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:16.266762  8243 tablet_copy_client.cc:538] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:16.272557  8199 raft_consensus.cc:1081] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:16.275871  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-8501e8317ed348cca428d77d106f937c received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:16.276343  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-8501e8317ed348cca428d77d106f937c on tablet 8501e8317ed348cca428d77d106f937c with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:16.281409  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:16.284478  1535 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.284919  1535 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:16.309818  2212 raft_consensus.cc:1217] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 13:04:16.317777  8239 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:16.325074  8239 tablet_bootstrap.cc:492] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:16.326105  8239 ts_tablet_manager.cc:1403] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.298s	user 0.041s	sys 0.013s
I20260709 13:04:16.335202  8239 raft_consensus.cc:359] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.341320  8161 raft_consensus.cc:993] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:16.343690  8161 raft_consensus.cc:1081] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:16.343802  8239 raft_consensus.cc:740] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:16.346546  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:16.347079  1683 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.347435  1683 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.346346  8239 consensus_queue.cc:260] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.341349  8243 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:16.357846  8239 ts_tablet_manager.cc:1434] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:04:16.359623  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1d120199a9d3441ab490816cfe76664f received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:16.360086  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1d120199a9d3441ab490816cfe76664f on tablet 1d120199a9d3441ab490816cfe76664f with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:16.360733  1683 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.367055  1683 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:16.368650  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:16.369612  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:16.370850  1603 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:16.371148  1603 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:16.371802  1534 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.383409  1603 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.391731  1603 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:16.416270  1535 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.426132  1535 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 27 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:16.420671  1534 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:16.432895  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:16.437513  1610 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:16.438592  1603 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:16.439888  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:16.443621  8121 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:16.444164  8121 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:16.444986  8121 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.470394  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:16.471119  1679 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:04:16.471513  1679 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:16.472397  1679 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.490502  2212 raft_consensus.cc:1217] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.12->[23.13-23.13]   Dedup: 23.13->[]
I20260709 13:04:16.512250  8113 raft_consensus.cc:993] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:16.512913  8113 raft_consensus.cc:1081] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:16.515650  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "552871638635413bbd17d508b2a95e03"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:16.516211  1603 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.516546  1603 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:16.516776  1430 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 17 to 18, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.522156  1679 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:16.527612  1610 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 27.
I20260709 13:04:16.531807  1603 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.557335  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:16.557096  1603 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:16.558089  1683 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:16.555424  1679 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 27.
I20260709 13:04:16.547936  1498 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:16.560691  8247 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:04:16.561198  8247 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:16.562129  8247 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.563115  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:16.563668  1534 raft_consensus.cc:3055] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:16.563934  1534 raft_consensus.cc:740] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:16.564670  1534 consensus_queue.cc:260] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.565922  1534 raft_consensus.cc:3060] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:16.568819  1683 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:16.547174  8243 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:16.573124  1576 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:16.573853  8243 tablet_bootstrap.cc:492] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:16.574280  8161 raft_consensus.cc:2804] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:16.574731  8243 ts_tablet_manager.cc:1403] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.234s	user 0.044s	sys 0.000s
I20260709 13:04:16.576761  8161 raft_consensus.cc:697] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:16.583045  8161 consensus_queue.cc:237] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:16.588408  1534 raft_consensus.cc:2468] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:16.646422  8243 raft_consensus.cc:359] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.627568  1432 catalog_manager.cc:5697] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 19 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.653465  8243 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:16.713860  1431 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 26 to 27, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 27 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.724439  8243 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:16.733652  8243 ts_tablet_manager.cc:1434] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.157s	user 0.007s	sys 0.002s
I20260709 13:04:16.735836  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-4b6b1fc817984924ac96a7a2a29d76de received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:16.736431  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-4b6b1fc817984924ac96a7a2a29d76de on tablet 4b6b1fc817984924ac96a7a2a29d76de with peer e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:16.690691  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 74759.2us
I20260709 13:04:16.761890  2212 raft_consensus.cc:1217] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:04:16.856930  8256 raft_consensus.cc:1064] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:16.859704  8256 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:16.901834  2212 raft_consensus.cc:1217] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:04:16.916666  1534 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:16.923892  1610 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:16.926795  1535 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:04:16.928139  8199 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:16.946192  2212 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:16.948076  8256 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:16.952394  8223 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:16.955174  8161 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:16.971868  1683 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:04:16.973435  8113 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:16.981434  1676 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:17.008069  8257 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:17.084471  1609 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:04:17.129863   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:17.139094  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 86174.2us
W20260709 13:04:17.146634  8260 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:04:17.148296  8259 log.cc:927] Time spent T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:04:17.185405  8264 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.188653  8224 raft_consensus.cc:1064] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:17.188959  8247 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:04:17.192850  1649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.194612  1676 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:17.208617  2212 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:17.226219  1648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.235033  8224 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 11, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.288256  1531 raft_consensus.cc:1275] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:04:17.291734  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 134803us
I20260709 13:04:17.337610  1528 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:17.357971  8260 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 13:04:17.311508  8256 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:04:17.373298  8161 consensus_queue.cc:1048] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:17.381340  1427 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.414985  1678 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.422863  8113 raft_consensus.cc:1064] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:17.425722  8113 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.429982  8199 raft_consensus.cc:1064] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:17.433025  8199 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.469264  1676 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:17.471918  2209 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:17.471005  8234 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:04:17.474087  1528 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:17.474095  1603 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:17.481720  2209 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:17.477321  2212 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:17.483906  8234 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:17.484481  8279 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:17.477592  8121 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:17.494292  8224 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:17.498805  8279 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:17.533448  1609 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:17.537036  8277 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:17.538968  1528 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:17.550470  8268 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.552155  2211 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.556479  8278 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:17.565253  1676 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.579288  8278 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.579403  1427 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.591073  8121 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.593015  1610 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.603360  1606 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:17.606249  1535 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.606848  1603 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.623275  1606 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.626588  2211 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:04:17.628367  1531 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.642987  8256 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:17.647742  2211 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.669754  1678 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:04:17.691967  8221 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:17.692262  1427 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:17.700188  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 60389.2us
I20260709 13:04:17.710702  8257 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.714452  8268 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:17.723026  2211 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.731868  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c56ae97ed5df4be18120cf680fd57f57 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:17.732841  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45278.2us
W20260709 13:04:17.733402  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45077us
I20260709 13:04:17.736944  1431 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.733222  1682 raft_consensus.cc:2955] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.748850  2212 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.801059  1427 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.809508  1610 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.862058  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet c56ae97ed5df4be18120cf680fd57f57 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:17.862205  1676 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.900127  1529 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:17.900537  2211 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:17.905154  8278 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:17.912334  8278 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:17.918731  8303 tablet_replica.cc:333] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:17.933441  8303 raft_consensus.cc:2243] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.934528  8303 raft_consensus.cc:2272] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.933444  1682 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:17.940105  8224 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.947499  8303 ts_tablet_manager.cc:1916] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:17.953361  2211 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.958434  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b6b1fc817984924ac96a7a2a29d76de with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:17.966392  2212 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:17.969584  1529 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:17.975666  8224 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:17.971843  1427 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 11 to 12, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.967593  1531 raft_consensus.cc:2955] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.984843  8224 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:17.992444  2212 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.001562  8121 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:18.020526  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b6b1fc817984924ac96a7a2a29d76de with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:18.029857  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8501e8317ed348cca428d77d106f937c with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:18.033540  1534 raft_consensus.cc:2955] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.057199  1427 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 14 to 15, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.107985  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 8501e8317ed348cca428d77d106f937c with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:18.135658  8304 tablet_replica.cc:333] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:18.166097  8304 raft_consensus.cc:2243] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:18.167037  8304 raft_consensus.cc:2272] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:18.171126  8304 ts_tablet_manager.cc:1916] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:18.214538  8303 ts_tablet_manager.cc:1929] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 13:04:18.215143  8303 log.cc:1199] T c56ae97ed5df4be18120cf680fd57f57 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/c56ae97ed5df4be18120cf680fd57f57
I20260709 13:04:18.217319  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet c56ae97ed5df4be18120cf680fd57f57 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:18.248441  8304 ts_tablet_manager.cc:1929] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:04:18.249886  1531 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:18.256755  2211 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:18.260229  8234 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:04:18.264655  1610 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:18.270697  8113 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:18.273418  8234 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.280670  2211 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.254874  8304 log.cc:1199] T 4b6b1fc817984924ac96a7a2a29d76de P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/4b6b1fc817984924ac96a7a2a29d76de
I20260709 13:04:18.288218  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 4b6b1fc817984924ac96a7a2a29d76de (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:18.293318  1603 raft_consensus.cc:2955] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.298799  1427 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 15 to 16, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:18.288220  8304 tablet_replica.cc:333] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:18.306145  8304 raft_consensus.cc:2243] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:18.307051  8304 raft_consensus.cc:2272] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:18.321637  8304 ts_tablet_manager.cc:1916] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:18.322929  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d120199a9d3441ab490816cfe76664f with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:18.341413  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d120199a9d3441ab490816cfe76664f with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:18.413829  8305 tablet_replica.cc:333] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:18.414992  8305 raft_consensus.cc:2243] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:18.415755  8305 raft_consensus.cc:2272] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:18.429069  8305 ts_tablet_manager.cc:1916] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:18.436911  8304 ts_tablet_manager.cc:1929] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.14
I20260709 13:04:18.437436  8304 log.cc:1199] T 8501e8317ed348cca428d77d106f937c P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/8501e8317ed348cca428d77d106f937c
I20260709 13:04:18.444796  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 8501e8317ed348cca428d77d106f937c (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:18.474058  8305 ts_tablet_manager.cc:1929] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:04:18.483487  8305 log.cc:1199] T 1d120199a9d3441ab490816cfe76664f P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/1d120199a9d3441ab490816cfe76664f
I20260709 13:04:18.485548  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet 1d120199a9d3441ab490816cfe76664f (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:18.845317   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:18.964980  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:18.965652  1610 raft_consensus.cc:606] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:18.969323  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:18.969971  1682 raft_consensus.cc:606] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:18.975093  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:18.975759  1531 raft_consensus.cc:606] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:18.983381   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:18.990804  8306 raft_consensus.cc:993] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:18.991427  8306 raft_consensus.cc:1081] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:18.991456   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:18.993635  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:18.994365  1682 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:18.994707  1682 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.000736  1682 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:19.002492  1682 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:19.003486  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:19.004148  2211 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.008423  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:19.009095  1610 raft_consensus.cc:3055] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:19.009428  1610 raft_consensus.cc:740] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:19.010212  1610 consensus_queue.cc:260] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:19.011411  1610 raft_consensus.cc:3060] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.027899  2211 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:19.040335  1648 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:19.043761  8121 raft_consensus.cc:2804] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:19.044303  8121 raft_consensus.cc:697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:19.045156  8121 consensus_queue.cc:237] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:19.053436  1610 raft_consensus.cc:2468] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:19.097178  1427 catalog_manager.cc:5697] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 19 to 20, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.214593  8121 raft_consensus.cc:993] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:19.215091  8121 raft_consensus.cc:1081] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:19.216789  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:19.217368  1531 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.217715  1531 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.234016  8113 raft_consensus.cc:993] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:19.234540  8173 raft_consensus.cc:1081] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:19.236369  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:19.236968  1603 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.237330  1603 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:19.306093  1603 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.309001  1531 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.318439  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:19.319154  1528 raft_consensus.cc:3055] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:19.319473  1528 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:19.320330  1528 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.321533  1528 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:19.321614  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:19.322346  1676 raft_consensus.cc:3060] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:19.321484  1603 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:19.332762  1528 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:19.334476  1574 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:19.335707  8256 raft_consensus.cc:2804] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:19.336246  8256 raft_consensus.cc:697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:19.336546  1531 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:19.337077  8256 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.340427  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:19.341089  1682 raft_consensus.cc:3055] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:19.341370  1682 raft_consensus.cc:740] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:19.342216  1682 consensus_queue.cc:260] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.343430  1682 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.345893  1676 raft_consensus.cc:2468] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:19.361596  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:19.362259  1610 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:19.386283  1610 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:19.387442  1498 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:19.388284  8234 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:19.388741  8234 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:19.389564  8234 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:19.391682  1682 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:19.411793  1427 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 21, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.421967  1432 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 20 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.458323  1610 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:19.479789  1574 consensus_peers.cc:597] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78a6859b4243476e8c4c421be70a6e19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.483399  1682 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:19.489019  1528 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:19.489611  8256 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:19.501472  8314 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:19.518945  8306 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.528797  1528 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.550746  1432 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.558843  1531 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:19.575138  1682 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.577329  2211 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:19.579046  8278 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:19.645081  1610 raft_consensus.cc:1275] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:19.646699  8278 consensus_queue.cc:1048] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:19.707489  1499 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d54062a82c94b8c93a956fc9082a450. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.710109  1609 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:19.712491  1678 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:19.714941  8173 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:19.720937  8234 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:19.806437  8324 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.814640  1682 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.830926  1531 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:19.839174  1609 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:19.853562  8320 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:19.874447  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 97536.6us
I20260709 13:04:19.873793  1432 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.882448  1606 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:19.899030  1678 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:19.919133  8314 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:19.919596  1574 consensus_peers.cc:597] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9463f88e50794193abace66439f1975b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.923800  1531 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:19.951606  1682 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:19.955475  8327 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:19.956353  1682 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:19.958668  8314 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:19.974713  8321 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:19.980203  1610 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:19.982138  8327 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:19.992847   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.079615  8314 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.095726  1676 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.115644  1529 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:20.120255  8343 ts_tablet_manager.cc:933] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:20.119340  1432 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.136500  1531 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.171484  1610 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:04:20.177112  1499 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e287a2761794958b3002cd2258cf2f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.177627  1678 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:20.179186  8234 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:20.183894  8328 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:20.239549  8346 ts_tablet_manager.cc:933] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:20.244130  1609 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.241144  8113 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.273206  8343 tablet_copy_client.cc:323] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:20.275125  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 78a6859b4243476e8c4c421be70a6e19 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:20.275715  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 78a6859b4243476e8c4c421be70a6e19 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-78a6859b4243476e8c4c421be70a6e19
I20260709 13:04:20.286105  1620 tablet_copy_source_session.cc:215] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:20.304255  1678 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.333143  8343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a6859b4243476e8c4c421be70a6e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:20.345419  1432 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:20.369103  8346 tablet_copy_client.cc:323] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:20.371414  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 5d54062a82c94b8c93a956fc9082a450 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:20.372017  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 5d54062a82c94b8c93a956fc9082a450 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-5d54062a82c94b8c93a956fc9082a450
I20260709 13:04:20.384503  1545 tablet_copy_source_session.cc:215] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:20.397553  8346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d54062a82c94b8c93a956fc9082a450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:20.406116  8343 tablet_copy_client.cc:806] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:20.408213  8343 tablet_copy_client.cc:670] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:20.412472  8343 tablet_copy_client.cc:538] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:20.440054  8343 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:20.481911  8350 ts_tablet_manager.cc:933] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:20.501946  8350 tablet_copy_client.cc:323] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:20.504138  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 9463f88e50794193abace66439f1975b from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:20.504787  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 9463f88e50794193abace66439f1975b from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-9463f88e50794193abace66439f1975b
I20260709 13:04:20.518868  8346 tablet_copy_client.cc:806] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:20.537897  8346 tablet_copy_client.cc:670] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:20.544391  8346 tablet_copy_client.cc:538] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:20.525729  1620 tablet_copy_source_session.cc:215] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:20.564976  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9463f88e50794193abace66439f1975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:20.595022  8346 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:20.643360  8350 tablet_copy_client.cc:806] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:20.644243  8350 tablet_copy_client.cc:670] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:20.664546  8350 tablet_copy_client.cc:538] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:20.681525  8353 ts_tablet_manager.cc:933] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:20.786098  8350 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:20.815009  8353 tablet_copy_client.cc:323] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
W20260709 13:04:20.865378  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 138363us
I20260709 13:04:20.899267  8343 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.921438  8343 tablet_bootstrap.cc:492] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:20.922379  8343 ts_tablet_manager.cc:1403] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.483s	user 0.050s	sys 0.022s
W20260709 13:04:20.925776  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 82677.6us
I20260709 13:04:20.928383  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 4e287a2761794958b3002cd2258cf2f2 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:20.928983  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 4e287a2761794958b3002cd2258cf2f2 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-4e287a2761794958b3002cd2258cf2f2
I20260709 13:04:20.950187  8343 raft_consensus.cc:359] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:20.960131  8343 raft_consensus.cc:740] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:21.014065  1545 tablet_copy_source_session.cc:215] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:04:21.021073  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 163390us
I20260709 13:04:21.059494  8346 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.061965  8346 tablet_bootstrap.cc:492] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:21.063052  8346 ts_tablet_manager.cc:1403] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.468s	user 0.029s	sys 0.041s
I20260709 13:04:21.013486  8343 consensus_queue.cc:260] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.093106  8343 ts_tablet_manager.cc:1434] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.170s	user 0.006s	sys 0.002s
I20260709 13:04:21.102454  8346 raft_consensus.cc:359] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.108206  8346 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:21.109030  8346 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.140072  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e287a2761794958b3002cd2258cf2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:21.151419  8346 ts_tablet_manager.cc:1434] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:04:21.175846  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-78a6859b4243476e8c4c421be70a6e19 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:21.176404  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-78a6859b4243476e8c4c421be70a6e19 on tablet 78a6859b4243476e8c4c421be70a6e19 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:21.184002  2209 raft_consensus.cc:1217] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
W20260709 13:04:21.189499  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49651.8us
I20260709 13:04:21.192203  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-5d54062a82c94b8c93a956fc9082a450 received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:21.192752  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-5d54062a82c94b8c93a956fc9082a450 on tablet 5d54062a82c94b8c93a956fc9082a450 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:21.229799   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:21.269603  8353 tablet_copy_client.cc:806] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:21.271540  8353 tablet_copy_client.cc:670] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:21.276770  8353 tablet_copy_client.cc:538] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:21.294173  8353 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:21.335232  8350 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.336805  8350 tablet_bootstrap.cc:492] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:21.337729  8350 ts_tablet_manager.cc:1403] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.552s	user 0.047s	sys 0.027s
I20260709 13:04:21.360188  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:21.360844  1679 raft_consensus.cc:606] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:21.364050  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:21.364699  1609 raft_consensus.cc:606] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:21.368813  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:21.369395  1529 raft_consensus.cc:606] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:21.370926   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:21.373971  8350 raft_consensus.cc:359] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.403401  8350 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:21.404263  8350 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.406783  8350 ts_tablet_manager.cc:1434] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.004s
I20260709 13:04:21.409657  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-9463f88e50794193abace66439f1975b received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:21.410133  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-9463f88e50794193abace66439f1975b on tablet 9463f88e50794193abace66439f1975b with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:21.428453   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:21.439455  8353 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.446762  8353 tablet_bootstrap.cc:492] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:21.447860  8353 ts_tablet_manager.cc:1403] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.154s	user 0.040s	sys 0.009s
I20260709 13:04:21.451496  8353 raft_consensus.cc:359] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.452483  8353 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:21.453209  8353 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:21.460119  8353 ts_tablet_manager.cc:1434] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:21.463352  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-4e287a2761794958b3002cd2258cf2f2 received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:21.463865  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-4e287a2761794958b3002cd2258cf2f2 on tablet 4e287a2761794958b3002cd2258cf2f2 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:21.469518  8333 raft_consensus.cc:993] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:21.470059  8333 raft_consensus.cc:1081] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:21.472452  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:21.473008  1529 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.473344  1529 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:21.480979  1529 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.487144  1529 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:21.487427  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:21.488119  1679 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:21.488420  1679 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:21.489135  1679 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.490453  1679 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:21.492408  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:21.493021  1610 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:21.500417  1679 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 25.
I20260709 13:04:21.501691  1610 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 25.
I20260709 13:04:21.501977  1501 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:21.502873  8362 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:21.503357  8362 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:21.504236  8362 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.520053  2209 raft_consensus.cc:1217] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:04:21.556687  8113 raft_consensus.cc:993] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:21.557593  8358 raft_consensus.cc:1081] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:21.565343  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:21.566031  1609 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.566483  1609 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:21.596978  1431 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 24 to 25, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 25 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.601418  1609 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.611111  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:21.611748  1529 raft_consensus.cc:3055] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:21.612062  1529 raft_consensus.cc:740] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:21.612234  1609 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:21.612433  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:21.613056  1679 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:21.612834  1529 consensus_queue.cc:260] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.614729  1529 raft_consensus.cc:3060] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:21.620730  1679 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:04:21.621888  1529 raft_consensus.cc:2468] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:04:21.622287  1576 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:21.623183  8367 raft_consensus.cc:2804] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:21.623795  8367 raft_consensus.cc:697] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:21.624692  8367 consensus_queue.cc:237] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.673350  2209 raft_consensus.cc:1217] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 13:04:21.699898  2209 raft_consensus.cc:1217] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:04:21.721410  1432 catalog_manager.cc:5697] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 19, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.764065  8314 raft_consensus.cc:993] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:21.764585  8314 raft_consensus.cc:1081] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:21.767091  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:21.767570  1679 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.767890  1679 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:21.771329  8367 raft_consensus.cc:1064] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:21.778923  1679 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.778980  8367 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:21.816694  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:21.817306  1531 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:21.819519  1679 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:21.821519  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:21.822245  1609 raft_consensus.cc:3055] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:21.822527  1609 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:21.824661  1609 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.829159  1609 raft_consensus.cc:3060] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:21.833473  1531 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:21.834801  1648 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:21.836404  8368 raft_consensus.cc:2804] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:21.836894  8368 raft_consensus.cc:697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:21.837641  8368 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:21.838168  1609 raft_consensus.cc:2468] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:21.860543  1679 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:21.861946  2211 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:21.864615  8355 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:21.866775  8355 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:21.874825  1529 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:21.877641  8365 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:21.883592  1431 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 23 to 24, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.021955  1679 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:22.027916  8234 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:22.053158  1530 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:22.056159  8365 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.057236  8321 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:22.055239  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 161160us
I20260709 13:04:22.082334  1679 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.094269  2211 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.111770  8113 raft_consensus.cc:1064] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:22.133268  8113 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:22.129876  1431 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:22.197467  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 49974.6us
W20260709 13:04:22.268240  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 76657.1us
I20260709 13:04:22.290838  1679 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:22.297865  8393 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:22.329865  1530 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:22.362757  2211 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:04:22.380460  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 136739us
I20260709 13:04:22.339922  8401 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:22.398686  1679 raft_consensus.cc:1275] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:22.397895  8398 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:04:22.406193  8113 raft_consensus.cc:1064] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:22.408916  8113 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:22.417032  1609 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:22.429560   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:22.452307  8368 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:04:22.362511  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 152000us
I20260709 13:04:22.456394  1528 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.467121  1610 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:22.471985  8404 consensus_queue.cc:1048] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:22.499209  1601 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:22.502791  2209 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:22.504997  8398 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:22.508080  1678 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:22.509764  8362 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:22.492378  1610 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:22.553891  1610 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:04:22.568866  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49871.1us
I20260709 13:04:22.578168  8234 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:22.585711  8399 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:22.616890  8362 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.615890  2211 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:22.630847  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 61202.4us
I20260709 13:04:22.638959  1679 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:22.647123  8321 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:22.658572  2212 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:22.687790  8321 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.707298  1676 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.722816  8113 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.725886  1682 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.733273  1676 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:22.740351  8365 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:22.742165  8406 raft_consensus.cc:1064] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:22.745185  8406 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:22.752738  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 167571us
I20260709 13:04:22.757315  1432 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:22.789374  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 46346.4us
I20260709 13:04:22.791754  2211 raft_consensus.cc:2955] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:22.874977  8380 log.cc:927] Time spent T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:04:22.909397  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 155094us
I20260709 13:04:22.846067  8393 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:04:22.943255  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 105647us
I20260709 13:04:22.944532  1606 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:22.998869  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82241.6us
I20260709 13:04:23.012952  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78a6859b4243476e8c4c421be70a6e19 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:04:23.055167  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53623.3us
W20260709 13:04:23.080687  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 80283.1us
W20260709 13:04:23.083837  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 80168.5us
I20260709 13:04:23.087811  2211 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:23.088120  1678 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:04:23.068807  8421 log.cc:927] Time spent T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:23.095325  8404 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:23.101784  8397 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:23.121272  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 106283us
I20260709 13:04:23.126525  2209 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.171236  1610 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:23.188583  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 132646us
I20260709 13:04:23.199399  1529 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:23.190918  1430 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 14 to 15, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:23.205775  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 204562us
W20260709 13:04:23.277462  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 69477.2us
I20260709 13:04:23.235003  8429 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:04:23.356793  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 89403.4us
I20260709 13:04:23.396992  1427 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 10 to 11, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.400627  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 78a6859b4243476e8c4c421be70a6e19 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:23.467278  8453 tablet_replica.cc:333] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:23.468436  8453 raft_consensus.cc:2243] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.469334  8453 raft_consensus.cc:2272] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.474026  1529 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:23.476568  8367 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.509227  1603 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:23.511716  8394 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:23.512351  2212 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:23.503296  1678 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.520071  8438 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.523422  1606 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.537379  8453 ts_tablet_manager.cc:1916] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.537729  8394 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:23.543529  1529 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.556478  1432 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.558321  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e287a2761794958b3002cd2258cf2f2 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.563278  2212 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.572898  2211 raft_consensus.cc:2955] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.632867  8453 ts_tablet_manager.cc:1929] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:04:23.633438  8453 log.cc:1199] T 78a6859b4243476e8c4c421be70a6e19 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/78a6859b4243476e8c4c421be70a6e19
I20260709 13:04:23.635052  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 78a6859b4243476e8c4c421be70a6e19 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:23.653787  1430 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 18 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.661888  1606 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:23.675988  1682 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:23.678210  8446 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:23.680445  2211 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:23.684376  8446 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:23.688993  8365 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.690405  1682 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.721187  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9463f88e50794193abace66439f1975b with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:23.733589  2209 raft_consensus.cc:2955] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.744299  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e287a2761794958b3002cd2258cf2f2 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:23.749418  1432 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:23.887413  8454 tablet_replica.cc:333] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:23.854382   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:23.923686  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 9463f88e50794193abace66439f1975b with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:23.924700  8453 tablet_replica.cc:333] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:23.925733  8453 raft_consensus.cc:2243] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.929416  8453 raft_consensus.cc:2272] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.933059  8453 ts_tablet_manager.cc:1916] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:23.961892  1531 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:23.971899  8454 raft_consensus.cc:2243] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:23.980978  8454 raft_consensus.cc:2272] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:23.984022  8454 ts_tablet_manager.cc:1916] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:24.091995  1604 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:24.092166  2209 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:24.094558  8394 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:24.096623  8362 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:24.110893  8394 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:24.112907  2209 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:24.132531  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:24.133214  1531 raft_consensus.cc:606] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:24.143688  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d54062a82c94b8c93a956fc9082a450 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:24.145390  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:24.145989  1529 raft_consensus.cc:606] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Received request to transfer leadership to TS e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:24.149308  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:24.149879  1676 raft_consensus.cc:606] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:24.154793  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:24.155400  1606 raft_consensus.cc:606] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:24.156630   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:24.157091  8438 raft_consensus.cc:993] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:24.158267   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:24.159731  8438 raft_consensus.cc:1081] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Signalling peer e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:24.167783  8453 ts_tablet_manager.cc:1929] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 13:04:24.168409  8453 log.cc:1199] T 9463f88e50794193abace66439f1975b P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/9463f88e50794193abace66439f1975b
I20260709 13:04:24.170027  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 9463f88e50794193abace66439f1975b (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:24.173148  2210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2"
dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:04:24.173811  2210 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.174242  2210 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:24.174154  1432 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 14 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.185043  1606 raft_consensus.cc:2955] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:24.191545  8454 ts_tablet_manager.cc:1929] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:04:24.193667  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d54062a82c94b8c93a956fc9082a450 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:24.202142  2210 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:24.209440  2210 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:24.209625  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:24.210335  1531 raft_consensus.cc:3055] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:24.210717  1531 raft_consensus.cc:740] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:24.211454  1531 consensus_queue.cc:260] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:24.212443  1531 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:24.220489  1531 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:04:24.221777  2176 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:24.222625  8427 raft_consensus.cc:2804] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:24.223174  8427 raft_consensus.cc:697] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:24.229187  8427 consensus_queue.cc:237] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:24.232214  8454 log.cc:1199] T 4e287a2761794958b3002cd2258cf2f2 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/4e287a2761794958b3002cd2258cf2f2
I20260709 13:04:24.234184  8454 tablet_replica.cc:333] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:24.235504  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet 4e287a2761794958b3002cd2258cf2f2 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:24.251221  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:24.251881  1606 raft_consensus.cc:3060] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:24.256840  8454 raft_consensus.cc:2243] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:24.257659  8454 raft_consensus.cc:2272] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:24.257975  1429 catalog_manager.cc:5697] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 18 to 19, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.262549  8454 ts_tablet_manager.cc:1916] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:24.286295  8393 raft_consensus.cc:993] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:24.287027  8438 raft_consensus.cc:1081] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:24.288930  1601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:24.289538  1601 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.289894  1601 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:24.298840  1601 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.301927  1601 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:24.303527  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:24.302860  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:24.304128  1682 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:24.304395  1531 raft_consensus.cc:3055] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:04:24.304839  1531 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:24.305663  1531 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.307881  1531 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:24.314903  1531 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 26.
I20260709 13:04:24.316362  1574 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:24.317795  8365 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:24.318315  8365 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:24.319228  8365 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.337147  1682 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 26.
I20260709 13:04:24.348222  1606 raft_consensus.cc:2468] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:04:24.352415  8454 ts_tablet_manager.cc:1929] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:04:24.352982  8454 log.cc:1199] T 5d54062a82c94b8c93a956fc9082a450 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/5d54062a82c94b8c93a956fc9082a450
I20260709 13:04:24.394060  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet 5d54062a82c94b8c93a956fc9082a450 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:24.401392  1429 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 25 to 26, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.462767  8367 raft_consensus.cc:993] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:24.466527  8367 raft_consensus.cc:1081] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:24.469134  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:24.470067  1682 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.470652  1682 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:24.520664  1682 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.536667  1682 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:24.539776  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:24.541595  1601 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:24.542003  1601 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:24.543371  1601 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.549407  1601 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:24.550714  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:24.572736  1531 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:24.605463  1531 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:24.707058  1648 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:24.707640  1601 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:24.708377  8433 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:24.709810  1604 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:24.711597  8435 raft_consensus.cc:993] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:24.718019  1529 raft_consensus.cc:1275] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:04:24.725637  8433 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:24.725873  8427 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:24.727667  8435 raft_consensus.cc:1081] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:24.728976  8433 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.740778  8448 consensus_queue.cc:1048] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:24.743392  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:24.744145  1529 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.744544  1529 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:24.770591  1529 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.799988  1529 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 28 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:24.826220  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:24.826884  1606 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:24.837703  1676 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:04:24.862495  1606 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 28.
I20260709 13:04:24.863811  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:24.864500  1682 raft_consensus.cc:3055] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:04:24.864805  1682 raft_consensus.cc:740] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:24.867599  1682 consensus_queue.cc:260] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.885185  8365 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:24.897060  1498 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:24.898238  8394 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:04:24.898789  8394 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 28 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:24.899770  8394 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:24.900310  1682 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:24.913823  1682 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 28.
I20260709 13:04:24.926719  1535 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:04:24.935750  1432 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.937942  8365 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:04:25.084441  1428 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 27 to 28, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 28 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.157678  1606 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:25.164268  8433 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:25.177088   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.261000  1535 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:25.263770  8463 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:25.377635  1606 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:04:25.382527  8458 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:25.399441  1678 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:04:25.405469  8362 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:25.550684  1530 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:25.577555  1678 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:25.577600  1601 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:25.579742  8458 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:25.581390  1499 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11e72d8320164ed18fc7fccba3a0ecd3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.582556  8362 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:25.677848  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 62318.9us
W20260709 13:04:25.880451  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 142523us
W20260709 13:04:25.944558  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 156097us
W20260709 13:04:25.968955  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 230859us
I20260709 13:04:25.977492  8394 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.028126  1606 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.068454  1678 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.094420  1429 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.137189  1604 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:26.213707  8509 ts_tablet_manager.cc:933] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:26.219074  1676 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:26.220954  8502 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:26.222632  1574 consensus_peers.cc:597] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3db0d135af1343458208be9b79d66635. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.243042  1530 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:26.244774  8502 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:26.261441  8509 tablet_copy_client.cc:323] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:26.264413  8489 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.268107  1682 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.281481  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet 11e72d8320164ed18fc7fccba3a0ecd3 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:26.282256  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet 11e72d8320164ed18fc7fccba3a0ecd3 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-11e72d8320164ed18fc7fccba3a0ecd3
I20260709 13:04:26.304311  1545 tablet_copy_source_session.cc:215] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:26.311158  8509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e72d8320164ed18fc7fccba3a0ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.315325  1676 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:26.326051  1428 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:26.373674  1648 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc704e97e2774b19b6d4867b31f50723. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.375176   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.377426  1604 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:26.379240  8506 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:26.399258  1530 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.415330  1528 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:26.422722  8505 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:26.447005  8509 tablet_copy_client.cc:806] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:26.447781  8509 tablet_copy_client.cc:670] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:26.452253  8509 tablet_copy_client.cc:538] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:26.503571  8490 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.531919  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:26.532689  1676 raft_consensus.cc:606] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:26.535595  8509 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:26.536844  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:26.537495  1682 raft_consensus.cc:606] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:26.546168  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:26.547705  1604 raft_consensus.cc:606] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:26.550580  1601 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.555024  1531 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.587078  8492 raft_consensus.cc:993] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:26.587682  8488 raft_consensus.cc:1081] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:26.589852  1530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:26.590519  1530 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.590920  1530 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:26.593206  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:26.594319  1529 raft_consensus.cc:606] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:26.602795  1530 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.604809  1604 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:26.605777   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:26.609157  1428 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.621300   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:26.621408  1530 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:26.622906  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:26.622965  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:26.623781  1678 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:26.625232  1678 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:26.623952  1610 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:26.626119  1678 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.627506  1678 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:26.641953  1678 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:26.643141  1610 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:26.643350  1501 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:26.644860  8491 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:26.646950  8491 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:26.648041  8491 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.676203  1430 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 18 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 19 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.698269  8503 raft_consensus.cc:993] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:26.698858  8503 raft_consensus.cc:1081] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:26.700850  1610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:26.701470  1610 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.701805  1610 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:26.709929  1610 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.712556  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:26.713121  1531 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:26.713397  1531 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:26.714104  1531 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.715144  1531 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:26.736274  1531 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:26.737809  1610 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:26.747431  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:26.748103  1676 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:26.753914  1676 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:26.755508  1576 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:26.757587  8493 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:26.758172  8493 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:26.759120  8493 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.788820  8522 ts_tablet_manager.cc:933] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:26.797286  8521 ts_tablet_manager.cc:933] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:26.805671  1682 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:04:26.806136  1574 consensus_peers.cc:597] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbbc977cdccf4f338a0e97226117c985. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:26.807790  8493 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:26.812708  1530 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:26.814433  8489 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:26.821918  1428 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 21, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.829568  8522 tablet_copy_client.cc:323] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:26.855777  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet bc704e97e2774b19b6d4867b31f50723 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:26.856400  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet bc704e97e2774b19b6d4867b31f50723 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-bc704e97e2774b19b6d4867b31f50723
I20260709 13:04:26.865139  1694 tablet_copy_source_session.cc:215] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:26.865537  8502 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.880848  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc704e97e2774b19b6d4867b31f50723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.869046  1530 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.880676  1682 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.892549  8490 raft_consensus.cc:993] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:26.893131  8490 raft_consensus.cc:1081] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:26.895074  8521 tablet_copy_client.cc:323] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:26.895612  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:26.896241  1531 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.896652  1531 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:26.909588  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 3db0d135af1343458208be9b79d66635 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:26.910312  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 3db0d135af1343458208be9b79d66635 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-3db0d135af1343458208be9b79d66635
I20260709 13:04:26.910771  1531 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.915572  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:26.916249  1604 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:26.931071  1531 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:26.936524  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:26.937116  1678 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:26.937413  1678 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:26.938172  1678 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.939361  1678 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:26.960130  1430 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 13, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:26.961508  1620 tablet_copy_source_session.cc:215] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:26.968390  1604 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:26.968683  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db0d135af1343458208be9b79d66635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.984360  1678 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:26.985502  1501 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:26.985721  8450 raft_consensus.cc:993] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:26.986392  8450 raft_consensus.cc:1081] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:26.988268  8491 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:26.989056  8491 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:26.989634  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:26.990386  1678 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.989938  8491 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:26.990758  1678 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:27.018086  1678 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:27.021095  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:27.021870  1531 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:27.029780  1678 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:27.030679  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:27.031278  1610 raft_consensus.cc:3055] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:27.031607  1610 raft_consensus.cc:740] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:27.032351  1610 consensus_queue.cc:260] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:27.039963  1610 raft_consensus.cc:3060] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:27.052919  1430 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 20, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 20 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.071681  1531 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:27.090669  1648 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:27.075785  8521 tablet_copy_client.cc:806] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:27.124459  8521 tablet_copy_client.cc:670] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:27.129662  8521 tablet_copy_client.cc:538] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:27.145061  1678 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:27.146761  8491 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:27.154286  1679 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:27.155795  8502 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:27.092661  1610 raft_consensus.cc:2468] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:27.092839  8488 raft_consensus.cc:2804] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:27.156987  8488 raft_consensus.cc:697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:27.157990  8488 consensus_queue.cc:237] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:27.160324  8521 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
W20260709 13:04:27.161132  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 90241.4us
I20260709 13:04:27.173900  1531 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:27.175822  8406 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:27.256742  1610 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:27.263110  8536 ts_tablet_manager.cc:933] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:27.277444  8503 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:27.308454  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62027.8us
I20260709 13:04:27.257153  8522 tablet_copy_client.cc:806] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
W20260709 13:04:27.301739  8519 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:27.334218  1428 catalog_manager.cc:5697] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:27.319842  8530 log.cc:927] Time spent T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.060s	user 0.007s	sys 0.011s
W20260709 13:04:27.331107  8532 log.cc:927] Time spent T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:04:27.342311  8522 tablet_copy_client.cc:670] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:27.434186  8536 tablet_copy_client.cc:323] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:27.531057  8522 tablet_copy_client.cc:538] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:04:27.551149  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 117033us
I20260709 13:04:27.570840  8522 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:27.622558   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.651599  1678 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:04:27.669545  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 66459.3us
W20260709 13:04:27.670885  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 50395.1us
I20260709 13:04:27.673537  8394 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:27.676491  1606 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:27.695015  8433 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:27.722739  1603 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:27.740588  8503 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:27.792976  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet fbbc977cdccf4f338a0e97226117c985 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:27.793648  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet fbbc977cdccf4f338a0e97226117c985 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-fbbc977cdccf4f338a0e97226117c985
I20260709 13:04:27.802686  1620 tablet_copy_source_session.cc:215] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:27.814147  8509 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=3 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:27.821632  1534 raft_consensus.cc:1275] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:27.933575  8509 tablet_bootstrap.cc:492] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:27.934415  8509 ts_tablet_manager.cc:1403] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.399s	user 0.046s	sys 0.018s
I20260709 13:04:27.944702  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbc977cdccf4f338a0e97226117c985. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:28.004860  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 75268.3us
W20260709 13:04:28.018167  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 105007us
I20260709 13:04:28.045765  8509 raft_consensus.cc:359] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.046798  8509 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:28.047619  8509 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.080662  8509 ts_tablet_manager.cc:1434] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.004s
W20260709 13:04:28.160308  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49631.5us
W20260709 13:04:28.171514  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 64650.7us
I20260709 13:04:28.128203  8571 consensus_queue.cc:1048] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.161s
I20260709 13:04:28.206964  8536 tablet_copy_client.cc:806] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:28.209278  8536 tablet_copy_client.cc:670] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:28.235702  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-11e72d8320164ed18fc7fccba3a0ecd3 received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:28.236259  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-11e72d8320164ed18fc7fccba3a0ecd3 on tablet 11e72d8320164ed18fc7fccba3a0ecd3 with peer e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:28.246728  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 69629.2us
W20260709 13:04:28.248622  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 68084.7us
I20260709 13:04:28.262737  8521 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.264170  8521 tablet_bootstrap.cc:492] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:28.265000  8521 ts_tablet_manager.cc:1403] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.105s	user 0.033s	sys 0.028s
I20260709 13:04:28.293080  8536 tablet_copy_client.cc:538] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:28.310777  8522 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.315327  8522 tablet_bootstrap.cc:492] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:28.316185  8522 ts_tablet_manager.cc:1403] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.746s	user 0.059s	sys 0.031s
I20260709 13:04:28.323871  8522 raft_consensus.cc:359] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.324857  8522 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:28.325547  8522 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:28.347445  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 234100us
I20260709 13:04:28.357465  2211 raft_consensus.cc:1217] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 13:04:28.369107  8522 ts_tablet_manager.cc:1434] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:04:28.370961  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-bc704e97e2774b19b6d4867b31f50723 received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:28.371579  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-bc704e97e2774b19b6d4867b31f50723 on tablet bc704e97e2774b19b6d4867b31f50723 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:28.326002  8536 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:28.398208  8521 raft_consensus.cc:359] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.406842  8521 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:28.407658  8521 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.410429  8521 ts_tablet_manager.cc:1434] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.000s
I20260709 13:04:28.414435  2211 raft_consensus.cc:1217] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:04:28.418711  2209 raft_consensus.cc:1217] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:04:28.452649  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-3db0d135af1343458208be9b79d66635 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:28.453123  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-3db0d135af1343458208be9b79d66635 on tablet 3db0d135af1343458208be9b79d66635 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:28.731099  8536 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:28.739006  8536 tablet_bootstrap.cc:492] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:28.742576  8536 ts_tablet_manager.cc:1403] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.417s	user 0.045s	sys 0.020s
I20260709 13:04:28.746596  8536 raft_consensus.cc:359] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.747489  8536 raft_consensus.cc:740] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:28.748183  8536 consensus_queue.cc:260] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:28.750665  8536 ts_tablet_manager.cc:1434] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:28.753029  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-fbbc977cdccf4f338a0e97226117c985 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:28.753458  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-fbbc977cdccf4f338a0e97226117c985 on tablet fbbc977cdccf4f338a0e97226117c985 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:28.777109  8554 raft_consensus.cc:1064] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:28.779800  8554 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:28.822674  8537 raft_consensus.cc:1064] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:28.851460  8579 raft_consensus.cc:1064] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:28.845124  2211 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:28.845170  2209 raft_consensus.cc:1217] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:04:28.856206  1601 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:28.856976  1528 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:28.860764  8578 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:28.864006  8577 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:04:28.854135  8579 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:28.867440  8577 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:04:28.937867  8537 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:28.996467   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:28.997381  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 79430.4us
W20260709 13:04:29.059065  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 105069us
I20260709 13:04:29.081923  2211 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:29.088976  8590 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:29.133703  1531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:29.134334  1531 raft_consensus.cc:606] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:29.143002  8585 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:04:29.188194  1527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:29.188894  1527 raft_consensus.cc:606] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:29.180313  8587 log.cc:927] Time spent T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:04:29.196226  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:29.196866  1678 raft_consensus.cc:606] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:29.196324  8562 raft_consensus.cc:993] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:29.203711  1683 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:04:29.216374  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 139855us
I20260709 13:04:29.220989  8562 raft_consensus.cc:1081] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
W20260709 13:04:29.260100  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 106333us
W20260709 13:04:29.247493  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 89676.9us
W20260709 13:04:29.290330  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 110935us
I20260709 13:04:29.298866  8595 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.316833  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32221e86161141d39327e18efdbbb226"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:29.317494  1678 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.317879  1678 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.334609  1527 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.337610  1678 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.337479  1604 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.344520  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:29.345268  1601 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.364054  1678 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:29.363886  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 227956us
W20260709 13:04:29.365641  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 103598us
I20260709 13:04:29.367296  2211 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:29.370606  8503 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:29.371054  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 43769.3us
I20260709 13:04:29.377218  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:29.377867  1531 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:29.378158  1531 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:29.378904  1531 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.379820  1531 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.387255  1531 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:29.405308  8597 raft_consensus.cc:993] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:29.406500  8562 raft_consensus.cc:1081] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:29.410614  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "148d93cd579345f7bda3407d430fed95"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:29.411166  1606 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.390275  1601 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:29.411516  1606 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.411980  1608 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:29.392428  1678 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:29.412670  1429 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:29.393337  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 201489us
I20260709 13:04:29.393819  2209 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.402022  1607 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:29.424562  8561 raft_consensus.cc:993] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:29.426175  8603 raft_consensus.cc:1081] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:29.427104  1606 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:29.405447  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 114393us
I20260709 13:04:29.416146  1647 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:29.436446  8608 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:29.435885  8537 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:29.443629  8577 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:29.444228  8577 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:29.445125  8577 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.446054  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace772102403442daf5f360432c323e9"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:29.446650  1608 raft_consensus.cc:606] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:29.449282  1606 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:29.462952  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:29.463613  1683 raft_consensus.cc:606] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:29.466144   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:29.468057   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:29.470263  1531 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:29.485031  8610 raft_consensus.cc:1064] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:29.486075  8597 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:29.493561  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:29.498793  1528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:29.499461  1528 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.499850  1528 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.498898  1527 raft_consensus.cc:3055] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:29.500825  1527 raft_consensus.cc:740] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:29.502075  1527 consensus_queue.cc:260] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.512455  1527 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.489696  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:29.516091  1681 raft_consensus.cc:3060] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:29.533458  1527 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:29.542177  1681 raft_consensus.cc:2468] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:29.564419  8541 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:29.487960  8610 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:29.572904  8594 raft_consensus.cc:993] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:29.573573  8594 raft_consensus.cc:1081] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:29.579344  1684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace772102403442daf5f360432c323e9"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:29.579938  1684 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.580354  1684 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:29.597867  1576 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:29.599507  8599 raft_consensus.cc:2804] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:29.600080  8599 raft_consensus.cc:697] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:29.600510  8605 raft_consensus.cc:993] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
W20260709 13:04:29.601446  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 66708.9us
I20260709 13:04:29.595118  1684 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.597054  1528 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.615836  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:29.616566  1606 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.616954  1528 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:29.630095  1606 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:04:29.634572  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:29.634895  1684 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:29.631503  8577 raft_consensus.cc:1081] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:29.634653  1498 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:29.634544  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:29.637444  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:29.638458  1528 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:29.639405  1606 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:29.639798  1606 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:29.643870  1432 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 19 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.602453  8599 consensus_queue.cc:237] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.656972  2208 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:29.661954  1528 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:29.641007  8562 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:29.666590  8562 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:29.668905  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:29.653426  1606 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.666975  1681 raft_consensus.cc:3055] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:29.672819  1681 raft_consensus.cc:740] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:29.684813  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:29.685698  1531 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.686053  1531 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:29.707230  8578 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:29.718369  1531 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.678597  8594 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
W20260709 13:04:29.777846  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 82577.7us
I20260709 13:04:29.774189  8539 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.784168  1606 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:29.791895  1606 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:29.667590  8562 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.766188  8578 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:29.803913  8578 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.807717  1678 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:29.813232  1531 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:29.812788  1678 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.818919  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:29.820092  1683 raft_consensus.cc:3055] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:29.820432  1683 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:29.821275  1683 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:29.826017  1683 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:29.829414  2209 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.822256  1681 consensus_queue.cc:260] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:29.849939  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.868719  1681 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.830148  8610 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:29.873653  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:29.876780  1606 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:29.877254  1681 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:04:29.849519  8502 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:04:29.886561  1606 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:29.889590  1498 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:04:29.913455  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87289.1us
I20260709 13:04:29.928836  8597 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:29.969281  1683 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
W20260709 13:04:29.970479  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 132452us
W20260709 13:04:29.980091  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 90587.4us
I20260709 13:04:29.990489  1608 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:04:30.002683  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 162678us
W20260709 13:04:30.073035  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 76629.8us
W20260709 13:04:30.101430  8620 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:04:30.096940  8609 log.cc:927] Time spent T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:04:30.195272  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 206511us
W20260709 13:04:30.206312  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 212647us
W20260709 13:04:30.208853  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 234363us
I20260709 13:04:30.180646  8597 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:30.222409  1607 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:30.280346  8551 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:04:30.281070  2212 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:30.215289  8597 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:30.374981  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 45420.7us
I20260709 13:04:30.377427  1683 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:30.386094  1684 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:04:30.388135  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 152017us
I20260709 13:04:30.390501  1527 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:04:30.458999  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60994.8us
W20260709 13:04:30.558691  8641 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:04:30.575480  1527 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:04:30.567098  8610 consensus_meta.cc:287] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.002s
W20260709 13:04:30.591689  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131937us
W20260709 13:04:30.651337  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 157733us
I20260709 13:04:30.502954  8577 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:04:30.763803  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 111509us
W20260709 13:04:30.748436  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 87593us
I20260709 13:04:30.779614  1527 raft_consensus.cc:1275] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:04:30.851186  8666 log.cc:927] Time spent T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 13:04:30.750519  8672 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
W20260709 13:04:30.872943  8664 log.cc:927] Time spent T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:30.893515  8593 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:30.894155  8593 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:30.896194  8593 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:30.897142  8593 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:30.897673  8593 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:30.913054  8593 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:30.963944  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:30.973495  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 130508us
I20260709 13:04:30.985873  1608 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:04:30.988941  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 71487us
I20260709 13:04:30.993727  8576 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:30.994304  8576 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:30.994876  8644 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:30.995520  8644 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:30.996454  8680 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:30.997066  8680 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:30.998932  8576 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:30.999128  8680 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:31.001515  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 248) took 1458 ms. Trace:
I20260709 13:04:31.007704  8644 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:31.014744  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 201353us
I20260709 13:04:31.008826   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:31.021569  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.021639  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.024322  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:31.001946  1432 rpcz_store.cc:276] 0709 13:04:29.543305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.543449 (+   144us) service_pool.cc:224] Handling call
0709 13:04:29.640708 (+ 97259us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:04:31.001421 (+1360713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:29.706979 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:29.783929 (+ 76950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:29.783964 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:29.783984 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:29.784395 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:29.784443 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:29.784495 (+    52us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:29.784677 (+   182us) tablet.cc:701] Row locks acquired
0709 13:04:29.784698 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:29.784852 (+   154us) write_op.cc:270] Start()
0709 13:04:29.784977 (+   125us) write_op.cc:276] Timestamp: P: 1783602269784798 usec, L: 0
0709 13:04:29.785000 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:29.785663 (+   663us) log.cc:844] Serialized 541 byte log entry
0709 13:04:30.470795 (+685132us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.754881 (+284086us) write_op.cc:301] APPLY: starting
0709 13:04:30.755033 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.756581 (+  1548us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.756687 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.757570 (+   883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.757750 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:30.757793 (+    43us) write_op.cc:312] APPLY: finished
0709 13:04:30.758002 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 13:04:30.760236 (+  2234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.760319 (+    83us) write_op.cc:454] Released schema lock
0709 13:04:30.760377 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.760867 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.760915 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":216817920,"child_traces":[["op",{"apply.queue_time_us":268932,"apply.run_cpu_time_us":3979,"apply.run_wall_time_us":5966,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":5343,"prepare.run_cpu_time_us":3187,"prepare.run_wall_time_us":89852,"replication_time_us":614996,"thread_start_us":69212,"threads_started":1}]]}
I20260709 13:04:31.033919  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.042462  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:31.044220  8610 consensus_queue.cc:1048] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:31.024387  8637 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:31.045256  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 53565.2us
I20260709 13:04:31.044384  1529 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.053331  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:31.072434  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.074225  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.074733  2175 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:31.075872  1606 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:31.062170  2212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41274 (request call id 304) took 1187 ms. Trace:
I20260709 13:04:31.077431  2212 rpcz_store.cc:276] 0709 13:04:29.834815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.834967 (+   152us) service_pool.cc:224] Handling call
0709 13:04:30.278957 (+443990us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b58001c1498. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:04:30.279238 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.279520 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:04:30.780669 (+501149us) log.cc:844] Serialized 14 byte log entry
0709 13:04:31.021985 (+241316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:31.022033 (+    48us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:04:31.022075 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.022155 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.022261 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30763,"raft.queue_time_us":32352,"raft.run_cpu_time_us":3709,"raft.run_wall_time_us":20908,"spinlock_wait_cycles":71524352,"thread_start_us":210180,"threads_started":1,"wal-append.queue_time_us":202775}
I20260709 13:04:31.098312  8591 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:31.098465  1533 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:31.102315  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.088310  8597 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:31.139837  8661 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:31.139931  8597 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:31.140612  8661 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:31.156760  8577 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:31.160705  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:31.162103  8592 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:31.163198  8681 log.cc:927] Time spent T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:04:31.164770  8661 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.175566  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.180490  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:31.149238  8597 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.188124  8595 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:04:31.199048  8682 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.215s	user 0.000s	sys 0.002s
I20260709 13:04:31.201740  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.203732  1606 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:04:31.210318  8642 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:31.186425  8562 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:04:31.218395  1677 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:04:31.225033  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 71274.8us
I20260709 13:04:31.226526  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.238423  8610 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.209275  8661 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:31.245692  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.253072  1501 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:31.254659  8675 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:31.256459  8537 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:31.259001  1684 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.271337  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 263) took 1861 ms. Trace:
I20260709 13:04:31.271786  1429 rpcz_store.cc:276] 0709 13:04:29.409516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.409675 (+   159us) service_pool.cc:224] Handling call
0709 13:04:31.271267 (+1861592us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:29.490531 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:29.491079 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:29.491117 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:29.491134 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:29.491467 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:29.491516 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:29.491545 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:29.491717 (+   172us) tablet.cc:701] Row locks acquired
0709 13:04:29.491734 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:29.491876 (+   142us) write_op.cc:270] Start()
0709 13:04:29.491988 (+   112us) write_op.cc:276] Timestamp: P: 1783602269491821 usec, L: 0
0709 13:04:29.492007 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:04:29.492682 (+   675us) log.cc:844] Serialized 599 byte log entry
0709 13:04:29.929488 (+436806us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.500932 (+571444us) write_op.cc:301] APPLY: starting
0709 13:04:30.502677 (+  1745us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.897832 (+395155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.897944 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.898740 (+   796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.898922 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:30.898966 (+    44us) write_op.cc:312] APPLY: finished
0709 13:04:30.899155 (+   189us) log.cc:844] Serialized 25 byte log entry
0709 13:04:30.899330 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.899414 (+    84us) write_op.cc:454] Released schema lock
0709 13:04:30.899451 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.899831 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.899883 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112688,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":487957,"apply.run_cpu_time_us":4594,"apply.run_wall_time_us":427434,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":73938,"prepare.run_cpu_time_us":23691,"prepare.run_wall_time_us":149521,"raft.queue_time_us":789019,"raft.run_cpu_time_us":40210,"raft.run_wall_time_us":679768,"replication_time_us":416650,"thread_start_us":597390,"threads_started":4,"wal-append.queue_time_us":173290}]]}
I20260709 13:04:31.286124  1683 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:04:31.296612  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.298460  8606 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:31.313417  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 150) took 1876 ms. Trace:
I20260709 13:04:31.313969  1428 rpcz_store.cc:276] 0709 13:04:29.436911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.437036 (+   125us) service_pool.cc:224] Handling call
0709 13:04:31.313356 (+1876320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277127,"reported_tablets":1}
I20260709 13:04:31.319931  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 286) took 1815 ms. Trace:
I20260709 13:04:31.320653  1430 rpcz_store.cc:276] 0709 13:04:29.504173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.504648 (+   475us) service_pool.cc:224] Handling call
0709 13:04:29.645041 (+140393us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:04:31.319867 (+1674826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26145,"reported_tablets":1,"spinlock_wait_cycles":307542784}
I20260709 13:04:31.330338  1432 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 16 to 17, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.342883  1574 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.347971  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:31.316406  8599 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.378060  1432 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.382095  1432 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.394743  1432 catalog_manager.cc:5697] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 19 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:31.373829  8661 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:31.380304  8537 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:31.415757  8696 log.cc:927] Time spent T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:04:31.427336  8645 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:04:31.395215  8599 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:31.507388  8662 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:31.508018  8662 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:31.510248  8662 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.510823  8599 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.578441  8684 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:31.622380  8684 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:31.712551  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 127373us
W20260709 13:04:31.720163  8695 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:04:31.729748  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.716293  8644 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:04:31.749352  8697 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:04:31.790544  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.786396  8640 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:31.738046  8644 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:31.787559  8529 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:31.787241  8684 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.798738  8644 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.796555  8640 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:31.802423  8640 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.803088  8529 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:31.805775  8529 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:31.809983  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.812268  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.813325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.812364  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.812376  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.818343  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:31.820444  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.820992  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.824841  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.833381  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.833438  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:31.841622  2176 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.842514  8529 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:31.844660  2176 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.845515  8529 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:31.845069  2209 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.846858  2176 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.860612  8529 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:31.861037  1531 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:31.886328  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.886298  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:31.891873  2175 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:31.900735  8684 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:31.949595  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.981931  8599 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:31.986040  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:31.988642  8619 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:32.040807  1429 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 23 to 24, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.041510  1678 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:32.043095  1429 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 15 to 16, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 16 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.064098  1532 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:32.065608  8561 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:32.066627  2212 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:32.069804  8561 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:32.100927  1607 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:32.122592  1531 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:32.134083  1432 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 13 to 14, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.205307  8680 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.221669  2209 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.246199  1607 consensus_queue.cc:237] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:32.237110  1526 raft_consensus.cc:2955] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.267359  2209 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:32.267894  2212 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:04:32.274190  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc704e97e2774b19b6d4867b31f50723 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:32.274204  8643 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:04:32.293946  1429 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 17 to 18, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:32.341325  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 71385.4us
I20260709 13:04:32.343942  1532 raft_consensus.cc:1275] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:04:32.347078  1683 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:32.349743  1678 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:32.352201  8576 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:32.350884  8610 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:04:32.358312  8662 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:32.390156  8610 consensus_queue.cc:1048] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:32.408624  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet bc704e97e2774b19b6d4867b31f50723 with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:32.478721   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:32.509476  2208 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:32.525447  8541 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:04:32.557565  1684 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:32.580173  8718 log.cc:927] Time spent T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:04:32.588864  2208 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.590245  8662 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.598201  1526 raft_consensus.cc:2955] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.604382  2212 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.622700  8590 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.582973  8649 raft_consensus.cc:2955] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.650411  1678 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.671875  8720 tablet_replica.cc:333] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:32.694449  1429 catalog_manager.cc:5697] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 14 to 15, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.723362  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet fbbc977cdccf4f338a0e97226117c985 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:32.737936  1429 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 15 to 16, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.756388  8723 tablet_replica.cc:333] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:32.757520  8723 raft_consensus.cc:2243] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:32.758442  8723 raft_consensus.cc:2272] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:32.771241  8723 ts_tablet_manager.cc:1916] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:32.773366  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fbbc977cdccf4f338a0e97226117c985 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:32.775547  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e72d8320164ed18fc7fccba3a0ecd3 with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:32.777653  2209 raft_consensus.cc:2955] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.786983  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3db0d135af1343458208be9b79d66635 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:32.776016  1431 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 23 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:32.788478  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:32.795310  8723 ts_tablet_manager.cc:1929] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 13:04:32.795864  8723 log.cc:1199] T fbbc977cdccf4f338a0e97226117c985 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/fbbc977cdccf4f338a0e97226117c985
I20260709 13:04:32.797600  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet fbbc977cdccf4f338a0e97226117c985 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:32.802697  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11e72d8320164ed18fc7fccba3a0ecd3 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:32.802657  1533 raft_consensus.cc:606] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Received request to transfer leadership to TS e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:32.836977  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:32.837493  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 3db0d135af1343458208be9b79d66635 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:32.837615  1526 raft_consensus.cc:606] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:32.845970  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:32.846644  1684 raft_consensus.cc:606] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:32.852113  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea2020c26814418b630a447fc961d07"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:32.853149  1684 raft_consensus.cc:606] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:32.864655  8720 raft_consensus.cc:2243] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:32.865581  8720 raft_consensus.cc:2272] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:32.867128  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:32.867992  1610 raft_consensus.cc:606] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:32.869619   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:32.871039   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:32.874084  8720 ts_tablet_manager.cc:1916] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:32.899600  8724 tablet_replica.cc:333] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:32.909904  8720 ts_tablet_manager.cc:1929] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.17
I20260709 13:04:32.910143  8724 raft_consensus.cc:2243] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:32.910444  8720 log.cc:1199] T bc704e97e2774b19b6d4867b31f50723 P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/bc704e97e2774b19b6d4867b31f50723
I20260709 13:04:32.911085  8724 raft_consensus.cc:2272] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:32.912325  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet bc704e97e2774b19b6d4867b31f50723 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:32.912541  8720 tablet_replica.cc:333] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:32.913702  8720 raft_consensus.cc:2243] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:32.914633  8720 raft_consensus.cc:2272] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:32.918035  8720 ts_tablet_manager.cc:1916] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:32.948711  8720 ts_tablet_manager.cc:1929] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:04:32.953598  8720 log.cc:1199] T 11e72d8320164ed18fc7fccba3a0ecd3 P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/11e72d8320164ed18fc7fccba3a0ecd3
I20260709 13:04:32.953691  8724 ts_tablet_manager.cc:1916] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:32.956689  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet 11e72d8320164ed18fc7fccba3a0ecd3 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:32.985483  8724 ts_tablet_manager.cc:1929] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:04:32.986289  8724 log.cc:1199] T 3db0d135af1343458208be9b79d66635 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/3db0d135af1343458208be9b79d66635
I20260709 13:04:32.989014  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 3db0d135af1343458208be9b79d66635 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:33.069414  8670 raft_consensus.cc:993] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:33.070611  8578 raft_consensus.cc:1081] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:33.081048  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:33.081651  1526 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.082059  1526 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.087874  8562 raft_consensus.cc:993] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:33.089468  8562 raft_consensus.cc:1081] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:33.090947  8562 raft_consensus.cc:993] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:33.091365  8562 raft_consensus.cc:1081] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Signalling peer e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:33.091269  1678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:33.092521  1678 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.092939  1678 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.098312  1526 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.100966  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:33.101502  1610 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.105144  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:33.105798  1683 raft_consensus.cc:3055] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:33.106089  1683 raft_consensus.cc:740] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:33.106801  1683 consensus_queue.cc:260] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.107577  2209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3"
dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:04:33.107985  1683 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.108165  2209 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.109763  2209 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.124478  1678 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.126022  1526 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:33.132186  2209 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:33.132755  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:33.131626  1610 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:33.133420  1603 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.131588  1678 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:33.143182  1683 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:33.134269  1498 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:33.146715  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:33.147743  1526 raft_consensus.cc:3055] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:33.145639  1603 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:33.149510  1647 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:33.150058  2209 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:33.148259  1526 raft_consensus.cc:740] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:33.146668  8562 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:33.152624  8627 raft_consensus.cc:2804] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:33.152907  8562 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:33.153290  8627 raft_consensus.cc:697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:33.153872  8562 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.154134  8627 consensus_queue.cc:237] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.158838  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:33.159462  1533 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:33.159765  1533 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:33.163844  1533 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:33.165163  1533 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.151839  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:33.166821  1678 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:33.168565  1526 consensus_queue.cc:260] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.180601  1533 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
I20260709 13:04:33.181787  2176 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:33.182583  8529 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:33.183163  8529 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:33.183871  1526 raft_consensus.cc:3060] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.184098  8529 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:33.195605  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 23 to 24, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.200727  1678 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
I20260709 13:04:33.187460  1429 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 23 to 24, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.216010  1432 catalog_manager.cc:5697] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 21 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.219648  1526 raft_consensus.cc:2468] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:33.261417  8627 raft_consensus.cc:993] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:33.261938  8627 raft_consensus.cc:1081] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:33.263933  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ea2020c26814418b630a447fc961d07"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:33.264712  1526 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.265125  1526 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:33.283334  8590 raft_consensus.cc:993] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:33.283903  8642 raft_consensus.cc:1081] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:33.285614  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:33.286245  1683 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.286689  1683 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.286036  1526 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.291088  1526 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:33.291774  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:33.292438  1603 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:33.292711  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:33.293305  1678 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:33.293583  1678 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:33.294420  1678 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.295749  1678 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:33.302356  1603 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:33.307009  1498 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:33.307804  8649 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:33.308542  8649 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:33.309490  8649 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.322992  1678 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:33.330121  1683 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.333632  1683 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:33.333865  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:33.334556  1603 raft_consensus.cc:3055] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:33.334877  1603 raft_consensus.cc:740] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:33.334996  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:33.335659  1526 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.333892  1432 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 23, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.335681  1603 consensus_queue.cc:260] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.340837  1603 raft_consensus.cc:3060] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:33.356074  1526 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:33.357409  1648 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:33.362143  1603 raft_consensus.cc:2468] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:33.363852  8561 raft_consensus.cc:2804] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:33.365173  8561 raft_consensus.cc:697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:33.366076  8561 consensus_queue.cc:237] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:33.406038  1432 catalog_manager.cc:5697] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 21 to 22, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.538856  1607 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:04:33.542234  8649 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:33.557467  1610 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:33.557467  1678 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:04:33.562003  8649 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:33.562269  8561 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:33.590890  1533 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:33.593189  8640 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:33.638132  1533 raft_consensus.cc:1275] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:33.640759  8561 consensus_queue.cc:1048] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:33.799341  1683 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:33.822455  8739 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
W20260709 13:04:33.837790  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 102470us
I20260709 13:04:33.888190   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:33.908473  8737 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:04:33.921757  8730 log.cc:927] Time spent T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.172s	user 0.001s	sys 0.003s
W20260709 13:04:33.930742  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 131405us
I20260709 13:04:33.933511  1607 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:04:33.939307  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 58545.5us
I20260709 13:04:33.986227  1533 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:33.996093  8680 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:04:34.019529  1603 raft_consensus.cc:1275] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:33.993607  8757 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:04:34.048671  8670 consensus_queue.cc:1048] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:34.051429  1678 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:04:34.057511  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 64818.8us
I20260709 13:04:34.071449  8757 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:34.376323  1607 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:34.522356  1533 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:04:34.523960  8642 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:34.547041  1682 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:04:34.552388  8541 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:04:34.781949  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 98063.4us
W20260709 13:04:35.455129  1556 debug-util.cc:398] Leaking SignalData structure 0x7b08003174a0 after lost signal to thread 434
W20260709 13:04:35.528505  1501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.015s	sys 0.010s
W20260709 13:04:35.529147  1501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.016s	sys 0.010s
W20260709 13:04:35.584343  1575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.007s	sys 0.006s
W20260709 13:04:35.585537  1575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.006s
W20260709 13:04:35.649264  2176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.011s	sys 0.019s
W20260709 13:04:35.649847  2176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.012s	sys 0.019s
I20260709 13:04:35.654868  8732 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.655440  8740 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.655568  8732 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.656131  8740 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.658500  8740 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.658489  8732 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.659147  8740 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.659720  8740 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:35.661172  8773 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:35.662364  8740 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:35.700469  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.004s	sys 0.008s
W20260709 13:04:35.701395  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.004s	sys 0.008s
W20260709 13:04:35.702648  1500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.010s	sys 0.021s
W20260709 13:04:35.703176  1500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.010s	sys 0.021s
W20260709 13:04:35.711598  1499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.006s	sys 0.005s
W20260709 13:04:35.712217  1499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.007s	sys 0.005s
W20260709 13:04:35.716463  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.032s
W20260709 13:04:35.717058  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.005s	sys 0.032s
I20260709 13:04:35.740166  8747 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.742067  8756 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.741637  8747 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.743261  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:35.744586  8748 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.745455  8748 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.743181  8756 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.753368  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 3649) took 1197 ms. Trace:
I20260709 13:04:35.754127  1684 rpcz_store.cc:276] 0709 13:04:34.555579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.555716 (+   137us) service_pool.cc:224] Handling call
0709 13:04:34.556286 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.556643 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.556673 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.557604 (+   931us) log.cc:844] Serialized 506 byte log entry
0709 13:04:34.666249 (+108645us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:04:34.666303 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.666386 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.752669 (+1086283us) raft_consensus.cc:1685] finished
0709 13:04:35.752715 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.753107 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":108294,"threads_started":1,"wal-append.queue_time_us":881312}
I20260709 13:04:35.744586  8642 raft_consensus.cc:493] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:04:35.756958  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800392980 after lost signal to thread 1467
I20260709 13:04:35.757426  8642 raft_consensus.cc:515] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.759274  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 3651) took 1187 ms. Trace:
I20260709 13:04:35.759545  8778 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.760294  8760 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.760514  8778 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.761250  8760 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.762585  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 4030) took 1276 ms. Trace:
I20260709 13:04:35.763088  1678 rpcz_store.cc:276] 0709 13:04:34.485850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.761247 (+1275397us) service_pool.cc:224] Handling call
0709 13:04:35.761748 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.761995 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.762032 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.762097 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:35.762162 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.762225 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.762383 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.764513  8662 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.765475  8662 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.766124  8741 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.763650  8778 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.767323  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39174 (request call id 3644) took 1393 ms. Trace:
I20260709 13:04:35.757055  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39172 (request call id 4032) took 1270 ms. Trace:
I20260709 13:04:35.764330  8785 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.741675  8759 raft_consensus.cc:493] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.767330  8741 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.767807  1683 rpcz_store.cc:276] 0709 13:04:34.373672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.765913 (+1392241us) service_pool.cc:224] Handling call
0709 13:04:35.766451 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.766799 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.766828 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.766890 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:04:35.766927 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.766986 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.767105 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.759765  1681 rpcz_store.cc:276] 0709 13:04:34.572023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.757621 (+1185598us) service_pool.cc:224] Handling call
0709 13:04:35.758177 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.758595 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.758630 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.758696 (+    66us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:04:35.758847 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.758916 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.759065 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.768700  1675 rpcz_store.cc:276] 0709 13:04:34.486330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.755349 (+1269019us) service_pool.cc:224] Handling call
0709 13:04:35.755979 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.756533 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.756560 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.756628 (+    68us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:04:35.756659 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.756721 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.756834 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.769151  8787 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.769323  8775 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.798091  8745 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.796532  8642 leader_election.cc:290] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.804090  8649 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.804294  8775 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.805210  8745 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.805591  8649 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.807550  8775 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.815318  8792 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.795431  8787 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.797698  8562 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.745463   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:35.789131  8747 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.787572  8662 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.827183  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 159) took 1436 ms. Trace:
I20260709 13:04:35.827744  1429 rpcz_store.cc:276] 0709 13:04:34.390988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.391246 (+   258us) service_pool.cc:224] Handling call
0709 13:04:35.826885 (+1435639us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3736,"reported_tablets":1}
I20260709 13:04:35.829264  8791 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.824175  8649 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.830760  8562 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.834839  8642 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.834939  8662 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.836992  8541 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.836930  8740 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.838420  8541 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.841399  8541 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.842060  8541 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.842760  8541 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.830483  8791 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.836701  8662 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.845160  8541 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.845772  8541 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.845880  8791 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.846693  8662 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.846479  8541 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.849341  8759 raft_consensus.cc:515] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.772169  8748 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.800753  8756 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.838488  8642 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.876921  8789 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.876399  8541 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.876670  8791 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.877017  8537 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.876219  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:35.882388  8791 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.882572  8537 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.883148  8642 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.885105  8791 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.770134  8785 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.881246  1535 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:35.889879  8791 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.892208  8590 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.893339  8743 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.893246  8590 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.894398  8743 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.890918  8791 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.896262  8794 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.897080  8541 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.897277  8794 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.897804  8755 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.897930  8541 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.898451  8759 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.898583  8755 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.899108  8759 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.887693  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:35.899785  8759 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.888595  8756 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.901669  8537 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.901623  8756 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.902014  8757 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.902825  8757 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.902074  8759 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.887971  8642 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.903703  8743 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.904093  8642 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.905007  8779 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.880716  8649 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.912212  8779 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.912773  8649 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.913918  8777 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.914820  8779 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.915007  8649 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.907742  8778 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.908368  8627 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.915958  8762 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.917430  8762 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.906016  8765 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:04:35.921581  1556 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf040 after lost signal to thread 1559
I20260709 13:04:35.921953  8765 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.909118  8788 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.911422  8783 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:35.923789  8788 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.924831  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:35.924504  8783 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.925910  1604 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:35.926702  8788 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.927582  8792 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.929257  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:35.839928  8740 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.929930  8793 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.930917  8793 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.914649  8777 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.916865  8627 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.933249  8740 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.929942  1604 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:35.934073  8782 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.934931  8627 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.935482  8786 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:35.936218  8786 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.939879  8745 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.941865  8780 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:35.943089  8780 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:35.951035  8787 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.953528  8755 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.915767  8778 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.944783  8680 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.904565  8756 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.955706  8680 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.958459  8680 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.962555  8562 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.944891  8757 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.964564  8793 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.927788  8783 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:35.966614  8778 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.967007  8746 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:35.967905  8746 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.945439  8786 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.970749  8746 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.972584  8760 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.977424  8590 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.979082  8762 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.981071  8792 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.982211  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:04:35.983008  1556 debug-util.cc:398] Leaking SignalData structure 0x7b080032c7c0 after lost signal to thread 1634
I20260709 13:04:35.983058  1608 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:35.983443  8541 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.878278  8789 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.970618  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:04:35.984604  1556 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5ac0 after lost signal to thread 1708
I20260709 13:04:35.985296  8791 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.984071  8741 leader_election.cc:290] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:04:35.986037  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800058240 after lost signal to thread 2236
I20260709 13:04:35.986152  8789 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.986388  8794 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.934725  8782 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:35.986645  8765 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:35.988835  8782 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:04:35.986404  1556 debug-util.cc:398] Leaking SignalData structure 0x7b0800371500 after lost signal to thread 2237
I20260709 13:04:35.990510  8777 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.992381  8785 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:35.992967  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78987.6us
I20260709 13:04:35.993673  8642 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:35.993718  8780 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:35.996351  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47543.8us
I20260709 13:04:35.997308  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:35.997290  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.003032  8777 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:36.008730  8796 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.009873  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.009809  8796 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.010974  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.011538  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a84223e947489c829c528c860660d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.020419  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.026311  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.012439  8795 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.029150  1603 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:04:36.036676  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.045893  1676 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:36.051734  8785 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.051637  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.030958  8796 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.053007  8796 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.052776  8785 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.053602  8796 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.051640  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.055109  8785 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.055850  8796 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.026738  8780 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.060626  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.069236  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.076323  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.078476  8760 raft_consensus.cc:493] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.079478  8760 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.080590  8732 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.081264  8732 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.071877  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.083024  8797 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.088006  8797 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.065791  8795 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.089870  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.090673  1684 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 16.
I20260709 13:04:36.090955  8797 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.094506  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.096526  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.097469  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.097760  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.076898  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.098241  8732 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.099254  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.099254  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.102185  8732 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.103099  8732 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.107236  8732 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.110958  8781 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.111164  8788 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.110844  8780 raft_consensus.cc:515] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.112159  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.113090  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.113998  8740 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.110755  8662 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:04:36.114727  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 43798us
I20260709 13:04:36.115830  2208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.116739  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.117113  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.117684  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:36.117838  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 44564.3us
I20260709 13:04:36.091210  8795 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.118167  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.118216  8783 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.119513  8760 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.122488  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.159994  8788 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.125087  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.160701  1684 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 22.
I20260709 13:04:36.162364  8788 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.125497  8799 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.066996  8796 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.122323  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbda5372a24182a9982a0d35ff91b7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.126437  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.127164  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:36.135341  8782 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.135634  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.142999  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.195508  1682 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 14.
I20260709 13:04:36.196995  1531 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 19.
I20260709 13:04:36.144271  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.197506  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.198866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.196524  8796 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.154556  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.159394  8800 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.145450  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.159571  8783 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.200491  8800 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.200896  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.202131  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.202630  8800 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.203179  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.165241  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.202636  8783 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.171653  8740 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.204524  1680 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 20.
I20260709 13:04:36.205412  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.205487  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.206221  8740 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.174433  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.206497  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.149873  1679 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:36.176420  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.168630  8760 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.209241  8760 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:36.210279  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 83290us
I20260709 13:04:36.211383  8760 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.211690  8793 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:36.178201  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.109381  1647 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:04:36.219075  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 204954us
I20260709 13:04:36.216988  1684 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:36.220290  8778 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:36.220683  8778 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.221053  8778 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.180876  8780 leader_election.cc:290] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.183445  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.158140  8786 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.188444  8795 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.222316  8786 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.222640  8795 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.191987  8802 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.224886  8786 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.225203  8802 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.222277  1647 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.227102  8788 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:36.227502  8802 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.227608  8788 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.192740  8781 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.213131  8799 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.228322  8788 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.229789  8781 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.229947  8799 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.197573  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.175194  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.212566  1501 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:36.212764  8793 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.176679  8662 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.232604  8793 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:36.234052  8662 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.199904  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.234622  1501 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:36.235760  8757 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:36.236166  8757 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.236557  8757 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.239966  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.240654  2210 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:36.240823  8760 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:36.241217  8760 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.241641  8760 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:36.241233  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d501527377474732bddb08ed904bd34d" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.243543  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.216646  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.196583  8782 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.224895  8795 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.244864  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.245083  2208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.245818  8782 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.217818  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.242139  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.247253  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.231598  8796 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.241577  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.248906  1647 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.248955  8680 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:36.249655  8680 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.249806  8789 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:36.250162  8680 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:36.250303  8789 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.250869  8789 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:36.252321  8800 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.253086  8800 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.255420  8800 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.255828  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.256217  8780 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:36.256706  8780 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.257190  8780 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.260629  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:36.261623  8782 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:36.262177  8782 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.262739  8782 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:36.264088  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 72677us
I20260709 13:04:36.241739  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.268625  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.269703  8794 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.270176  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.270397  8794 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.271432  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.271674  1501 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:36.272560  8786 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:36.272629  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.272935  8765 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.273051  8786 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.273561  8765 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.266315  8790 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.274976  8788 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.275195  8790 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.275821  8765 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.273603  8786 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:36.280184  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 46067.7us
I20260709 13:04:36.283315  8562 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.288400  8562 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:36.288998  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.289063  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.289613  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.290742  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.291808  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.292007  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.292619  1530 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:36.292866  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.293483  1533 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:36.294370  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.294983  1528 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:04:36.293510  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.296540  8794 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.297108  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.297542  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.298694  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.300551  8755 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.300664  8797 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.302276  8755 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.302543  8797 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.304159  8562 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.304447  8755 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.305441  8782 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.306286  1499 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.307710  1499 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.308099  8745 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:36.308487  8745 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.308813  8797 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.309002  8649 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.309468  8662 raft_consensus.cc:493] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.308843  8745 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.310158  8662 raft_consensus.cc:515] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.317663  8786 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:36.301689  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 171467us
I20260709 13:04:36.321036  1501 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.322487  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.322814  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.324930  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.325883  8756 raft_consensus.cc:2749] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.326592  8756 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:36.328137  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47938.1us
I20260709 13:04:36.330265  2178 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.331179  8732 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.331861  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.333097  8794 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.333765  8794 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.334386  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.338719  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.340319  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.341696  8780 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.339387  1526 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 23.
I20260709 13:04:36.347353  8794 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.337946  2178 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:36.348366  8662 leader_election.cc:290] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.355795  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.348909  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.350477  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.350756  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.357393  8805 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:36.351015  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.351807  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.357962  8805 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.358451  8805 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.357977  1531 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
I20260709 13:04:36.361052  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.365681  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.366130  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.367033  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.367415  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.369505  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.365744  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.371476  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.307678  8782 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.372269  1533 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:36.375711  1574 consensus_peers.cc:597] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5174ec6bd2452abb5d7617555ce4f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:36.378391  8745 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.380517  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.381155  8786 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.382206  1526 raft_consensus.cc:1240] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:36.382503  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.383338  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.383414  8680 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.385587  8680 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.385794  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.386786  1531 raft_consensus.cc:1240] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:36.387458  8788 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.387581  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.353864  8793 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.354509  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.389357  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.354975  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.390144  1603 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:04:36.390872  8793 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.391340  2176 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.391520  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.392795  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.394240  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.394361  1574 leader_election.cc:304] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.343958  8780 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.395751  8804 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.396277  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.396458  8778 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.396872  1676 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:36.396962  2176 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.397495  1677 raft_consensus.cc:1240] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:36.398284  8741 raft_consensus.cc:2749] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.401084  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.402532  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2f5a84af4984d759b3126fa5852fb2e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.402737  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.403518  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.404330  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.404537  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.406191  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.406879  2176 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:36.409103  2176 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:36.406661  1501 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.411175  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.411309  8803 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:36.412078  8803 raft_consensus.cc:493] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.412449  8803 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.412763  8793 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.405448  8804 raft_consensus.cc:2749] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.414143  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.414153  1601 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:36.412467  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.417903  8732 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:36.418114  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.418408  8732 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.418828  8732 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.420365  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.417941  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.418196  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.423640  2211 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.420534  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.399540  8805 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.424800  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.426118  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.417075  8745 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.431257  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.432423  8763 consensus_queue.cc:1059] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:04:36.449358  8793 raft_consensus.cc:3055] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:36.449797  8793 raft_consensus.cc:740] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.450783  8793 consensus_queue.cc:260] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.451782  1678 raft_consensus.cc:1240] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:36.452127  8793 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.455749  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.456364  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.457064  8670 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.458644  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.460094  8804 consensus_queue.cc:1059] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:04:36.460364  8793 consensus_queue.cc:1059] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:36.461148  8804 raft_consensus.cc:3055] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:36.461683  8804 raft_consensus.cc:740] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.461624  8763 raft_consensus.cc:3055] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:36.462263  8763 raft_consensus.cc:740] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.463006  8763 consensus_queue.cc:260] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.462842  8804 consensus_queue.cc:260] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.468421  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.468519  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.420650  8790 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.472221  1648 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.463999  8763 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.478361  8805 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.476656  1574 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.483238  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e287a2761794958b3002cd2258cf2f2" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.484206  1676 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 25.
I20260709 13:04:36.484898  1677 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 24. Current term is 25. Ops: []
I20260709 13:04:36.485762  1678 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:36.487262  8561 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:36.490667  2209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.484805  1574 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.495730  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.487917  1501 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.481442  8680 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:36.501225  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.503959  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.429685  8789 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.506989  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.507355  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.488956  8780 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:36.513893  8780 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.514369  8780 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.509513  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4443c0ffc3140788a1384ff8bc1b047" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.500607  2208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.519155  8765 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:36.519613  8765 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.520004  8765 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.502035  8804 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.519166  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb93316b761941d4be4cb8d1af0db97e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.512447  8760 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.509111  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.506263  1574 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:36.526239  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.518169  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891c34d92ded4b85948a508cf94b612c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.499459  8778 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.500533  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.528575  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.529060  8791 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:36.529948  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.533242  1684 raft_consensus.cc:1240] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:36.505347  8793 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:36.504628  8680 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:36.529698  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.539247  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.540267  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.530287  8670 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:04:36.542449  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6a74dd4014d38b1b536f6b0fc66ec" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.544528  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.545411  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.548800  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:36.552335  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.533769  8791 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:36.545697  8680 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:36.558128  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.546736  8793 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.569060  8793 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.554359  8777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50684 (request call id 6) took 2162 ms. Trace:
I20260709 13:04:36.562013  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.567459  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.572150  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc3085f661f457e8c8d15478c227311" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.570451  8777 rpcz_store.cc:276] 0709 13:04:34.373902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.374213 (+   311us) service_pool.cc:224] Handling call
0709 13:04:34.460630 (+ 86417us) log.cc:844] Serialized 506 byte log entry
0709 13:04:36.527685 (+2067055us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":227,"raft.queue_time_us":131893,"raft.run_cpu_time_us":1782,"raft.run_wall_time_us":1782,"thread_start_us":10389,"threads_started":1,"wal-append.queue_time_us":10832,"wal-append.run_cpu_time_us":1828,"wal-append.run_wall_time_us":1002895}
I20260709 13:04:36.560705  8800 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:36.574599  8760 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.562574  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.581032  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.582393  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.582712  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.583428  8741 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.575601  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.583922  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.576486  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.578080  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.579602  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.588498  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:36.592160  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.594096  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.594377  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.595585  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.558048  8791 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.597925  2208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:36.600904  2175 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.601716  8790 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.602429  2175 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.603639  8805 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.613737  2211 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:36.615828  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf31533a97f4325919d60e19d73b3f2" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.618086  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db0d135af1343458208be9b79d66635"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:36.618937  1604 raft_consensus.cc:606] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.620007  2210 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:36.621030  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.623706  8757 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.627107  8757 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.631631  1431 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 16, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 26 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:36.633404  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.634506  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:36.634915  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.563906  1527 raft_consensus.cc:1240] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:36.635066  1680 raft_consensus.cc:606] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:36.642223  8790 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:36.643419  8790 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:36.643728  8790 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.640157  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.644572  8790 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.645203  1574 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.646042  8790 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:36.647147  1574 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.648185  8800 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.649362  8800 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.650166  8732 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.650746  1648 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.651057  8741 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:36.651971  8670 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.653551  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.653836  8754 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:36.654219  8754 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.613420  2175 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:36.657177  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 43837.4us
I20260709 13:04:36.657346  8748 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:36.658087  8805 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:36.658843  2175 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:36.659634  8805 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:36.659974  8805 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:36.660370  8805 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:36.655241  8754 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.669636  8796 consensus_queue.cc:1059] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:36.670756  8796 raft_consensus.cc:3055] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:36.671141  8796 raft_consensus.cc:740] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.672290  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.673580  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba1b10b23d84716ad2e0452649e214e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.670584  8802 consensus_queue.cc:1059] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:36.675462  8802 raft_consensus.cc:3055] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:36.675896  8802 raft_consensus.cc:740] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.676513  8796 consensus_queue.cc:260] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.676996  8802 consensus_queue.cc:260] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.677755  8796 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:36.678826  8802 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:36.680294  8561 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:36.682157  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:36.684022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.683634  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.665689  2175 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.686594  1648 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.687680  2175 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.691111  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.692365  8795 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:36.692816  8780 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.694047  1610 raft_consensus.cc:1240] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:36.695798  1527 raft_consensus.cc:1240] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:36.695998  8780 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.696226  8670 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:36.700769  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.702426  8670 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.696255  1531 raft_consensus.cc:1240] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Rejecting Update request from peer e3ab72f324d545a6b4ecb1025df1f7c0 for earlier term 24. Current term is 25. Ops: []
I20260709 13:04:36.704355  8732 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.706822  8754 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.709012  1526 raft_consensus.cc:1240] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:36.709645  8670 consensus_queue.cc:1059] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:36.710795  8749 raft_consensus.cc:3055] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:36.711139  8749 raft_consensus.cc:740] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.667533  1679 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:36.712559  8783 consensus_queue.cc:1059] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:36.713603  8783 raft_consensus.cc:3055] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:36.713912  8783 raft_consensus.cc:740] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.714869  8783 consensus_queue.cc:260] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.715415  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.711957  8749 consensus_queue.cc:260] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.717519  8783 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.718152  8740 consensus_queue.cc:1059] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:36.719255  8740 raft_consensus.cc:3055] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:36.719559  8740 raft_consensus.cc:740] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.719919  8561 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:36.718003  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.720450  8740 consensus_queue.cc:260] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.722111  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.722817  1532 raft_consensus.cc:2468] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:36.725515  8795 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.729032  8749 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.726172  2175 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.732882  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:36.732586  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.737751  2175 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.738981  2178 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.738050  8794 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.738291  8795 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.740062  8780 consensus_queue.cc:1059] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:36.740432  8795 raft_consensus.cc:2749] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:36.741952  8740 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.742837  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.746680  8780 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:36.747066  8780 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:36.747958  8780 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.748842  2212 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:04:36.749372  8780 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:36.737586  1680 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:36.759570  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:36.775840  1499 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.758895  2211 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:36.759528  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a39df5ae9144c118d4158b68b17044c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.774885  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:04:36.805014  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 45528.2us
I20260709 13:04:36.805776  1648 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.808416  8748 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:36.808866  8748 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:36.809240  8748 raft_consensus.cc:3060] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.819167  2210 raft_consensus.cc:2468] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 16.
I20260709 13:04:36.789675  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
W20260709 13:04:36.822307  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 46567.6us
I20260709 13:04:36.776265  8796 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.741978  8789 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.822851  1648 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.824404  1576 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.732191  8765 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.695109  8791 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.821956  8561 raft_consensus.cc:2804] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:36.828644  1576 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.825146  8787 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:36.758131  8803 raft_consensus.cc:515] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.835636  1576 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:36.837620  1608 raft_consensus.cc:1240] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:36.836097  8800 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:36.832352  8777 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:36.841138  1610 raft_consensus.cc:1240] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:36.842361  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.844596  1576 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.845736  2212 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:36.826160  8788 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:04:36.847021  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5396b1c71261414f9ca554acc690f489"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:36.847852  1526 raft_consensus.cc:606] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:36.850684  1501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.842608  8777 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:36.844975  8787 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.853961  8787 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.859454  1683 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:36.860636  8811 ts_tablet_manager.cc:933] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.845197  8780 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:36.865922  8765 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.866959  1530 raft_consensus.cc:2468] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:36.868409  8794 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.867551  8680 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.828471  8748 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.872054  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:36.870987  8680 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.872915  8748 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:36.835640  8805 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.873889  2210 raft_consensus.cc:1240] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:36.875728  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.877130  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.877723  1532 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:36.877987  1498 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.870944  8791 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.886540  1609 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:36.891315  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.892661  1498 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.896921  1532 raft_consensus.cc:2468] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
I20260709 13:04:36.898248  1498 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.898924  2176 leader_election.cc:304] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:36.901149  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
W20260709 13:04:36.905050  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 56926.3us
I20260709 13:04:36.906162  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.898779  8793 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:36.898867  2206 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 17.
I20260709 13:04:36.908058  8787 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.927287  8805 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:36.927937  8803 leader_election.cc:290] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:36.928910  8627 consensus_queue.cc:1059] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:36.929972  8627 consensus_queue.cc:1059] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:36.930938  8627 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:36.931286  8627 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.907254  8740 raft_consensus.cc:2804] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:36.932148  8740 raft_consensus.cc:697] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:36.932221  8748 raft_consensus.cc:3055] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:36.932651  8748 raft_consensus.cc:740] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.933161  8740 consensus_queue.cc:237] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.933478  8748 consensus_queue.cc:260] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.934809  8748 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.919521  8746 raft_consensus.cc:2804] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:36.936585  8746 raft_consensus.cc:697] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.937626  1610 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:36.937469  8746 consensus_queue.cc:237] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.939313  8782 raft_consensus.cc:993] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:36.900452  8763 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.921398  8788 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:36.942154  8788 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.942947  8788 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.943506  8670 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:36.921398  8760 consensus_queue.cc:1059] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:04:36.945276  8760 raft_consensus.cc:3055] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:36.945606  8760 raft_consensus.cc:740] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.939805  8782 raft_consensus.cc:1081] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:36.946547  8760 consensus_queue.cc:260] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.950657  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc704e97e2774b19b6d4867b31f50723" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:36.954092  8627 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.957785  8627 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:36.908623  8811 tablet_copy_client.cc:323] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:36.914597  8791 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:36.960005  1499 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.918560  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:36.968218  1526 raft_consensus.cc:606] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:36.919356  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 96715.2us
I20260709 13:04:36.968839  8782 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:36.919574  8561 raft_consensus.cc:697] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.972786   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:36.972970  8782 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:36.974622   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:36.974771  1533 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:36.974884  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.975466  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:36.975728  1530 raft_consensus.cc:2393] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 20: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:36.978699  2208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443ffcfd9be74d9891a8cb9596947ca3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:36.896483  8757 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:36.924225  2210 raft_consensus.cc:1240] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:36.924875  8754 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:36.972820  8561 consensus_queue.cc:237] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.985193  8754 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:36.916301  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.986255  8754 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:36.986310  8765 consensus_queue.cc:1059] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:36.988631  1683 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:04:36.991945  1648 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.974133  8782 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:36.995350  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 79123.5us
I20260709 13:04:37.002772  8780 raft_consensus.cc:3055] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:37.003237  8780 raft_consensus.cc:740] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.003458  1526 raft_consensus.cc:1240] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24. Ops: []
I20260709 13:04:37.004552  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.004212  8780 consensus_queue.cc:260] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:36.947958  8760 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:36.969409  8788 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:37.005829  1576 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:36.960075  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5396b1c71261414f9ca554acc690f489"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:37.021868  1679 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:04:37.022184  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4443c0ffc3140788a1384ff8bc1b047. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.022341  1679 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:36.987835  8765 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:37.026613  8789 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:37.025971  8783 consensus_queue.cc:1059] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
I20260709 13:04:37.030429  8778 raft_consensus.cc:3055] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:37.030970  8778 raft_consensus.cc:740] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:37.032070  8778 consensus_queue.cc:260] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:37.023972  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 125827us
I20260709 13:04:37.033697  8778 raft_consensus.cc:3060] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:37.034235  1498 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.042744  1498 leader_election.cc:304] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.043570  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.049889  1576 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.019048  8680 raft_consensus.cc:2804] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:37.010780  8791 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:37.054863  1498 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:36.998785  8757 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:04:37.057466  1498 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.060166  1576 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.036269  8793 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.035976  2208 raft_consensus.cc:2468] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 15.
I20260709 13:04:37.064941  8815 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:37.069336  8662 raft_consensus.cc:993] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:37.060012  8680 raft_consensus.cc:697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:37.054961  8794 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:37.054468  8800 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.071890  1498 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.056102  8787 raft_consensus.cc:2749] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.064016  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.059603  8745 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.084075  8741 raft_consensus.cc:1081] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:37.060635  8777 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.097285  1679 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.063180  8780 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:37.070566  8791 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.092131  1498 leader_election.cc:304] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:37.077723  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 52187.1us
I20260709 13:04:37.094897  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.094287  8793 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:37.111107  1498 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.111449  1576 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.113186  1679 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:37.118441  1498 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.098081  8800 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:37.121440  1498 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.121510  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:37.127410  1530 raft_consensus.cc:3055] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:37.127743  1530 raft_consensus.cc:740] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:37.119617  8680 consensus_queue.cc:237] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.123385  8745 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.127998  1498 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.130132  1648 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:37.116465  8662 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:37.133044  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:37.141089  1610 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:37.116626  8763 raft_consensus.cc:2749] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.120342  8794 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:37.133560  1530 consensus_queue.cc:260] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.126261  8787 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:37.132891  8815 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:37.138500  8748 raft_consensus.cc:2804] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:37.146849  8793 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.160365  8748 raft_consensus.cc:697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:37.167672  1530 raft_consensus.cc:3060] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:37.175478  8748 consensus_queue.cc:237] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:37.164494  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 51512.7us
I20260709 13:04:37.180088  1576 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.181844  1576 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:37.183846  1576 leader_election.cc:304] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.288712  1609 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:37.290154  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 106421us
I20260709 13:04:37.291150  8741 raft_consensus.cc:2749] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:37.292757  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:37.187443  8791 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:37.284248  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 93810.1us
I20260709 13:04:37.293866  8791 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.294340  1610 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:37.295857  1647 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:37.301630  8754 raft_consensus.cc:2804] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:37.302202  8754 raft_consensus.cc:697] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:37.303133  8754 consensus_queue.cc:237] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.303529  2210 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:04:37.187193  8765 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:37.306880  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 178956us
I20260709 13:04:37.307753  1498 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.287743  1530 raft_consensus.cc:2468] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
I20260709 13:04:37.316987  8627 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:37.343420  2208 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:04:37.348937  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 53840.9us
I20260709 13:04:37.349372  8680 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:37.354729  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 47064.4us
I20260709 13:04:37.356766  1498 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.353574  1576 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:37.371129  2175 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.372589  8805 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.374147  2175 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.378961  2175 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.382125  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:37.384379  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:37.369917  8782 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:37.386619  8740 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:37.387605  8805 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:37.401866  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db0d135af1343458208be9b79d66635"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:37.402729  1677 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:37.403201  1677 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:37.397425  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:37.416817  8782 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:37.417523  8782 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:37.420352  8793 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.456951  1526 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:37.463403  1679 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
W20260709 13:04:37.475324  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88837.4us
I20260709 13:04:37.480252  1527 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:37.481477  8778 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:37.486903  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:37.470920  1680 raft_consensus.cc:2468] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:37.396462  8777 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:04:37.489384  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 104299us
I20260709 13:04:37.474176  8782 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:37.496649  1680 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:04:37.495936  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 139275us
I20260709 13:04:37.501039  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:37.501447  8830 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:04:37.505308  8803 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:04:37.509127  1430 catalog_manager.cc:5697] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 23 to 24, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:37.529673  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 1d5174ec6bd2452abb5d7617555ce4f7 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:37.530411  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 1d5174ec6bd2452abb5d7617555ce4f7 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-1d5174ec6bd2452abb5d7617555ce4f7
I20260709 13:04:37.529749  1498 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.528420  1530 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:37.539896  8562 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:37.541105  2175 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.541961  8803 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.543105  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.544231  1678 raft_consensus.cc:2468] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
I20260709 13:04:37.544471  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:37.546538  1609 raft_consensus.cc:3060] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:37.549216  1610 raft_consensus.cc:3060] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:37.551671  1683 raft_consensus.cc:1275] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:37.497911  8777 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.554296  8777 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.549876  1677 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:37.560074  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 62632.9us
I20260709 13:04:37.569412  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:37.573274  1677 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:37.571444  1576 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:37.576017  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:37.576741  1608 raft_consensus.cc:3055] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:37.577780  1608 raft_consensus.cc:740] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.585493  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:37.580966  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:37.586589  2211 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:37.587512  1609 raft_consensus.cc:1275] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:04:37.605806  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:37.611176  2211 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:37.612911  1648 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:37.598006  1608 consensus_queue.cc:260] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:37.617528  1608 raft_consensus.cc:3060] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:37.576740  8760 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:37.619313  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbc977cdccf4f338a0e97226117c985" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:37.624046  1610 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:37.630643  1528 raft_consensus.cc:1275] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:37.618577  8765 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:37.627744  8818 raft_consensus.cc:2804] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:37.641041  8840 ts_tablet_manager.cc:933] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:37.639639  1608 raft_consensus.cc:2468] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
I20260709 13:04:37.653138  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 265) took 1119 ms. Trace:
I20260709 13:04:37.658210  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 298) took 1049 ms. Trace:
I20260709 13:04:37.623116  8793 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.658670  1429 rpcz_store.cc:276] 0709 13:04:36.608730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.608880 (+   150us) service_pool.cc:224] Handling call
0709 13:04:37.658136 (+1049256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20427,"reported_tablets":1}
I20260709 13:04:37.632071  2206 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:04:37.664382  2208 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:37.666676  8760 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:37.667768  1534 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:37.675325  8818 raft_consensus.cc:697] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:37.682438  1527 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:37.682524  1528 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:37.672262  1620 tablet_copy_source_session.cc:215] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:37.627532  8836 consensus_queue.cc:1048] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 13:04:37.664953  8838 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:37.689790  1677 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:37.653649  1431 rpcz_store.cc:276] 0709 13:04:36.533551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.540181 (+  6630us) service_pool.cc:224] Handling call
0709 13:04:37.653065 (+1112884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:36.826822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:36.863065 (+ 36243us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:36.863113 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:04:36.863146 (+    33us) tablet.cc:662] Decoding operations
0709 13:04:36.863564 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:36.863665 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:36.863702 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:36.864056 (+   354us) tablet.cc:701] Row locks acquired
0709 13:04:36.864112 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:04:36.864262 (+   150us) write_op.cc:270] Start()
0709 13:04:36.864406 (+   144us) write_op.cc:276] Timestamp: P: 1783602276864199 usec, L: 0
0709 13:04:36.864441 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:04:36.865152 (+   711us) log.cc:844] Serialized 599 byte log entry
0709 13:04:37.288655 (+423503us) op_driver.cc:464] REPLICATION: finished
0709 13:04:37.513016 (+224361us) write_op.cc:301] APPLY: starting
0709 13:04:37.513150 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:37.515266 (+  2116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:37.515436 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:37.598361 (+ 82925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:37.648841 (+ 50480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:37.648908 (+    67us) write_op.cc:312] APPLY: finished
0709 13:04:37.649193 (+   285us) log.cc:844] Serialized 25 byte log entry
0709 13:04:37.649396 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:37.649479 (+    83us) write_op.cc:454] Released schema lock
0709 13:04:37.649539 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:37.649957 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:37.649986 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":198812,"apply.run_cpu_time_us":5375,"apply.run_wall_time_us":151438,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":174546,"prepare.run_cpu_time_us":22882,"prepare.run_wall_time_us":207985,"raft.queue_time_us":162701,"raft.run_cpu_time_us":30608,"raft.run_wall_time_us":136565,"replication_time_us":424041,"thread_start_us":551934,"threads_started":4,"wal-append.queue_time_us":197508}]]}
W20260709 13:04:37.703018  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 131648us
I20260709 13:04:37.684163  8765 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.704676  1576 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:37.687897  8818 consensus_queue.cc:237] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:37.683916  8670 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:04:37.685091  8763 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:04:37.725260  8765 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.732928  1677 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:37.696493  8680 consensus_queue.cc:1048] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:04:37.728958  8824 raft_consensus.cc:2804] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:37.704605  8788 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:04:37.747854  1576 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:37.741431  8840 tablet_copy_client.cc:323] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:37.728468  8778 consensus_queue.cc:1048] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:04:37.741914  8670 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 13:04:37.775568  1575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.775647  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 186630us
I20260709 13:04:37.748512  8782 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:04:37.766530  8824 raft_consensus.cc:697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.794287  8662 consensus_queue.cc:1059] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:37.776820  8791 raft_consensus.cc:2804] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:37.809125  8824 consensus_queue.cc:237] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.810930  8662 raft_consensus.cc:3055] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:37.812500  8662 raft_consensus.cc:740] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.830502  8811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5174ec6bd2452abb5d7617555ce4f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:37.852144  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 101086us
W20260709 13:04:37.883714  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 60001.6us
I20260709 13:04:37.889029  1607 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:37.892467  8662 consensus_queue.cc:260] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:37.893895  8662 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:37.899854  8858 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:37.900545  8858 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:37.903154  8858 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:37.903788  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:37.904665  1677 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:37.909085  1605 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:37.912876  8818 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:37.883348  8791 raft_consensus.cc:697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:37.916185  8791 consensus_queue.cc:237] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:37.922011  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 99073.2us
I20260709 13:04:37.927798  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:37.928807  2211 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:37.941397  1677 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:04:37.951545  1499 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe9105bf6ce4e118b6b4a3135515534. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.002429  8763 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:04:38.002146  8662 raft_consensus.cc:493] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.033823  1607 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:38.036582  8561 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.041095  8868 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:38.042047  8868 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.051113  8868 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.053848  1606 raft_consensus.cc:3060] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.057392  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet c4443c0ffc3140788a1384ff8bc1b047 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:38.058153  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet c4443c0ffc3140788a1384ff8bc1b047 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-c4443c0ffc3140788a1384ff8bc1b047
I20260709 13:04:38.062806  8760 raft_consensus.cc:993] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:38.062976  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:38.063858  8780 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:38.064244  8780 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:38.064639  8780 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:38.008994   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:38.087304  1606 raft_consensus.cc:1275] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:38.042558  8662 raft_consensus.cc:515] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:38.093336  8760 raft_consensus.cc:1081] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:38.123850  8662 leader_election.cc:290] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:38.124651  1526 raft_consensus.cc:1275] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:38.102598  8778 consensus_queue.cc:1048] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:38.103549  1694 tablet_copy_source_session.cc:215] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:38.108964  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:04:38.116827  8867 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:38.156337  2207 raft_consensus.cc:1275] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:38.132607  1498 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:38.143517  2211 raft_consensus.cc:2393] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d in current term 18: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:04:38.164180  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:38.164825  1606 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:38.165196  1606 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:38.164548  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:04:38.152760  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 195806us
I20260709 13:04:38.182202  8562 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:38.184000  8830 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:38.184568  8830 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:38.198016  8670 consensus_queue.cc:1048] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.216249  8778 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:38.216889  8778 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:38.226866  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 94348.7us
I20260709 13:04:38.228389  1601 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:38.233685  1527 raft_consensus.cc:3060] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:38.212200  8749 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:38.237609  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea2020c26814418b630a447fc961d07" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:38.242682  8866 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:38.243188  8830 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:38.248186  8749 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.249598  8778 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:38.249378  1606 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.250788  8749 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.264777  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.267998  1606 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.273713  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:38.274686  1680 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
I20260709 13:04:38.260993  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.262187  1530 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:38.297293  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:38.310427  1576 leader_election.cc:304] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:38.318760  1530 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:38.271559  8837 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.319995  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148d93cd579345f7bda3407d430fed95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:38.314569  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:38.327145  8861 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:38.327577  8780 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.331243  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:38.333406  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:38.334177  2211 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:38.339720  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 80930us
I20260709 13:04:38.342533  1648 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:38.360776  2211 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:04:38.361915  1574 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:38.327615  8861 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:38.336494  8862 raft_consensus.cc:2749] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:38.315414  8793 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:04:38.390152  1648 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:38.354646  8789 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:38.411423  8878 log.cc:927] Time spent T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:04:38.414229  1430 catalog_manager.cc:5697] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 15 to 16, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 16 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:38.422175  1430 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 23 to 24, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:38.416394  2206 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.424898  1430 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 16 to 17, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 17 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:38.380095  8861 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.457190  1527 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:04:38.336100  8826 consensus_queue.cc:1048] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:04:38.430768  8863 raft_consensus.cc:2804] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:38.457046  8561 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:38.501730  8780 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.502928  8840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4443c0ffc3140788a1384ff8bc1b047. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:38.516466  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 188198us
I20260709 13:04:38.340992  8837 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.521993  8811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41274 (request call id 361) took 1748 ms. Trace:
I20260709 13:04:38.522578  8811 rpcz_store.cc:276] 0709 13:04:36.773468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.773639 (+   171us) service_pool.cc:224] Handling call
0709 13:04:36.861084 (+ 87445us) ts_tablet_manager.cc:934] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
0709 13:04:37.775104 (+914020us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:38.022163 (+247059us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:38.022290 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:38.521019 (+498729us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:38.521483 (+   464us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:38.521836 (+   353us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:38.521897 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8117,"tablet-copy.queue_time_us":86360,"thread_start_us":90973,"threads_started":2}
I20260709 13:04:38.525357  8811 tablet_copy_client.cc:806] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:38.526248  8811 tablet_copy_client.cc:670] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:38.486824  8863 raft_consensus.cc:697] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:38.532167  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:38.531898  8863 consensus_queue.cc:237] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.532891  1682 raft_consensus.cc:2393] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 22: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:38.593493  8837 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.614688  8763 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.615301  8763 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:38.617664  8763 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:38.628294  2211 raft_consensus.cc:1275] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:38.630158  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:38.630930  1675 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:38.633951  8754 consensus_queue.cc:1048] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:38.636498  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:38.639633  8890 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:38.640157  8890 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.640506  8890 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:38.645076  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 127911us
I20260709 13:04:38.650125  1684 raft_consensus.cc:1275] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:04:38.652635  1676 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:38.653481  1682 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:38.653378  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:38.654803  2211 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 20.
I20260709 13:04:38.666955  8830 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:38.669493  8830 raft_consensus.cc:3055] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:38.671023  8830 raft_consensus.cc:740] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:38.680852  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c985edaa245138167af8ae5b22067" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.682505  8627 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.683108  8627 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.707438  1499 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:38.719204  1675 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:38.658327  8740 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.729553  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.736825  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.737524  1602 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 19.
I20260709 13:04:38.740672  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d54062a82c94b8c93a956fc9082a450" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:38.746604  1534 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:38.753054  1609 raft_consensus.cc:1240] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.748607  1498 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:38.705224  8818 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:38.735347  8793 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:38.774417  8757 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:38.734887  8846 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:04:38.767570  8793 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.788970  8811 tablet_copy_client.cc:538] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:04:38.838660  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 47723.2us
I20260709 13:04:38.803288  8890 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:38.786615  8836 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:38.804219  8765 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:38.749173  8740 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.786059  8627 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.762293  8852 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:04:38.763134  8864 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:04:38.784837  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:38.703214  8830 consensus_queue.cc:260] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.841616  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:38.853716  1534 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:38.830749  8793 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:38.768592  8818 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.859807  1675 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:38.799831  8868 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:38.873396  1607 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:38.824858  8861 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:38.918040  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 51914.6us
W20260709 13:04:38.922905  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 203525us
I20260709 13:04:38.859272  8824 consensus_queue.cc:1048] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:04:38.870482  8777 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:04:38.863689  8836 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:38.922336  8859 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.918694  8897 consensus_queue.cc:1059] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:04:38.977954  8740 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:38.980571  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:38.981379  1676 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:04:38.986399  8861 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.988004  2178 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:38.991077  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:38.992826  8910 ts_tablet_manager.cc:933] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
I20260709 13:04:38.994861  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41288 (request call id 383) took 1507 ms. Trace:
I20260709 13:04:38.995414  8840 rpcz_store.cc:276] 0709 13:04:37.487343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.487529 (+   186us) service_pool.cc:224] Handling call
0709 13:04:37.641435 (+153906us) ts_tablet_manager.cc:934] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
0709 13:04:38.054282 (+412847us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4c00108240. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696345a20 00007f4696356a29 00007f469635713f 00007f469631b2ab 00007f4696348f3c 00007f4696349461 00007f4696349768 00007f469c0cf2eb 00007f469cff4d3b 00007f469cfef008 00007f469cfee405
0709 13:04:38.186574 (+132292us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:38.677511 (+490937us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:38.677638 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:38.984926 (+307288us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:38.985203 (+   277us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:38.994563 (+  9360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:38.994764 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":283,"spinlock_wait_cycles":7748992,"tablet-copy.queue_time_us":144313,"thread_start_us":214745,"threads_started":2}
I20260709 13:04:38.997567  8840 tablet_copy_client.cc:806] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:39.000458  8840 tablet_copy_client.cc:670] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:39.002277  8884 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:39.002744  8884 raft_consensus.cc:493] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.003072  8884 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:38.962610  8859 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.010353  8859 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:38.955595  8746 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:39.014463  8746 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.015154  8890 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.016673  8746 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:39.014626  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:39.020771  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:39.020826  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:39.032315  1676 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 18.
W20260709 13:04:39.013938  8904 log.cc:927] Time spent T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:04:39.037345  8840 tablet_copy_client.cc:538] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:39.040130  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:39.040982  1527 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 23: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:39.043372  8848 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.043769  8897 consensus_queue.cc:1243] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer f9fb126997be4ec79f8f60fcd6764b00 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:04:39.043912  8848 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.046437  8848 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.048774  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.050146  8830 raft_consensus.cc:3060] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:39.050549  8840 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:39.064833  8836 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.069069  8818 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:39.069223  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:39.070163  1532 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:04:39.072535  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
W20260709 13:04:39.076327  8906 log.cc:927] Time spent T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.288s	user 0.002s	sys 0.002s
I20260709 13:04:39.077581  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.079463  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:39.084605  1606 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:39.088282  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.088923  1675 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:39.088337  2210 raft_consensus.cc:2393] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in this term.
I20260709 13:04:39.081776  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 11, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:39.094430  1431 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 21, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.098603  8811 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:39.106909  8793 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.108388  8910 tablet_copy_client.cc:323] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34325
I20260709 13:04:39.111649  8871 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.112241  8871 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.115053  8871 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:39.122578  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 203562us
I20260709 13:04:39.125427  8864 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:39.128055  8848 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:39.128747  8848 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.140753  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.143551  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.154016  1527 raft_consensus.cc:3060] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:39.145711  1501 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:39.148373  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:39.168406  1608 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:04:39.168520  8562 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:39.169059  8562 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:39.169214  8793 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:39.170094  8562 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.148500  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:39.150156  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:39.173909  2210 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:39.174793  8917 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:39.175212  8917 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.175540  8917 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:39.175566  2207 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:39.175659  1534 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:04:39.152287  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:39.139277  8848 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.185261  1608 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:39.186079  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:39.186537  1498 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:39.186614  2210 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:39.186781  2207 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:39.187618  1647 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:39.189152  8826 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:39.189544  8826 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.189914  8826 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:39.199977  8917 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.201483  1527 raft_consensus.cc:1275] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:39.201395  8826 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.204396  2207 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:39.209794  8890 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:39.210335  8890 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:39.211206  8890 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.142452  8884 raft_consensus.cc:515] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.218415  1545 tablet_copy_service.cc:140] P 36f53e9bfce749bbba4a4b34829f563d: Received BeginTabletCopySession request for tablet cbe9105bf6ce4e118b6b4a3135515534 from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:37256)
I20260709 13:04:39.219050  1545 tablet_copy_service.cc:161] P 36f53e9bfce749bbba4a4b34829f563d: Beginning new tablet copy session on tablet cbe9105bf6ce4e118b6b4a3135515534 from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:37256: session id = e3ab72f324d545a6b4ecb1025df1f7c0-cbe9105bf6ce4e118b6b4a3135515534
I20260709 13:04:39.226905  2176 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:39.236465  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32221e86161141d39327e18efdbbb226" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.241498  2206 raft_consensus.cc:2368] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:04:39.244632  1499 leader_election.cc:400] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 18 election: Vote denied by peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631) with higher term. Message: Invalid argument: T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19.
I20260709 13:04:39.250156  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:39.250931  1679 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:39.262512  8740 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:39.269359  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552871638635413bbd17d508b2a95e03" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.272274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:39.275372  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.273682  8868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34384 (request call id 9) took 1700 ms. Trace:
I20260709 13:04:39.276222  8868 rpcz_store.cc:276] 0709 13:04:37.573369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.665563 (+ 92194us) service_pool.cc:224] Handling call
0709 13:04:37.739767 (+ 74204us) log.cc:844] Serialized 506 byte log entry
0709 13:04:39.273591 (+1533824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139566,"raft.queue_time_us":79178,"raft.run_cpu_time_us":5339,"raft.run_wall_time_us":101893,"thread_start_us":49464,"threads_started":1,"wal-append.queue_time_us":140774,"wal-append.run_cpu_time_us":2435,"wal-append.run_wall_time_us":1015751}
I20260709 13:04:39.264117  1574 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:39.289609  1501 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.263444  8884 leader_election.cc:290] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.290638  1679 raft_consensus.cc:2468] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 19.
I20260709 13:04:39.292290  2178 leader_election.cc:304] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:39.299455  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.300308  1610 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:39.305054  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.305841  1604 raft_consensus.cc:2368] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:04:39.307088  8859 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:39.303606  8815 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:39.318396  8846 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:39.319633  8846 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:39.328402  8846 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.303550  8805 raft_consensus.cc:2804] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:39.329589  8805 raft_consensus.cc:697] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:39.330585  8805 consensus_queue.cc:237] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.317911  1545 tablet_copy_source_session.cc:215] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:39.336439  1528 raft_consensus.cc:2468] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 15.
I20260709 13:04:39.335484  1501 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.347764   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:39.348567  1501 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.349448  1532 raft_consensus.cc:1275] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:39.349692  1501 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.354456  8902 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:04:39.347733  8852 consensus_queue.cc:1048] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:04:39.357161  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:39.357736  1678 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:04:39.360193  8787 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:39.360792  8849 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:39.361210  8787 raft_consensus.cc:2749] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:39.362089  8787 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.362651  8787 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.378727  1678 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:39.383945  1576 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:39.407181  2210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:39.408135  2210 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:39.427505  2210 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
W20260709 13:04:39.433759  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 141223us
I20260709 13:04:39.413724  8800 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:39.407797  8917 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:39.439270  8811 tablet_bootstrap.cc:700] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent opening tablet: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:04:39.439845  8826 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:39.470280  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:39.470788  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f31cf514617428594649c1ecf3b2547" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:39.480468  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.477926  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:39.466075  8800 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:39.494488  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11658e0328124c609f964e633d7649bf"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:39.494823  1647 leader_election.cc:400] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:04:39.495234  1647 leader_election.cc:403] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.495323  1675 raft_consensus.cc:606] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:39.488049  2207 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:39.505074  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe9105bf6ce4e118b6b4a3135515534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.493884  8891 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:39.512883  1528 raft_consensus.cc:1240] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:04:39.502187  8787 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.508728  8749 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 21. Current term is 22.
I20260709 13:04:39.510025  8891 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:39.533347  8891 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:39.523756  8800 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.577243  2207 raft_consensus.cc:2468] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
W20260709 13:04:39.578367  8927 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.239s	user 0.004s	sys 0.000s
I20260709 13:04:39.578845  1648 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.580307  8865 raft_consensus.cc:2804] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:39.580998  8865 raft_consensus.cc:697] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:04:39.581535  8934 log.cc:927] Time spent T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:04:39.582098  8865 consensus_queue.cc:237] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:39.596880  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 185422us
I20260709 13:04:39.601238  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace772102403442daf5f360432c323e9" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.622979  8871 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.627604  8871 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.629896  8871 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.649149  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:39.650107  1606 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:39.651858  1607 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:04:39.653573  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:39.654500  8745 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:39.655041  8745 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.655491  8745 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:39.664422  8787 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:39.673127  8916 raft_consensus.cc:3055] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:39.700299  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:39.700978  1535 raft_consensus.cc:606] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:39.690752  8916 raft_consensus.cc:740] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:39.673056  8745 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.702863  8916 consensus_queue.cc:260] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.705482  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:39.708513  8918 consensus_queue.cc:1059] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:39.710845  8859 consensus_queue.cc:1048] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:39.714038  1535 raft_consensus.cc:606] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Received request to transfer leadership to TS e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:39.719918  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:39.720669  1535 raft_consensus.cc:606] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 LEADER]: Received request to transfer leadership to TS f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.735677  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41286 (request call id 443) took 1046 ms. Trace:
I20260709 13:04:39.736429  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:39.737161  1607 raft_consensus.cc:606] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:39.737582  1607 raft_consensus.cc:614] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:39.736223  8910 rpcz_store.cc:276] 0709 13:04:38.689406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.719103 (+ 29697us) service_pool.cc:224] Handling call
0709 13:04:38.993282 (+274179us) ts_tablet_manager.cc:934] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325)
0709 13:04:39.444136 (+450854us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:39.667315 (+223179us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:39.667439 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:39.734659 (+ 67220us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:39.735056 (+   397us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:39.735496 (+   440us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:39.735582 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":342,"tablet-copy.queue_time_us":190193,"thread_start_us":258853,"threads_started":2}
I20260709 13:04:39.740808  8910 tablet_copy_client.cc:806] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:39.740942  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:39.741533  8910 tablet_copy_client.cc:670] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:39.741595  1534 raft_consensus.cc:606] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:39.743022   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:39.744820   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:39.747144  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:39.754771  1607 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:39.774490  1501 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:39.779167  8916 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:39.755928  8840 log.cc:927] Time spent T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:04:39.785271  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:39.785626  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:39.786536  8745 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.820349  8815 raft_consensus.cc:993] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:39.829695  8890 raft_consensus.cc:993] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:39.783743  8757 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:39.808569  8891 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.842633  8830 raft_consensus.cc:993] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
W20260709 13:04:39.846000  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 532c559048cc4785a9da4b7d8725f768: Remote error: Service unavailable: leader transfer in progress
I20260709 13:04:39.877427  1528 raft_consensus.cc:3055] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:39.877897  1528 raft_consensus.cc:740] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:39.851367  2207 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:04:39.854682  8627 raft_consensus.cc:993] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:39.858943  2208 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:39.869825  1678 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:39.873234  1683 raft_consensus.cc:1240] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:39.881608  8890 raft_consensus.cc:1081] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:39.896459  1607 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:39.878644  1528 consensus_queue.cc:260] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.904071  1682 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:39.888494  8627 raft_consensus.cc:1081] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:39.902402  8745 raft_consensus.cc:1081] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:39.897961  8918 consensus_queue.cc:1059] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 13:04:39.917196  8918 consensus_queue.cc:1243] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Peer 8c6031790cc44edfba5c3964e6f27c6e log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:04:39.917858  8918 raft_consensus.cc:3055] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:39.918274  8918 raft_consensus.cc:740] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:39.919164  8757 consensus_queue.cc:1059] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:39.927479  8891 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:39.928462  1527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11658e0328124c609f964e633d7649bf"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:39.928903  8910 tablet_copy_client.cc:538] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:39.929071  1527 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.929551  1527 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:39.932399  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:39.933291  1535 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24.
I20260709 13:04:39.935179  1648 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24.
I20260709 13:04:39.935527  1648 leader_election.cc:403] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.938215  1498 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:39.889102  8849 raft_consensus.cc:1081] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 LEADER]: Signalling peer f9fb126997be4ec79f8f60fcd6764b00 to start an election
I20260709 13:04:39.940492  8861 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:39.941098  8861 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:39.942025  8861 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.939560  1682 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 24.
I20260709 13:04:39.943990  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:39.944820  1606 raft_consensus.cc:2368] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24.
I20260709 13:04:39.944871  1608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
 from {username='slave'} at 127.0.0.1:35640
I20260709 13:04:39.945506  1608 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:39.945853  1608 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:39.948148  1647 leader_election.cc:400] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Vote denied by peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24.
I20260709 13:04:39.955955  2212 raft_consensus.cc:1240] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Rejecting Update request from peer f9fb126997be4ec79f8f60fcd6764b00 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:39.958729  8918 consensus_queue.cc:260] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:39.960003  8918 raft_consensus.cc:3060] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:39.960569  1608 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:39.963346  1608 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:39.902066  8830 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:04:39.968991  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:39.969859  1535 raft_consensus.cc:3055] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:04:39.970263  1535 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:39.974628  1528 raft_consensus.cc:3060] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:39.948256  8894 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325) with higher term. Message: Invalid argument: T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e for earlier term 23. Current term is 24.
I20260709 13:04:40.038594  1606 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:04:40.039358  1606 pending_rounds.cc:85] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting all ops after (but not including) 17
I20260709 13:04:39.986624  1527 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.009789  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1665355552db4e4e97ba80c516768367"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:40.042405  1682 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.042822  1682 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:40.012323  1676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39172
I20260709 13:04:40.046056  1676 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.046445  1676 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:40.012933  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:40.047348  1683 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:40.020629  1681 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:40.023190  2207 raft_consensus.cc:1275] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:40.026533  1675 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:39.994032  1535 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.039640  1606 pending_rounds.cc:107] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:04:40.050649  1606 raft_consensus.cc:2889] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.051573  1528 raft_consensus.cc:1275] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:04:40.052054  1528 pending_rounds.cc:85] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting all ops after (but not including) 12
I20260709 13:04:40.050874  1682 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.054222  1535 raft_consensus.cc:3060] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:04:40.056773  8912 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:40.063608  1683 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 28.
I20260709 13:04:40.052493  1528 pending_rounds.cc:107] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:04:40.066781  1528 raft_consensus.cc:2889] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.067553  1576 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:40.070109  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:40.070719  1606 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:40.071877  1527 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:40.072731  1535 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 28.
I20260709 13:04:40.073189  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:40.073871  1681 raft_consensus.cc:3055] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:40.074146  1681 raft_consensus.cc:740] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:40.071731  8858 raft_consensus.cc:2804] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:04:40.074977  1681 consensus_queue.cc:260] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.052446  8916 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:04:40.075403  8858 raft_consensus.cc:697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:40.074165  8910 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:40.088085  1681 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:40.053625  8627 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:04:40.095786  1606 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:40.100240  1498 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:40.108894  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:40.080720  8740 consensus_queue.cc:1048] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:04:40.101106  8754 consensus_queue.cc:1048] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:04:40.108343  8871 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:40.117489  1676 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.135109  1527 raft_consensus.cc:3055] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:40.135538  1527 raft_consensus.cc:740] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:40.136276  1527 consensus_queue.cc:260] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.141018  1679 raft_consensus.cc:1240] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Rejecting Update request from peer 36f53e9bfce749bbba4a4b34829f563d for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:40.142526  8871 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:40.143477  8871 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.144366  1682 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:40.146107  1527 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:40.148303  8793 consensus_queue.cc:1059] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:40.149232  8892 raft_consensus.cc:3055] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:40.149606  8892 raft_consensus.cc:740] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:40.150326  8892 consensus_queue.cc:260] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.150812  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:40.151353  1608 raft_consensus.cc:3060] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:40.151515  8892 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:40.156019  8840 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:40.157071  8840 tablet_bootstrap.cc:492] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:40.157816  8840 ts_tablet_manager.cc:1403] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.108s	user 0.061s	sys 0.022s
I20260709 13:04:40.130643  8858 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.168429  1429 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 19 to 20, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:40.177913  1527 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:40.179461  1648 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:40.182560  8627 raft_consensus.cc:2804] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:40.183087  8627 raft_consensus.cc:697] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:40.158232  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 299) took 1535 ms. Trace:
I20260709 13:04:40.184139  8627 consensus_queue.cc:237] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.184194  1431 rpcz_store.cc:276] 0709 13:04:38.622723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.622934 (+   211us) service_pool.cc:224] Handling call
0709 13:04:39.077247 (+454313us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:04:40.158166 (+1080919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:39.296737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:39.461170 (+164433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:39.465637 (+  4467us) write_op.cc:435] Acquired schema lock
0709 13:04:39.468665 (+  3028us) tablet.cc:662] Decoding operations
0709 13:04:39.511098 (+ 42433us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:39.515010 (+  3912us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:39.515836 (+   826us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:39.543930 (+ 28094us) tablet.cc:701] Row locks acquired
0709 13:04:39.545345 (+  1415us) write_op.cc:260] PREPARE: finished
0709 13:04:39.555270 (+  9925us) write_op.cc:270] Start()
0709 13:04:39.555398 (+   128us) write_op.cc:276] Timestamp: P: 1783602279555204 usec, L: 0
0709 13:04:39.555429 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:04:39.556129 (+   700us) log.cc:844] Serialized 983 byte log entry
0709 13:04:39.730967 (+174838us) op_driver.cc:464] REPLICATION: finished
0709 13:04:39.760837 (+ 29870us) write_op.cc:301] APPLY: starting
0709 13:04:39.760915 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:40.061929 (+301014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:40.062040 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:40.134587 (+ 72547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:40.152426 (+ 17839us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:40.152478 (+    52us) write_op.cc:312] APPLY: finished
0709 13:04:40.152784 (+   306us) log.cc:844] Serialized 33 byte log entry
0709 13:04:40.152960 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.153057 (+    97us) write_op.cc:454] Released schema lock
0709 13:04:40.153096 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:40.153494 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:40.153528 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":562370304,"child_traces":[["op",{"apply.queue_time_us":29592,"apply.run_cpu_time_us":13922,"apply.run_wall_time_us":392602,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":182137,"prepare.run_cpu_time_us":4784,"prepare.run_wall_time_us":259726,"replication_time_us":175368,"spinlock_wait_cycles":17280,"thread_start_us":188741,"threads_started":2}]]}
I20260709 13:04:40.165514  1681 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 23.
I20260709 13:04:40.179570  1429 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 24 to 25, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 25 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.194710  1429 catalog_manager.cc:5697] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 23 to 24, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:40.202913  1608 raft_consensus.cc:2468] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:40.204631  1676 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:40.215627  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:40.220662  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:40.221560  1606 raft_consensus.cc:3060] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:40.245253  1527 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:40.246434  1648 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:40.256892  1606 raft_consensus.cc:2468] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:40.228181  2207 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:40.281798  8778 raft_consensus.cc:2804] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:40.317148  8780 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:40.333792  8946 raft_consensus.cc:993] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:40.334349  8946 raft_consensus.cc:1081] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Signalling peer e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
W20260709 13:04:40.367422  8811 log.cc:927] Time spent T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:04:40.408255  2210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef"
dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:04:40.408881  2210 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.409255  2210 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:40.367662  8778 raft_consensus.cc:697] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:40.429920  2210 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:40.462894  2210 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:40.471616  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:40.472440  1528 raft_consensus.cc:3055] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:40.472841  1528 raft_consensus.cc:740] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:40.486829  1528 consensus_queue.cc:260] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:40.494388  1528 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:40.515321  1607 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:04:40.517782  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 107200us
I20260709 13:04:40.517912  1528 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
I20260709 13:04:40.519243  2176 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:40.534782  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:40.535432  1602 raft_consensus.cc:3060] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:40.536257  8952 raft_consensus.cc:2804] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:40.569988  1676 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:04:40.571898  8954 log.cc:927] Time spent T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:04:40.594871  8955 log.cc:927] Time spent T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:04:40.520643  8757 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:04:40.588445  8952 raft_consensus.cc:697] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:40.598734  8952 consensus_queue.cc:237] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:40.515026  8778 consensus_queue.cc:237] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.627048  1602 raft_consensus.cc:2468] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
W20260709 13:04:40.628527  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 248242us
W20260709 13:04:40.628743  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 221262us
I20260709 13:04:40.649627  1602 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:04:40.608204  8959 log.cc:927] Time spent T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.346s	user 0.004s	sys 0.000s
W20260709 13:04:40.667832  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 225573us
I20260709 13:04:40.646658  8946 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:04:40.565172  8840 raft_consensus.cc:359] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:40.702535  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 146187us
I20260709 13:04:40.711997  1604 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:04:40.703671  8840 raft_consensus.cc:740] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:40.668804  8892 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:04:40.740358  8840 consensus_queue.cc:260] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:40.751405  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 95277.1us
I20260709 13:04:40.760676   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.784473  8840 ts_tablet_manager.cc:1434] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.626s	user 0.015s	sys 0.000s
W20260709 13:04:40.831763  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 81494.6us
I20260709 13:04:40.845155  1527 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260709 13:04:40.786084  8840 ts_tablet_manager.cc:1467] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Tablet startup took 627ms
I20260709 13:04:40.873075  8662 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:40.903512  8976 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:40.917714  8976 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:40.930423  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:40.931197  1605 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:40.931226  8866 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:04:40.862665  8840 ts_tablet_manager.cc:1469] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Trace:
0709 13:04:37.487343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.487529 (+   186us) service_pool.cc:224] Handling call
0709 13:04:37.641435 (+153906us) ts_tablet_manager.cc:934] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
0709 13:04:38.054282 (+412847us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4c00108240. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4696345a20 00007f4696356a29 00007f469635713f 00007f469631b2ab 00007f4696348f3c 00007f4696349461 00007f4696349768 00007f469c0cf2eb 00007f469cff4d3b 00007f469cfef008 00007f469cfee405
0709 13:04:38.186574 (+132292us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:04:38.677511 (+490937us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:38.677638 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:04:38.984926 (+307288us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:04:38.985203 (+   277us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:38.994563 (+  9360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:04:38.994764 (+   201us) inbound_call.cc:177] Queueing success response
0709 13:04:39.050087 (+ 55323us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:04:40.158145 (+1108058us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:04:40.267573 (+109428us) tablet_replica.cc:261] Starting instrumentation
0709 13:04:40.268390 (+   817us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":283,"mutex_wait_us":19450,"raft.queue_time_us":21064,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":31307,"spinlock_wait_cycles":7748992,"tablet-copy.queue_time_us":144313,"tablet-download-pool.queue_time_us":145,"tablet-download-pool.run_cpu_time_us":1406,"tablet-download-pool.run_wall_time_us":35883,"thread_start_us":214745,"threads_started":2}
I20260709 13:04:40.959157  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c4443c0ffc3140788a1384ff8bc1b047 received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:40.959690  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-c4443c0ffc3140788a1384ff8bc1b047 on tablet c4443c0ffc3140788a1384ff8bc1b047 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:40.919909  8976 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:40.967712  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:40.969439  8980 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:40.969900  8980 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:40.970350  8980 raft_consensus.cc:3060] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:40.986532  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 192358us
I20260709 13:04:41.004184  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d" is_pre_election: true
I20260709 13:04:41.005046  1532 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:41.014736  1677 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:04:41.066522  8811 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.067617  8811 tablet_bootstrap.cc:492] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:41.072363  8811 ts_tablet_manager.cc:1403] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.974s	user 0.078s	sys 0.074s
I20260709 13:04:41.075182  1605 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:41.082576  1605 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:41.082700  8980 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:41.088563  1527 raft_consensus.cc:1275] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:04:41.084252  8805 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:04:41.096478  8976 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:41.098997  8987 consensus_queue.cc:1048] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:41.111315  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 278) took 2435 ms. Trace:
I20260709 13:04:41.121191  8980 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:41.113070  1431 catalog_manager.cc:5697] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 21, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:41.123816  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:41.128298  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:41.122624  1431 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 21, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:41.137518  1535 raft_consensus.cc:2393] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 22: Already voted for candidate 36f53e9bfce749bbba4a4b34829f563d in this term.
I20260709 13:04:41.138461  1431 catalog_manager.cc:5697] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 17 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:41.139978  1431 catalog_manager.cc:5697] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 14 to 15, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:41.142871  1604 raft_consensus.cc:2468] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:41.142563  1431 catalog_manager.cc:5697] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 17 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:41.147013  1647 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:41.148066  8979 raft_consensus.cc:2804] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:41.148567  8979 raft_consensus.cc:697] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:41.149084  1679 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:04:41.149348  8979 consensus_queue.cc:237] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:41.180249  1431 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:41.182451  1431 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 27 to 28, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 28 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.111763  1429 rpcz_store.cc:276] 0709 13:04:38.675771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.675926 (+   155us) service_pool.cc:224] Handling call
0709 13:04:38.903353 (+227427us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540006dbd4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:04:41.111222 (+2207869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:40.501399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:40.578234 (+ 76835us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:40.578280 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:04:40.578304 (+    24us) tablet.cc:662] Decoding operations
0709 13:04:40.578884 (+   580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:40.578967 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:40.578998 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:40.579346 (+   348us) tablet.cc:701] Row locks acquired
0709 13:04:40.579366 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:40.579547 (+   181us) write_op.cc:270] Start()
0709 13:04:40.579669 (+   122us) write_op.cc:276] Timestamp: P: 1783602280579491 usec, L: 0
0709 13:04:40.579695 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:40.580438 (+   743us) log.cc:844] Serialized 1312 byte log entry
0709 13:04:40.829085 (+248647us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.062048 (+232963us) write_op.cc:301] APPLY: starting
0709 13:04:41.062134 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.098466 (+ 36332us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.098552 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.100732 (+  2180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.100927 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:04:41.100975 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:41.101174 (+   199us) log.cc:844] Serialized 41 byte log entry
0709 13:04:41.101346 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.101444 (+    98us) write_op.cc:454] Released schema lock
0709 13:04:41.101481 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:41.101845 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.101888 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":440060800,"child_traces":[["op",{"apply.queue_time_us":232711,"apply.run_cpu_time_us":5984,"apply.run_wall_time_us":39767,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":237321,"prepare.run_cpu_time_us":3525,"prepare.run_wall_time_us":79386,"replication_time_us":249220,"thread_start_us":394263,"threads_started":2}]]}
I20260709 13:04:41.187774  1431 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.189630  1431 catalog_manager.cc:5697] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 21 to 23, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:41.195498  1527 raft_consensus.cc:1275] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:41.198619  1431 catalog_manager.cc:5697] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 23 to 24, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:41.200925  1431 catalog_manager.cc:5697] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 17 to 18, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:41.210498  1431 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:41.218655  8662 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:41.225327  2207 raft_consensus.cc:1217] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:04:41.209358  8952 consensus_queue.cc:1048] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:04:41.236572  1535 raft_consensus.cc:1275] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:04:41.239290  8980 consensus_queue.cc:1048] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:41.180655  8811 raft_consensus.cc:359] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:41.249943  8811 raft_consensus.cc:740] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:41.250680  8811 consensus_queue.cc:260] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:41.254316  8910 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.211570  8946 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 13:04:41.266991  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 48072.9us
W20260709 13:04:41.340368  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 124063us
W20260709 13:04:41.341661  1498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 75658.1us
W20260709 13:04:41.350943  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 64539us
I20260709 13:04:41.385843  8811 ts_tablet_manager.cc:1434] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.313s	user 0.005s	sys 0.004s
I20260709 13:04:41.424000  2206 raft_consensus.cc:1217] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.15->[26.16-26.16]   Dedup: 26.16->[]
I20260709 13:04:41.417435  8910 tablet_bootstrap.cc:492] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
W20260709 13:04:41.469197  8994 log.cc:927] Time spent T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: Append to log took a long time: real 0.092s	user 0.002s	sys 0.002s
I20260709 13:04:41.475898  8910 ts_tablet_manager.cc:1403] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.402s	user 0.060s	sys 0.024s
I20260709 13:04:41.503644  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1d5174ec6bd2452abb5d7617555ce4f7 received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:41.504251  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-1d5174ec6bd2452abb5d7617555ce4f7 on tablet 1d5174ec6bd2452abb5d7617555ce4f7 with peer e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:41.539633  1499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 169447us
I20260709 13:04:41.588810  8910 raft_consensus.cc:359] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:41.589799  8910 raft_consensus.cc:740] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:41.590538  8910 consensus_queue.cc:260] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:41.593674  8910 ts_tablet_manager.cc:1434] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 13:04:41.644609  1545 tablet_copy_service.cc:342] P 36f53e9bfce749bbba4a4b34829f563d: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-cbe9105bf6ce4e118b6b4a3135515534 received from {username='slave'} at 127.0.0.1:37256
I20260709 13:04:41.645094  1545 tablet_copy_service.cc:434] P 36f53e9bfce749bbba4a4b34829f563d: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-cbe9105bf6ce4e118b6b4a3135515534 on tablet cbe9105bf6ce4e118b6b4a3135515534 with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:41.664798  1535 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:41.685122  8627 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:41.702853  1609 raft_consensus.cc:1275] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:41.714600  8979 consensus_queue.cc:1048] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:04:41.747941  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 70805.2us
I20260709 13:04:41.898777  2206 raft_consensus.cc:1217] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.16->[24.17-24.17]   Dedup: 24.17->[]
I20260709 13:04:41.995404  8864 raft_consensus.cc:1064] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:41.998294  8864 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 14, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:42.192653  2207 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:04:42.205304  8864 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:04:42.242616  1527 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:04:42.248284  9003 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:42.273912  1679 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:04:42.275318  8818 raft_consensus.cc:1064] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
W20260709 13:04:42.278012  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 58967.7us
I20260709 13:04:42.278964  8818 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:42.292137  8985 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:42.189721   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.304982  1431 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38912 (request call id 300) took 1743 ms. Trace:
I20260709 13:04:42.388917  8830 raft_consensus.cc:1064] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:42.396426  8830 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:42.411363  9003 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:42.415956  1647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 195244us
I20260709 13:04:42.421969  1683 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.426469  2207 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:04:42.429318  2211 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:42.428068  8815 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:42.436522  8987 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:42.436772  1535 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:42.453778  1677 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:04:42.454351  1604 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:04:42.455947  1608 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:42.455760  8830 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:42.466988  8815 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:42.314121  1431 rpcz_store.cc:276] 0709 13:04:40.562097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.572253 (+ 10156us) service_pool.cc:224] Handling call
0709 13:04:42.304901 (+1732648us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:41.522151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:41.590360 (+ 68209us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:41.590397 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:04:41.590414 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:41.591489 (+  1075us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:41.591547 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:41.591574 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:41.592659 (+  1085us) tablet.cc:701] Row locks acquired
0709 13:04:41.592679 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:41.592826 (+   147us) write_op.cc:270] Start()
0709 13:04:41.592940 (+   114us) write_op.cc:276] Timestamp: P: 1783602281592780 usec, L: 0
0709 13:04:41.592965 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:04:41.593672 (+   707us) log.cc:844] Serialized 4839 byte log entry
0709 13:04:41.698657 (+104985us) op_driver.cc:464] REPLICATION: finished
0709 13:04:41.845242 (+146585us) write_op.cc:301] APPLY: starting
0709 13:04:41.845331 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:41.995710 (+150379us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:41.995807 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:42.037778 (+ 41971us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:42.038130 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:04:42.038194 (+    64us) write_op.cc:312] APPLY: finished
0709 13:04:42.038648 (+   454us) log.cc:844] Serialized 113 byte log entry
0709 13:04:42.038892 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.039093 (+   201us) write_op.cc:454] Released schema lock
0709 13:04:42.052522 (+ 13429us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:42.083650 (+ 31128us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.088011 (+  4361us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18285,"reported_tablets":17,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":146306,"apply.run_cpu_time_us":18443,"apply.run_wall_time_us":235428,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":174068,"prepare.run_cpu_time_us":4621,"prepare.run_wall_time_us":77001,"replication_time_us":105484,"thread_start_us":253230,"threads_started":2}]]}
I20260709 13:04:42.484804  8987 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:04:42.492641  2206 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.544680  1432 catalog_manager.cc:5697] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 14 to 15, leader changed from e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 15 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.580761  8815 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.574474  8976 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:04:42.588763  1604 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.591692  1534 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:42.677652  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 99593.4us
I20260709 13:04:42.739121  8976 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.745632  1679 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.748822  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b6b1fc817984924ac96a7a2a29d76de"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:42.749509  1683 raft_consensus.cc:606] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Received request to transfer leadership to TS e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:42.749862  1683 raft_consensus.cc:614] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:42.757200  1535 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.761387  2206 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.774008  1608 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.786990  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cee4cb45f7c44278850093451991c78"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:42.787766  1683 raft_consensus.cc:606] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:42.792335  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702"
dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
mode: GRACEFUL
new_leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:04:42.792934  1609 raft_consensus.cc:606] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Received request to transfer leadership to TS 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:42.798345  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
mode: GRACEFUL
new_leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:04:42.799193  1534 raft_consensus.cc:606] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Received request to transfer leadership to TS e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:42.803371  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
mode: GRACEFUL
new_leader_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:04:42.804096  1677 raft_consensus.cc:606] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Received request to transfer leadership to TS 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:42.805408   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:42.807337   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:42.857177  8917 raft_consensus.cc:993] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: : Instructing follower 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:42.857739  8917 raft_consensus.cc:1081] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Signalling peer 8c6031790cc44edfba5c3964e6f27c6e to start an election
I20260709 13:04:42.863081  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702"
dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
 from {username='slave'} at 127.0.0.1:39174
I20260709 13:04:42.863690  1677 raft_consensus.cc:493] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.864161  1677 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:42.870203  2206 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:42.874735  1677 raft_consensus.cc:515] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:42.883095  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:42.883805  1535 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:42.890763  1535 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:42.892895  1648 leader_election.cc:304] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:42.893769  8980 raft_consensus.cc:2804] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:42.894274  8980 raft_consensus.cc:697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:42.895078  8980 consensus_queue.cc:237] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:42.891681  1677 leader_election.cc:290] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:42.902684  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b748cae74bbb4bdc9765bc293b0b6702" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:42.903362  1608 raft_consensus.cc:3055] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:42.903640  1608 raft_consensus.cc:740] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:42.904412  1608 consensus_queue.cc:260] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:42.905630  1608 raft_consensus.cc:3060] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:42.919838  1608 raft_consensus.cc:2468] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:42.942868  8987 raft_consensus.cc:993] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:42.943379  8987 raft_consensus.cc:1081] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:42.945266  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:42.945829  1534 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.946149  1534 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:42.965581  1534 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:42.970140  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:42.970883  1608 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:42.972949  1534 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 26 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:42.978689  1429 catalog_manager.cc:5697] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 21, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 21 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:42.980346  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:42.980952  1677 raft_consensus.cc:3055] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:04:42.981261  1677 raft_consensus.cc:740] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:42.999154  1677 consensus_queue.cc:260] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:43.000962  9031 raft_consensus.cc:993] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: : Instructing follower e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:43.001657  8897 raft_consensus.cc:1081] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Signalling peer e3ab72f324d545a6b4ecb1025df1f7c0 to start an election
I20260709 13:04:43.003486  1429 catalog_manager.cc:5697] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 17 to 19, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.005723  2211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5"
dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:04:43.005645  1429 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 24, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.006392  2211 raft_consensus.cc:493] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.006857  2211 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:43.001699  1677 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:43.010174  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57670 (request call id 162) took 3877 ms. Trace:
I20260709 13:04:43.010653  1430 rpcz_store.cc:276] 0709 13:04:39.132504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.132636 (+   132us) service_pool.cc:224] Handling call
0709 13:04:43.010109 (+3877473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5893,"reported_tablets":4}
I20260709 13:04:43.016345  1677 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 26.
I20260709 13:04:43.017719  1501 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e; no voters: 
I20260709 13:04:43.018570  9031 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:43.019038  9031 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 26 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:43.019856  9031 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:43.021559  1432 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38920 (request call id 266) took 3726 ms. Trace:
I20260709 13:04:43.032547  1429 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 22 to 23, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 23 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.034225  2211 raft_consensus.cc:515] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.021950  1432 rpcz_store.cc:276] 0709 13:04:39.295396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.302916 (+  7520us) service_pool.cc:224] Handling call
0709 13:04:43.021503 (+3718587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:42.680365 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:42.693546 (+ 13181us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:42.693613 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:04:42.693643 (+    30us) tablet.cc:662] Decoding operations
0709 13:04:42.694106 (+   463us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:42.694185 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:42.694233 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:42.694483 (+   250us) tablet.cc:701] Row locks acquired
0709 13:04:42.694511 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:04:42.694701 (+   190us) write_op.cc:270] Start()
0709 13:04:42.694861 (+   160us) write_op.cc:276] Timestamp: P: 1783602282694637 usec, L: 0
0709 13:04:42.694896 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:04:42.695845 (+   949us) log.cc:844] Serialized 536 byte log entry
0709 13:04:42.856811 (+160966us) op_driver.cc:464] REPLICATION: finished
0709 13:04:42.879273 (+ 22462us) write_op.cc:301] APPLY: starting
0709 13:04:42.879371 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:42.948563 (+ 69192us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:42.948660 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:42.949347 (+   687us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:42.949502 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:42.949545 (+    43us) write_op.cc:312] APPLY: finished
0709 13:04:42.949719 (+   174us) log.cc:844] Serialized 25 byte log entry
0709 13:04:42.949902 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.949982 (+    80us) write_op.cc:454] Released schema lock
0709 13:04:42.950018 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:42.950391 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:42.950419 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":22217,"apply.run_cpu_time_us":3381,"apply.run_wall_time_us":71096,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":116947,"prepare.run_cpu_time_us":3755,"prepare.run_wall_time_us":52046,"replication_time_us":161777,"thread_start_us":156279,"threads_started":2}]]}
I20260709 13:04:43.036897  8754 raft_consensus.cc:993] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: : Instructing follower 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:43.037400  8754 raft_consensus.cc:1081] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Signalling peer 36f53e9bfce749bbba4a4b34829f563d to start an election
I20260709 13:04:43.044723  1534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cee4cb45f7c44278850093451991c78"
dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
 from {username='slave'} at 127.0.0.1:57254
I20260709 13:04:43.045400  1534 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.047536  1534 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:43.054757  1608 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 26.
I20260709 13:04:43.055477  1609 raft_consensus.cc:1240] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Rejecting Update request from peer 8c6031790cc44edfba5c3964e6f27c6e for earlier term 25. Current term is 26. Ops: []
I20260709 13:04:43.072157  2211 leader_election.cc:290] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:43.073102  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:43.073673  1677 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:43.080988  1677 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
I20260709 13:04:43.082221  2178 leader_election.cc:304] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:43.083067  8998 raft_consensus.cc:2804] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:43.083603  8998 raft_consensus.cc:697] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:43.085719  8998 consensus_queue.cc:237] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.089531  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb1b18d08269419485367169ac7d79c5" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "36f53e9bfce749bbba4a4b34829f563d"
I20260709 13:04:43.094720  1535 raft_consensus.cc:3055] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:43.095151  1535 raft_consensus.cc:740] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:43.106571  1431 catalog_manager.cc:5697] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 21 to 22, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:43.108295  1431 catalog_manager.cc:5697] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 16 to 17, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.110760  1535 consensus_queue.cc:260] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.109863  1431 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 16 to 17, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.124365  1431 catalog_manager.cc:5697] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 19 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 20 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } }
I20260709 13:04:43.126601  1535 raft_consensus.cc:3060] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:43.139914  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38910 (request call id 279) took 1743 ms. Trace:
I20260709 13:04:43.140573  1534 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:43.148044  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:43.148686  1609 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:43.157419  1535 raft_consensus.cc:2468] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
I20260709 13:04:43.160432  1534 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:43.161355  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "36f53e9bfce749bbba4a4b34829f563d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:43.162221  1676 raft_consensus.cc:3055] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:43.162509  1676 raft_consensus.cc:740] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:43.163218  1676 consensus_queue.cc:260] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:43.164355  1676 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:43.165635  1609 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:43.141878  1429 rpcz_store.cc:276] 0709 13:04:41.396469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.396621 (+   152us) service_pool.cc:224] Handling call
0709 13:04:43.099156 (+1702535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.099185 (+    29us) write_op.cc:454] Released schema lock
0709 13:04:43.139852 (+ 40667us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:43.040291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:43.040810 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:43.040845 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:43.040863 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:43.041465 (+   602us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:43.041523 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:43.041554 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:04:43.042017 (+   463us) tablet.cc:701] Row locks acquired
0709 13:04:43.042037 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:43.042200 (+   163us) write_op.cc:270] Start()
0709 13:04:43.042328 (+   128us) write_op.cc:276] Timestamp: P: 1783602283042147 usec, L: 0
0709 13:04:43.042353 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:04:43.043060 (+   707us) log.cc:844] Serialized 1701 byte log entry
0709 13:04:43.052269 (+  9209us) op_driver.cc:464] REPLICATION: finished
0709 13:04:43.052706 (+   437us) write_op.cc:301] APPLY: starting
0709 13:04:43.052776 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:43.055211 (+  2435us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:43.055294 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:43.057719 (+  2425us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:43.057883 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:04:43.057938 (+    55us) write_op.cc:312] APPLY: finished
0709 13:04:43.058159 (+   221us) log.cc:844] Serialized 49 byte log entry
0709 13:04:43.058909 (+   750us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:43.059026 (+   117us) write_op.cc:454] Released schema lock
0709 13:04:43.059067 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":354,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":6058,"apply.run_wall_time_us":6639,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":4195,"prepare.run_cpu_time_us":3029,"prepare.run_wall_time_us":3030,"replication_time_us":9624}]]}
I20260709 13:04:43.175359  1676 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36f53e9bfce749bbba4a4b34829f563d in term 21.
I20260709 13:04:43.167058  1498 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:43.180924  8815 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:43.181463  8815 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Becoming Leader. State: Replica: 36f53e9bfce749bbba4a4b34829f563d, State: Running, Role: LEADER
I20260709 13:04:43.182317  8815 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:43.194608  1608 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.207013  1676 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:04:43.209051  8846 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:43.211604  2211 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:04:43.212987  8846 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:43.217303  8864 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.223590  1432 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 11 to 12, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.226569  1432 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.251680  2211 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.288054  1417 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d5174ec6bd2452abb5d7617555ce4f7 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.289462  1677 raft_consensus.cc:2955] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.287570  1430 catalog_manager.cc:5697] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 21 to 22, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.298431  1532 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:43.299805  8987 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:43.323868  1429 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 17 to 18, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 26 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.330152  1429 catalog_manager.cc:5697] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 23 to 24, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.354408  1608 raft_consensus.cc:1275] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:43.356096  8980 consensus_queue.cc:1048] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:43.359233  1676 consensus_queue.cc:237] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.373162  1534 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:43.377033  2211 raft_consensus.cc:1275] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:43.378697  8987 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:43.380750  8987 consensus_queue.cc:1048] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:43.381588  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d5174ec6bd2452abb5d7617555ce4f7 with delete_type TABLET_DATA_TOMBSTONED (TS 36f53e9bfce749bbba4a4b34829f563d not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:34394
I20260709 13:04:43.396293  9016 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.398057  2211 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.406895  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4443c0ffc3140788a1384ff8bc1b047 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.411423  1534 raft_consensus.cc:2955] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.413882  9047 tablet_replica.cc:333] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:43.421442  1432 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 25 to 26, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 26 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.427181  1432 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d reported cstate change: term changed from 20 to 21, leader changed from 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) to 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193). New cstate: current_term: 21 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.463421  9047 raft_consensus.cc:2243] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.464377  9047 raft_consensus.cc:2272] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.471637  9047 ts_tablet_manager.cc:1916] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.479846  1431 catalog_manager.cc:5697] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 12 to 13, VOTER f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) evicted. New cstate: current_term: 17 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.506971  1532 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:43.511587  1535 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:04:43.514659  1599 tablet_service.cc:1558] Processing DeleteTablet for tablet c4443c0ffc3140788a1384ff8bc1b047 with delete_type TABLET_DATA_TOMBSTONED (TS f9fb126997be4ec79f8f60fcd6764b00 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36926
I20260709 13:04:43.515793  9039 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:43.523839  2211 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:43.525138  1608 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:43.525382  9031 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:04:43.527009  8897 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:04:43.538241  8815 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.540661  9049 tablet_replica.cc:333] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:43.541890  9049 raft_consensus.cc:2243] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.543242  9049 raft_consensus.cc:2272] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.550089  2206 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.560890  1604 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:04:43.562186  1609 raft_consensus.cc:2955] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.568452  1676 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:04:43.577033  9049 ts_tablet_manager.cc:1916] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.586282  9031 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:43.586431  1418 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe9105bf6ce4e118b6b4a3135515534 with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.590655  1432 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 18 to 19, VOTER 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195) evicted. New cstate: current_term: 24 leader_uuid: "36f53e9bfce749bbba4a4b34829f563d" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:43.596572  8897 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:43.614336  1667 tablet_service.cc:1558] Processing DeleteTablet for tablet cbe9105bf6ce4e118b6b4a3135515534 with delete_type TABLET_DATA_TOMBSTONED (TS 8c6031790cc44edfba5c3964e6f27c6e not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:44548
I20260709 13:04:43.650748  9047 ts_tablet_manager.cc:1929] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 26.17
I20260709 13:04:43.651268  9047 log.cc:1199] T 1d5174ec6bd2452abb5d7617555ce4f7 P 36f53e9bfce749bbba4a4b34829f563d: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-0-root/wals/1d5174ec6bd2452abb5d7617555ce4f7
I20260709 13:04:43.680747  1683 raft_consensus.cc:1275] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:04:43.684320  9052 tablet_replica.cc:333] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:43.684118  9039 consensus_queue.cc:1048] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:43.721669  9052 raft_consensus.cc:2243] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:43.732692  1501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 47988.2us
I20260709 13:04:43.733487  1418 catalog_manager.cc:5028] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): tablet 1d5174ec6bd2452abb5d7617555ce4f7 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:43.740967  9052 raft_consensus.cc:2272] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.759593  1609 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:43.761093  9055 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:43.765457  9052 ts_tablet_manager.cc:1916] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.752405  9049 ts_tablet_manager.cc:1929] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:04:43.808876   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.785123  9049 log.cc:1199] T c4443c0ffc3140788a1384ff8bc1b047 P f9fb126997be4ec79f8f60fcd6764b00: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-1-root/wals/c4443c0ffc3140788a1384ff8bc1b047
I20260709 13:04:43.821786  1417 catalog_manager.cc:5028] TS f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): tablet c4443c0ffc3140788a1384ff8bc1b047 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
I20260709 13:04:43.826757  1683 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer 36f53e9bfce749bbba4a4b34829f563d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:43.831524  9054 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:43.915746  9052 ts_tablet_manager.cc:1929] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.18
I20260709 13:04:43.920993  9052 log.cc:1199] T cbe9105bf6ce4e118b6b4a3135515534 P 8c6031790cc44edfba5c3964e6f27c6e: Deleting WAL directory at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0/minicluster-data/ts-2-root/wals/cbe9105bf6ce4e118b6b4a3135515534
I20260709 13:04:43.924242  1420 catalog_manager.cc:5028] TS 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): tablet cbe9105bf6ce4e118b6b4a3135515534 (table test-workload [id=e0ddceb182fa44498fba9f1c9bed1e86]) successfully deleted
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:04:43.947503   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:43.990552  1648 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:04:44.013814  1648 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.049516  1574 consensus_peers.cc:597] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.057796  1574 consensus_peers.cc:597] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.082033  1648 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.098459  1648 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.113312  1574 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.118145  1648 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.130921  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 45818.9us
W20260709 13:04:44.142202  2176 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.150209   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:44.151306  2176 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.156972   431 tablet_replica.cc:333] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.160789   431 raft_consensus.cc:2243] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.161626   431 raft_consensus.cc:2272] T b748cae74bbb4bdc9765bc293b0b6702 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.174602   431 tablet_replica.cc:333] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.175500   431 raft_consensus.cc:2243] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.178973  1648 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.179993   431 raft_consensus.cc:2272] T 208506ca334e4441af10e7c0e8432dbe P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.182979   431 tablet_replica.cc:333] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
W20260709 13:04:44.188674  2176 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.188728  1574 consensus_peers.cc:597] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.191054  1574 consensus_peers.cc:597] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.192070   431 raft_consensus.cc:2243] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.192785   431 raft_consensus.cc:2272] T 4fb69c6ea77a4b5680f9f2b453332415 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.195617   431 tablet_replica.cc:333] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
W20260709 13:04:44.197846  1574 consensus_peers.cc:597] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.196528   431 raft_consensus.cc:2243] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.205595  1648 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.213130  2176 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.217890  1648 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.221443   431 raft_consensus.cc:2272] T abc3085f661f457e8c8d15478c227311 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.224747   431 tablet_replica.cc:333] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
W20260709 13:04:44.242164  1648 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.244680   431 raft_consensus.cc:2243] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.246448  1574 consensus_peers.cc:597] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.267171  1648 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.270543  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.245656   431 raft_consensus.cc:2272] T bb1b18d08269419485367169ac7d79c5 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.282855   431 tablet_replica.cc:333] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.283728   431 raft_consensus.cc:2243] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.284389   431 raft_consensus.cc:2272] T 32221e86161141d39327e18efdbbb226 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.290256   431 tablet_replica.cc:333] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.291622   431 raft_consensus.cc:2243] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.292273   431 raft_consensus.cc:2272] T 4e287a2761794958b3002cd2258cf2f2 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.295044   431 tablet_replica.cc:333] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
W20260709 13:04:44.297407  1574 consensus_peers.cc:597] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.298590   431 raft_consensus.cc:2243] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.300838  1574 consensus_peers.cc:597] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.312408   431 raft_consensus.cc:2272] T d9a84223e947489c829c528c860660d1 P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.315219   431 tablet_replica.cc:333] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.316084   431 raft_consensus.cc:2243] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.317184   431 raft_consensus.cc:2272] T e7f600ce14224412994ac233d95d67d1 P 36f53e9bfce749bbba4a4b34829f563d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.326051   431 tablet_replica.cc:333] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.327087   431 raft_consensus.cc:2243] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.327958  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.339644   431 raft_consensus.cc:2272] T 891c34d92ded4b85948a508cf94b612c P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.342912   431 tablet_replica.cc:333] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.343777   431 raft_consensus.cc:2243] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.349109   431 raft_consensus.cc:2272] T 8cee4cb45f7c44278850093451991c78 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.352897   431 tablet_replica.cc:333] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.353888   431 raft_consensus.cc:2243] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.354911   431 raft_consensus.cc:2272] T bc704e97e2774b19b6d4867b31f50723 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.357867   431 tablet_replica.cc:333] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.358788   431 raft_consensus.cc:2243] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.359701   431 raft_consensus.cc:2272] T c4cbda5372a24182a9982a0d35ff91b7 P 36f53e9bfce749bbba4a4b34829f563d [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:44.367525  1648 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.384920   431 tablet_replica.cc:333] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.385826   431 raft_consensus.cc:2243] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.386523   431 raft_consensus.cc:2272] T 4b6b1fc817984924ac96a7a2a29d76de P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.399382   431 tablet_replica.cc:333] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
W20260709 13:04:44.400184  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.400308   431 raft_consensus.cc:2243] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.401678   431 raft_consensus.cc:2272] T 1d120199a9d3441ab490816cfe76664f P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.421195   431 tablet_replica.cc:333] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.422816   431 raft_consensus.cc:2243] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:44.426204  1574 consensus_peers.cc:597] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.426488   431 raft_consensus.cc:2272] T ace772102403442daf5f360432c323e9 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.430048   431 tablet_replica.cc:333] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.431131   431 raft_consensus.cc:2243] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:04:44.431965  1574 consensus_peers.cc:597] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.433310   431 raft_consensus.cc:2272] T 8501e8317ed348cca428d77d106f937c P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:44.435223  1648 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.440743  1574 consensus_peers.cc:597] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.466964  1574 consensus_peers.cc:597] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.468438  2176 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.472066   431 tablet_replica.cc:333] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.473011   431 raft_consensus.cc:2243] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.474099   431 raft_consensus.cc:2272] T 3db5c09b405c47f6a1aaa189b76a0002 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.476848   431 tablet_replica.cc:333] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.477664   431 raft_consensus.cc:2243] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.478721   431 raft_consensus.cc:2272] T 5adb51b03e1142c4b3d2fe81051fecb9 P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.493474   431 tablet_replica.cc:333] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.494282   431 raft_consensus.cc:2243] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.494997   431 raft_consensus.cc:2272] T fb93316b761941d4be4cb8d1af0db97e P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:44.519583  2176 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:44.520756  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.522439   431 tablet_replica.cc:333] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.523367   431 raft_consensus.cc:2243] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.526198   431 raft_consensus.cc:2272] T f2f5a84af4984d759b3126fa5852fb2e P 36f53e9bfce749bbba4a4b34829f563d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.541157   431 tablet_replica.cc:333] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.542003   431 raft_consensus.cc:2243] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.561035   431 raft_consensus.cc:2272] T eca33b3bd986485893d6724a68cb2430 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.565124   431 tablet_replica.cc:333] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.567713   431 raft_consensus.cc:2243] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.568924   431 raft_consensus.cc:2272] T 0246a4c90f2b48c5a3a10ad330723a67 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.571702   431 tablet_replica.cc:333] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.584379   431 raft_consensus.cc:2243] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.585139   431 raft_consensus.cc:2272] T 5ea2020c26814418b630a447fc961d07 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.588263   431 tablet_replica.cc:333] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.600926   431 raft_consensus.cc:2243] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.612845   431 raft_consensus.cc:2272] T 5df6a74dd4014d38b1b536f6b0fc66ec P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.616022   431 tablet_replica.cc:333] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.617013   431 raft_consensus.cc:2243] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.617676   431 raft_consensus.cc:2272] T 6d6c985edaa245138167af8ae5b22067 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.620527   431 tablet_replica.cc:333] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.626670   431 raft_consensus.cc:2243] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.632591   431 raft_consensus.cc:2272] T 3ba1b10b23d84716ad2e0452649e214e P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.641819   431 tablet_replica.cc:333] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.653823   431 raft_consensus.cc:2243] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.655242   431 raft_consensus.cc:2272] T 11e72d8320164ed18fc7fccba3a0ecd3 P 36f53e9bfce749bbba4a4b34829f563d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.660447   431 tablet_replica.cc:333] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.676734   431 raft_consensus.cc:2243] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.678145   431 raft_consensus.cc:2272] T 69addfec4f4248bbabd86bd0f93ae32d P 36f53e9bfce749bbba4a4b34829f563d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.681394   431 tablet_replica.cc:333] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.684791   431 raft_consensus.cc:2243] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.686072   431 raft_consensus.cc:2272] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.702996   431 tablet_replica.cc:333] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.703966   431 raft_consensus.cc:2243] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.704610   431 raft_consensus.cc:2272] T 532c559048cc4785a9da4b7d8725f768 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.714870   431 tablet_replica.cc:333] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.720100   431 raft_consensus.cc:2243] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.720863   431 raft_consensus.cc:2272] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:44.720966  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 82234.3us
I20260709 13:04:44.739250   431 tablet_replica.cc:333] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.740226   431 raft_consensus.cc:2243] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.740953   431 raft_consensus.cc:2272] T 148d93cd579345f7bda3407d430fed95 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.743885   431 tablet_replica.cc:333] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.744624   431 raft_consensus.cc:2243] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.745151   431 raft_consensus.cc:2272] T 3f5eb582ff4540bb9b59540cc56f458a P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.747653   431 tablet_replica.cc:333] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.773351   431 raft_consensus.cc:2243] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.774358   431 raft_consensus.cc:2272] T 1af5bea2a3c6428b9b6c07c96e3160ef P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.782527   431 tablet_replica.cc:333] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.783447   431 raft_consensus.cc:2243] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.784087   431 raft_consensus.cc:2272] T 5396b1c71261414f9ca554acc690f489 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.786872   431 tablet_replica.cc:333] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.792763   431 raft_consensus.cc:2243] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.793599   431 raft_consensus.cc:2272] T fbbc977cdccf4f338a0e97226117c985 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.811332   431 tablet_replica.cc:333] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.812359   431 raft_consensus.cc:2243] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.815268   431 raft_consensus.cc:2272] T cbe9105bf6ce4e118b6b4a3135515534 P 36f53e9bfce749bbba4a4b34829f563d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.818236   431 tablet_replica.cc:333] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.820197   431 raft_consensus.cc:2243] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.820802   431 raft_consensus.cc:2272] T fac0c25895864a4e8a2926c7c5198ee7 P 36f53e9bfce749bbba4a4b34829f563d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.823376   431 tablet_replica.cc:333] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.824136   431 raft_consensus.cc:2243] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.824693   431 raft_consensus.cc:2272] T 5d54062a82c94b8c93a956fc9082a450 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.835866   431 tablet_replica.cc:333] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.838351   431 raft_consensus.cc:2243] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.839190   431 raft_consensus.cc:2272] T c4443c0ffc3140788a1384ff8bc1b047 P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.849077   431 tablet_replica.cc:333] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.852955   431 raft_consensus.cc:2243] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.853595   431 raft_consensus.cc:2272] T 1665355552db4e4e97ba80c516768367 P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.864869   431 tablet_replica.cc:333] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.874732   431 raft_consensus.cc:2243] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.888563   431 raft_consensus.cc:2272] T f2343c932afb4d9aaa361b1e57330e8e P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.891508   431 tablet_replica.cc:333] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.896448   431 raft_consensus.cc:2243] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.897432   431 raft_consensus.cc:2272] T d501527377474732bddb08ed904bd34d P 36f53e9bfce749bbba4a4b34829f563d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.904294   431 tablet_replica.cc:333] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.916658   431 raft_consensus.cc:2243] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.924446   431 raft_consensus.cc:2272] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 36f53e9bfce749bbba4a4b34829f563d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.927345   431 tablet_replica.cc:333] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.936620   431 raft_consensus.cc:2243] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.937781   431 raft_consensus.cc:2272] T f66f028938a14af4a39a0e553938682b P 36f53e9bfce749bbba4a4b34829f563d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.940474   431 tablet_replica.cc:333] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.948647   431 raft_consensus.cc:2243] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.949676   431 raft_consensus.cc:2272] T 11658e0328124c609f964e633d7649bf P 36f53e9bfce749bbba4a4b34829f563d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.955367   431 tablet_replica.cc:333] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.981063   431 raft_consensus.cc:2243] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:44.982640   431 raft_consensus.cc:2272] T 73161049b574469ea08e360e2def1aac P 36f53e9bfce749bbba4a4b34829f563d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:44.986153   431 tablet_replica.cc:333] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:44.986989   431 raft_consensus.cc:2243] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:44.988401   431 raft_consensus.cc:2272] T 552871638635413bbd17d508b2a95e03 P 36f53e9bfce749bbba4a4b34829f563d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.003410   431 tablet_replica.cc:333] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d: stopping tablet replica
I20260709 13:04:45.012579   431 raft_consensus.cc:2243] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:45.013429   431 raft_consensus.cc:2272] T 443ffcfd9be74d9891a8cb9596947ca3 P 36f53e9bfce749bbba4a4b34829f563d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:45.019502  1676 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:45.078181  1608 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:04:45.080053  8975 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:45.088174  1648 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5df6a74dd4014d38b1b536f6b0fc66ec. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:45.096129  1648 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.131527  8754 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:45.133764  1608 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:45.175478  1432 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index -1 to 14, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:45.178960  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet 0246a4c90f2b48c5a3a10ad330723a67: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:45.187989  1608 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
W20260709 13:04:45.205916  1574 consensus_peers.cc:597] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 -> Peer e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631): Couldn't send request to peer e3ab72f324d545a6b4ecb1025df1f7c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 208506ca334e4441af10e7c0e8432dbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.206183  1676 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:04:45.207926  8846 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:45.229712  1574 consensus_peers.cc:597] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:45.248867  8754 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.249511  8754 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.251613  8754 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:45.253844  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
W20260709 13:04:45.256883  1648 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:45.261051  1647 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:45.263193  9063 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:45.293529  8846 raft_consensus.cc:2955] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 LEADER]: Committing config change with OpId 28.17: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:45.344334  1481 auto_rebalancer.cc:629] Failed to schedule move for tablet f2343c932afb4d9aaa361b1e57330e8e: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:45.369302  1676 raft_consensus.cc:2955] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
I20260709 13:04:45.413313  1432 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index -1 to 17, NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) added. New cstate: current_term: 28 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } }
W20260709 13:04:45.566972  2176 connection.cc:573] client connection to 127.0.107.193:34325 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:04:45.569897  9066 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.570830  9066 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.599469  9064 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.599567  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:45.600310  9064 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.602298  9066 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.603507  9064 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.605357  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:45.606230  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 26.
I20260709 13:04:45.607920  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:45.608986  9064 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:04:45.610518  9064 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.611198  9064 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:45.616528  9066 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.620411  9066 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.624625  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:45.631798  9066 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:45.636277  2176 leader_election.cc:336] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.636909  2176 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:45.637804  9064 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.638389  9066 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:45.643033  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f600ce14224412994ac233d95d67d1" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:45.643723  1676 raft_consensus.cc:3060] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:45.645773  8980 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.646376  8980 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.648574  8980 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:45.653438  1676 raft_consensus.cc:2468] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 27.
I20260709 13:04:45.656088  1576 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:45.657119  9084 ts_tablet_manager.cc:933] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.657397  8918 raft_consensus.cc:2804] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:04:45.658016  8918 raft_consensus.cc:697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 27 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:04:45.658425  2176 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.658891  2176 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:45.658954  8918 consensus_queue.cc:237] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.654072  9064 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:45.654470  1574 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.669682  8980 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.670387  8980 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.672593  8980 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:45.673977  9066 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:45.677048  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:45.678721  9084 tablet_copy_client.cc:323] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43535
I20260709 13:04:45.680979  1694 tablet_copy_service.cc:140] P 8c6031790cc44edfba5c3964e6f27c6e: Received BeginTabletCopySession request for tablet 5df6a74dd4014d38b1b536f6b0fc66ec from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:50950)
I20260709 13:04:45.681519  1694 tablet_copy_service.cc:161] P 8c6031790cc44edfba5c3964e6f27c6e: Beginning new tablet copy session on tablet 5df6a74dd4014d38b1b536f6b0fc66ec from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:50950: session id = e3ab72f324d545a6b4ecb1025df1f7c0-5df6a74dd4014d38b1b536f6b0fc66ec
I20260709 13:04:45.681411  1431 catalog_manager.cc:5697] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 26 to 27, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 27 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:45.682250  1574 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.689436  8918 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.690057  8918 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:45.693143  1648 leader_election.cc:336] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.693503  1694 tablet_copy_source_session.cc:215] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.693887  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:45.696689  8918 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.703166  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:45.703913  2211 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
W20260709 13:04:45.704851  1574 leader_election.cc:336] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.705318  1574 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:45.705983  8918 raft_consensus.cc:2749] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:45.709571  1648 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:45.712474  8980 raft_consensus.cc:2749] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:45.713580  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:45.720520  8980 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:45.720994  8980 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.721442  8980 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:45.730055  8980 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.730652  9079 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.731319  9079 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:45.731881  1648 leader_election.cc:336] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.734555  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:45.738708  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6a74dd4014d38b1b536f6b0fc66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.740008  8980 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:45.741159  9079 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:45.747063  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8501e8317ed348cca428d77d106f937c" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:45.747741  2211 raft_consensus.cc:3060] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:45.755112  2211 raft_consensus.cc:2468] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 25.
I20260709 13:04:45.758706  8918 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.759370  8918 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.761766  8918 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.770354  1648 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:45.770953  9079 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:04:45.775904  1574 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.776400  9079 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.778210  8846 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.778726  9079 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:45.778738  8846 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.775241  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:45.779795  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:45.780251  1676 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 18.
W20260709 13:04:45.781141  1648 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.781677  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:45.781857  9079 raft_consensus.cc:2804] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:45.781944  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:45.785171  8918 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:04:45.789691  1648 leader_election.cc:336] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.795145  8918 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.795840  8918 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:45.789202  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:45.794251  9064 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.783306  9079 raft_consensus.cc:697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:45.783293  8846 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:45.794238  1574 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.812880  9079 consensus_queue.cc:237] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.800670  9064 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.789424  8980 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:45.825053  9089 ts_tablet_manager.cc:933] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Initiating tablet copy from peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:45.828413  1648 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.829144  9064 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.829059  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:45.830130  8980 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:45.834357  8918 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.842867  8918 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:45.847371  9063 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.847919  9063 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.848428  9089 tablet_copy_client.cc:323] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:33801
I20260709 13:04:45.850380  9063 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:45.854907  9084 tablet_copy_client.cc:806] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.855742  9084 tablet_copy_client.cc:670] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.912575  1576 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:45.949667  1574 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:45.930011  9092 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.953876  9092 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:45.955992  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:45.943813  9064 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:45.962888  1431 catalog_manager.cc:5697] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 24 to 25, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 25 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.973460  8980 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.974696  8980 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.976181  9063 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.977174  9063 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.982332  8980 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:45.984207  9088 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.992352  9078 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:45.993445  9078 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:45.994961  9092 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:04:45.987365  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 54748.7us
I20260709 13:04:45.985432  9088 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.003075  9078 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.007114  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.008162  1679 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 21.
I20260709 13:04:46.008523  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0246a4c90f2b48c5a3a10ad330723a67" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.009582  1676 raft_consensus.cc:3060] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:46.009979  1648 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.011301  9063 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.018139  9088 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.023242  9084 tablet_copy_client.cc:538] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:46.036868  1620 tablet_copy_service.cc:140] P f9fb126997be4ec79f8f60fcd6764b00: Received BeginTabletCopySession request for tablet 208506ca334e4441af10e7c0e8432dbe from peer e3ab72f324d545a6b4ecb1025df1f7c0 ({username='slave'} at 127.0.0.1:56314)
I20260709 13:04:46.038024  1620 tablet_copy_service.cc:161] P f9fb126997be4ec79f8f60fcd6764b00: Beginning new tablet copy session on tablet 208506ca334e4441af10e7c0e8432dbe from peer e3ab72f324d545a6b4ecb1025df1f7c0 at {username='slave'} at 127.0.0.1:56314: session id = e3ab72f324d545a6b4ecb1025df1f7c0-208506ca334e4441af10e7c0e8432dbe
I20260709 13:04:46.041656  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.045388  1679 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 16.
I20260709 13:04:46.038031  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.052845  9096 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.053782  9096 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:46.064090  2176 leader_election.cc:336] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.065620  9096 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.066817  9088 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:46.067476  9088 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.068073  9088 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:46.078974  1574 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.092252  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:46.093015  2206 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
W20260709 13:04:46.096215  1574 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.084720  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 46848.7us
I20260709 13:04:46.089668  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:46.090369  1648 leader_election.cc:336] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.098169  1648 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.098927  1679 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 25.
W20260709 13:04:46.097015  1574 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.108634  1647 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:46.109934  9078 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:46.112622  1676 raft_consensus.cc:2468] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 19.
I20260709 13:04:46.113348  1620 tablet_copy_source_session.cc:215] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:46.118347  9093 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.119220  9093 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.121742  9093 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.123692  9084 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:46.125815  9088 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.130529  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.130652  8918 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.132965  9094 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:46.133512  9094 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.133325  8918 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.133957  9094 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:46.135865  8918 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.138070  9093 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.138871  9093 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.141304  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.142076  1608 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:46.141465  9093 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:46.148497  2178 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.149715  9068 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:46.150245  9068 raft_consensus.cc:493] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.150658  9068 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:46.153340  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.153856  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.154078  1604 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 24.
W20260709 13:04:46.156250  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 55360.8us
I20260709 13:04:46.160709  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.161548  1676 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:46.163761  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.165038  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.165270  9089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208506ca334e4441af10e7c0e8432dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.165839  9098 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:46.166326  9098 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.166791  9098 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:46.166636  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.170775  8975 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:46.171177  8975 raft_consensus.cc:493] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.171576  8975 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:46.172681  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.173564  9063 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:46.173961  9063 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.174364  9063 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:46.183717  1648 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.192907  9092 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.193498  1676 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:46.190474  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:46.193558  9092 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.209873  9092 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:46.194656  9078 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.194789  9088 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.196667  9079 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.210749  9078 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.210894  9079 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.192577  9093 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.212920  9079 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:46.213335  9093 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.212932  9078 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:46.189090  1574 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.215583  9093 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.198927  1576 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.225024  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.226114  8754 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.226763  8754 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.232829  9063 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.233255  9092 raft_consensus.cc:2804] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:46.234649  9092 raft_consensus.cc:697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:46.234750  8754 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.234987  9063 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.233024  8975 raft_consensus.cc:515] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.235769  9092 consensus_queue.cc:237] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.237315  8975 leader_election.cc:290] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.240561  9088 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:46.241170  9088 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.240965  9068 raft_consensus.cc:515] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.241816  9088 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:46.248517  9079 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
W20260709 13:04:46.249051  1574 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.249249  9079 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:46.249853  1574 consensus_peers.cc:597] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:46.250360  1574 leader_election.cc:336] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.251631  9079 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.252470  2207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:46.255527  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.257824  9093 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.269351  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:46.269541  9093 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.261214  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.226680  9094 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.271898  1609 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 20.
I20260709 13:04:46.272637  9095 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:46.273238  9094 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.273484  9095 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.274289  1608 raft_consensus.cc:2393] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 17: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:46.278630  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cee4cb45f7c44278850093451991c78" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.279289  1676 raft_consensus.cc:3060] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:46.281177  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:46.282431  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eca33b3bd986485893d6724a68cb2430" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:46.283083  1605 raft_consensus.cc:3060] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:46.290014  1676 raft_consensus.cc:2468] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 22.
I20260709 13:04:46.290860  9093 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.292295  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e72d8320164ed18fc7fccba3a0ecd3" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.293026  1677 raft_consensus.cc:3060] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:46.294569  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.296729  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.274214  9095 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:46.300323  9068 leader_election.cc:290] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.304345  1609 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:46.308634  1608 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 28.
I20260709 13:04:46.312588  9068 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.313397  9068 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.316962  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:46.317929  9097 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:46.320802  9089 tablet_copy_client.cc:806] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:46.321574  9089 tablet_copy_client.cc:670] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:46.328156  9068 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.333246  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:46.333617  1574 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.333992  1679 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
W20260709 13:04:46.334273  1574 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.334738  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:46.335647  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.335932  9092 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:46.327244  1431 catalog_manager.cc:5697] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 18 to 19, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.340066  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adb51b03e1142c4b3d2fe81051fecb9" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.340477  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.340829  1683 raft_consensus.cc:3060] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:46.341105  1679 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 23.
I20260709 13:04:46.344559  1676 raft_consensus.cc:1275] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:04:46.330521  1677 raft_consensus.cc:2468] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 26.
I20260709 13:04:46.346915  2178 leader_election.cc:304] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:46.340817  1605 raft_consensus.cc:2468] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 23.
I20260709 13:04:46.348050  9068 raft_consensus.cc:2804] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:46.352157  9068 raft_consensus.cc:697] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:46.352412  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.354364  1605 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 21.
I20260709 13:04:46.354089  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:46.356489  1683 raft_consensus.cc:2468] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 17.
I20260709 13:04:46.361491  1647 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:46.363273  8980 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:46.363727  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:46.365399  9078 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:46.365840  9078 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.366211  9078 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:46.370150  9066 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.370941  9066 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.372434  9099 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:46.372991  9099 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.373438  9099 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:46.374353  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:46.376842  9066 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.379257  2212 raft_consensus.cc:1275] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:04:46.274252  9088 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.381786  8980 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:04:46.382506  1647 leader_election.cc:304] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:46.378724  9068 consensus_queue.cc:237] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.384835  8980 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.385325  8980 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:04:46.343245  9098 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.394739  9098 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:46.400729  9095 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.403420  9095 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:46.409384  2176 leader_election.cc:336] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.410262  2176 leader_election.cc:336] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.417456  8754 consensus_queue.cc:1048] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:46.418591  9079 raft_consensus.cc:2804] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:46.419193  9079 raft_consensus.cc:697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:46.420171  9079 consensus_queue.cc:237] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.421108  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d120199a9d3441ab490816cfe76664f" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:46.431994  2206 raft_consensus.cc:3060] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:46.409152  1576 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:04:46.434341  1574 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.434890  1574 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.435568  1576 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:04:46.437913  2176 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.441151  1648 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.443463  1648 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.444802  1648 leader_election.cc:336] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.445106  1604 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 25: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:46.399821  9078 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:46.446012  1648 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.446188  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.438685  9092 raft_consensus.cc:2804] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:46.447316  9092 raft_consensus.cc:697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:46.442174  9093 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:46.452308  9093 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.452723  9093 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:46.459081  9084 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:46.463443  9084 tablet_bootstrap.cc:492] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:46.464390  9084 ts_tablet_manager.cc:1403] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 0.341s	user 0.051s	sys 0.011s
I20260709 13:04:46.470602  9092 consensus_queue.cc:237] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.479693  2206 raft_consensus.cc:2468] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 20.
I20260709 13:04:46.480870  1576 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.479404  8980 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.481105  9064 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:46.487361  9064 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.487859  9064 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:46.496891  1574 consensus_peers.cc:597] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.497871  9088 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:46.497617  1574 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.501222  9099 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.502154  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:46.504133  9063 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:46.507074  9078 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.507619  1431 catalog_manager.cc:5697] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 25 to 26, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 26 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.508981  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:04:46.499440  1574 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.485002  8918 consensus_queue.cc:1048] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:04:46.516870  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
W20260709 13:04:46.480142  1648 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.526935  1605 raft_consensus.cc:3060] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:04:46.519852  8980 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.527909  9098 raft_consensus.cc:2804] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:46.532262  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:46.531886  1574 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.533661  9097 raft_consensus.cc:2804] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:46.534174  9097 raft_consensus.cc:697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:46.535136  9097 consensus_queue.cc:237] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.522881  9069 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.531088  9099 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.536564  9069 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.538944  9069 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.540985  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:46.541623  1677 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 17.
I20260709 13:04:46.541657  2175 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.543004  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:46.543326  9089 tablet_copy_client.cc:538] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:46.543748  9096 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:46.544153  9096 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.544534  9096 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:46.549767  9093 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.551115  1608 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 21: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:46.554629  9064 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.555039  9096 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.557485  9098 raft_consensus.cc:697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:46.607695  9098 consensus_queue.cc:237] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.608492  9064 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.607942  1431 catalog_manager.cc:5697] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 21 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.609798  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c2065ad5cf4ab19e1aabd16c64fe95" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.610386  1683 raft_consensus.cc:3060] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:46.558184  1605 raft_consensus.cc:2468] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 29.
I20260709 13:04:46.616350  1604 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6031790cc44edfba5c3964e6f27c6e in current term 24: Already voted for candidate f9fb126997be4ec79f8f60fcd6764b00 in this term.
I20260709 13:04:46.617722  1647 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:46.617811  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.564347  9107 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:46.564623  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:46.565388  9093 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:46.623051  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:46.568367  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 88277.3us
W20260709 13:04:46.624300  1648 leader_election.cc:336] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.623934  1677 raft_consensus.cc:2393] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 21: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:46.624697  1648 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:46.598512  1574 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.589702   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1556)
W20260709 13:04:46.579131  2176 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.618813  1683 raft_consensus.cc:2468] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
I20260709 13:04:46.620618  1679 raft_consensus.cc:2393] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 25: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
I20260709 13:04:46.621512  1608 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 24.
W20260709 13:04:46.628159  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 49114.2us
I20260709 13:04:46.621254  9107 raft_consensus.cc:493] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.632154  1675 raft_consensus.cc:1275] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:46.632448  9107 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:46.629736  1574 consensus_peers.cc:597] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.646270  1574 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.623097  9099 raft_consensus.cc:2804] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:04:46.656121  8980 raft_consensus.cc:2749] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:46.656352  9099 raft_consensus.cc:697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 29 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:46.657406  9099 consensus_queue.cc:237] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:46.658548  9089 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap starting.
I20260709 13:04:46.649588  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:46.659370  2176 leader_election.cc:336] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.644898  1576 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.651714  1432 catalog_manager.cc:5697] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 22 to 23, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 23 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.659993  1677 raft_consensus.cc:2393] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f9fb126997be4ec79f8f60fcd6764b00 in current term 24: Already voted for candidate 8c6031790cc44edfba5c3964e6f27c6e in this term.
W20260709 13:04:46.660208  2176 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.664671  2175 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
W20260709 13:04:46.706995  1648 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.707111  1576 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
W20260709 13:04:46.708731  9105 log.cc:927] Time spent T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:04:46.711517  8918 raft_consensus.cc:2749] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:46.579715  9084 raft_consensus.cc:359] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:46.720768  9098 consensus_queue.cc:1048] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:46.701120  9095 raft_consensus.cc:2804] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:46.700963  9068 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:46.727114  9068 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 36f53e9bfce749bbba4a4b34829f563d)
I20260709 13:04:46.729665  9068 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:46.717772  9084 raft_consensus.cc:740] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:46.737504  9096 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.746373  9084 consensus_queue.cc:260] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:46.730254  9095 raft_consensus.cc:697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
W20260709 13:04:46.748939  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.749485  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:46.750561  9093 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:46.752795  9107 raft_consensus.cc:515] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:46.749500  9084 ts_tablet_manager.cc:1434] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.285s	user 0.009s	sys 0.001s
I20260709 13:04:46.775297  9095 consensus_queue.cc:237] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:46.777523  9111 log.cc:927] Time spent T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:04:46.779143  2176 leader_election.cc:336] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.780967  2176 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.788472  1694 tablet_copy_service.cc:342] P 8c6031790cc44edfba5c3964e6f27c6e: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-5df6a74dd4014d38b1b536f6b0fc66ec received from {username='slave'} at 127.0.0.1:50950
I20260709 13:04:46.789059  1694 tablet_copy_service.cc:434] P 8c6031790cc44edfba5c3964e6f27c6e: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-5df6a74dd4014d38b1b536f6b0fc66ec on tablet 5df6a74dd4014d38b1b536f6b0fc66ec with peer e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:46.807746  2176 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.820495  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.812999  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66f028938a14af4a39a0e553938682b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:46.823419  1678 raft_consensus.cc:3060] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:46.811630  9107 leader_election.cc:290] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:46.803968  1574 consensus_peers.cc:597] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.832434  1574 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.833160  1574 consensus_peers.cc:597] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.833737  1574 consensus_peers.cc:597] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.834374  1574 consensus_peers.cc:597] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.835898  2176 leader_election.cc:336] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.845034  1677 raft_consensus.cc:1275] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:04:46.845785  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 128930us
I20260709 13:04:46.846519  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:46.846549  1678 raft_consensus.cc:2468] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 18.
I20260709 13:04:46.847489  9113 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:04:46.849067  9107 consensus_queue.cc:1048] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:04:46.854396  1430 catalog_manager.cc:5697] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 19 to 20, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.857893  1430 catalog_manager.cc:5697] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 16 to 17, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:46.861852  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 141631us
I20260709 13:04:46.877911  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:46.878777  1608 raft_consensus.cc:3060] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:46.895126  2176 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:46.897403  1648 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.899173  1648 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:46.908751  1608 raft_consensus.cc:2468] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 22.
I20260709 13:04:46.909381  2178 leader_election.cc:304] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.911725  8754 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:04:46.912063  1648 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.912818  1648 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:46.864568  9068 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:46.915880  1648 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:46.920090  2175 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.921322  9066 raft_consensus.cc:2804] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:04:46.916939  1648 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:46.922688  1648 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.925858  9068 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:46.917841  9099 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:04:46.934173  2176 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:46.923830  1648 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.935753  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:46.936458  1608 raft_consensus.cc:3060] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:46.916949  9096 raft_consensus.cc:2804] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:46.947460  2212 raft_consensus.cc:1217] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.13->[24.14-24.14]   Dedup: 24.14->[]
I20260709 13:04:46.949397  9096 raft_consensus.cc:697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:46.950444  9096 consensus_queue.cc:237] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:46.954568  1574 consensus_peers.cc:597] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:46.956344  1683 raft_consensus.cc:1275] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:46.955577  1608 raft_consensus.cc:2468] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 25.
I20260709 13:04:46.985559  2175 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:46.991356  9069 raft_consensus.cc:2804] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:46.991930  9069 raft_consensus.cc:697] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:46.992897  9069 consensus_queue.cc:237] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:46.997973  2176 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.002104  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.004515  1574 consensus_peers.cc:597] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.024183  9097 consensus_queue.cc:1048] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:47.015915  1648 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.029222  1608 raft_consensus.cc:1275] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:04:47.051110  1431 catalog_manager.cc:5697] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 28 to 29, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 29 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.071839  9066 raft_consensus.cc:697] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:47.060374  9099 consensus_queue.cc:1048] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:04:47.109505  1648 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.112006  1648 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.113857  1648 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.114382  1648 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.177692  2176 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.180914  1648 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.181859  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.187088  1574 consensus_peers.cc:597] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.187526  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 78414.1us
W20260709 13:04:47.187938  1648 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.192224  9066 consensus_queue.cc:237] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:47.198349  1574 consensus_peers.cc:597] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.182390  1430 catalog_manager.cc:5697] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 24 to 25, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.224596  1683 raft_consensus.cc:1275] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:47.227764  9130 consensus_queue.cc:1048] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:04:47.228092  1574 consensus_peers.cc:597] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.228940  1574 consensus_peers.cc:597] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.231813  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.242579  9112 raft_consensus.cc:1064] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
I20260709 13:04:47.245579  9112 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:47.241698  1676 raft_consensus.cc:1275] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:04:47.274485  1574 consensus_peers.cc:597] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.275130  1574 consensus_peers.cc:597] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.279402  1605 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:04:47.280575  2206 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEARNER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:04:47.282994  8980 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:47.284773  9064 consensus_queue.cc:1048] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:47.291553  2206 raft_consensus.cc:1275] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:47.300530  8980 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:47.304864  1605 raft_consensus.cc:1275] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:04:47.310505  9099 consensus_queue.cc:1048] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:04:47.332423  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 44010.3us
I20260709 13:04:47.347391  1432 catalog_manager.cc:5697] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 21 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 22 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:47.363076  1648 consensus_peers.cc:597] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.363677  1648 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:47.367411  9064 consensus_queue.cc:1048] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:47.369774  1574 consensus_peers.cc:597] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.373224  9089 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.113s	user 0.004s	sys 0.000s
I20260709 13:04:47.419705  9063 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:47.437780  2212 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:47.462469  1574 consensus_peers.cc:597] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.463028  2176 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.463541  2176 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:47.464519  1432 catalog_manager.cc:5697] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 17 to 18, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.466961  1609 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:47.479460  1677 raft_consensus.cc:1275] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:47.481097  9107 consensus_queue.cc:1048] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:04:47.482386  1648 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:47.517562  1432 catalog_manager.cc:5697] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 24 to 25, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:47.554183  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 71286.6us
I20260709 13:04:47.563445  1608 raft_consensus.cc:1275] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:04:47.565717  9107 consensus_queue.cc:1048] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:04:47.615257  9140 log.cc:927] Time spent T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.068s	user 0.010s	sys 0.022s
W20260709 13:04:47.620220  9089 log.cc:927] Time spent T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
W20260709 13:04:47.621515  9075 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: Append to log took a long time: real 0.054s	user 0.003s	sys 0.006s
W20260709 13:04:47.628204   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1556)
I20260709 13:04:47.631641  1430 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: config changed from index 14 to 15, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.666131  1676 consensus_queue.cc:237] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:47.680786  1609 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:04:47.682669  9103 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:47.692019  9112 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:47.699019  1605 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:47.719533  2212 raft_consensus.cc:1275] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:04:47.740865  9103 consensus_queue.cc:1048] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:47.748538  9089 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=2 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:47.776114  9089 tablet_bootstrap.cc:492] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Bootstrap complete.
I20260709 13:04:47.777040  9089 ts_tablet_manager.cc:1403] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent bootstrapping tablet: real 1.146s	user 0.068s	sys 0.004s
I20260709 13:04:47.780203  9089 raft_consensus.cc:359] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:47.785353  2206 raft_consensus.cc:2955] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:47.796572  9089 raft_consensus.cc:740] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 LEARNER]: Becoming Follower/Learner. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Initialized, Role: LEARNER
I20260709 13:04:47.797488  9089 consensus_queue.cc:260] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } }
I20260709 13:04:47.802130  9089 ts_tablet_manager.cc:1434] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:04:47.819871  1620 tablet_copy_service.cc:342] P f9fb126997be4ec79f8f60fcd6764b00: Request end of tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-208506ca334e4441af10e7c0e8432dbe received from {username='slave'} at 127.0.0.1:56314
I20260709 13:04:47.820415  1620 tablet_copy_service.cc:434] P f9fb126997be4ec79f8f60fcd6764b00: ending tablet copy session e3ab72f324d545a6b4ecb1025df1f7c0-208506ca334e4441af10e7c0e8432dbe on tablet 208506ca334e4441af10e7c0e8432dbe with peer e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:47.846382  1420 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5df6a74dd4014d38b1b536f6b0fc66ec with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:47.849434  1605 raft_consensus.cc:1275] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:04:47.853089  9068 consensus_queue.cc:1048] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:04:47.858471  1574 consensus_peers.cc:597] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:47.871176  2176 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:47.924613  1432 catalog_manager.cc:5697] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: config changed from index 15 to 16, VOTER 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) evicted. New cstate: current_term: 24 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:47.929610  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 57785.1us
I20260709 13:04:48.002879  2206 raft_consensus.cc:1217] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 LEARNER]: Deduplicated request from leader. Original: 28.16->[28.17-28.17]   Dedup: 28.17->[]
W20260709 13:04:48.129037  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.443074  8754 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.443553  8754 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.445509  8754 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:48.452422  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:48.453122  1608 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 25.
I20260709 13:04:48.454257  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:48.456662  8754 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:48.457046  8754 raft_consensus.cc:493] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.457335  8754 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:48.483222  8754 raft_consensus.cc:515] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.502386  8754 leader_election.cc:290] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:48.502986  8754 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.503986  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db5c09b405c47f6a1aaa189b76a0002" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:48.504618  1608 raft_consensus.cc:3060] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:48.504341  8754 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.506140  9146 raft_consensus.cc:1064] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: attempting to promote NON_VOTER e3ab72f324d545a6b4ecb1025df1f7c0 to VOTER
W20260709 13:04:48.508095  1648 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.511152  9146 consensus_queue.cc:237] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 15, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:48.512415  8754 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:48.523048  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00" is_pre_election: true
I20260709 13:04:48.524550  1605 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 21.
I20260709 13:04:48.532594  1608 raft_consensus.cc:2468] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 26.
I20260709 13:04:48.532105  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:48.535872  9064 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:48.536844  1648 leader_election.cc:336] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:48.538622  1648 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.539116  9064 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.541270  9064 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:48.542775  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:48.543460  1676 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 24.
I20260709 13:04:48.545271  9148 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:48.545801  9148 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.546152  9148 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:48.546657  1647 leader_election.cc:304] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:48.547645  9079 raft_consensus.cc:2804] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:48.548379  9079 raft_consensus.cc:697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:48.549611  9079 consensus_queue.cc:237] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.557204  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:48.565687  9148 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.566758  9064 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:48.567186  9064 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.567526  9064 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:48.568642  1574 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.584206  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f9fb126997be4ec79f8f60fcd6764b00"
I20260709 13:04:48.584872  1608 raft_consensus.cc:3060] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:48.586218  1683 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:04:48.583856  9064 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.589653  9064 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:48.590312  9064 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:04:48.591384  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11658e0328124c609f964e633d7649bf" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:48.591995  1683 raft_consensus.cc:3060] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:48.593585  2206 raft_consensus.cc:1275] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 LEARNER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
W20260709 13:04:48.597915  1648 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.600395  9148 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Requested vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:48.603691  1608 raft_consensus.cc:2468] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 22.
I20260709 13:04:48.613706  1647 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d
I20260709 13:04:48.622104  9148 raft_consensus.cc:2804] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:48.623410  1683 raft_consensus.cc:2468] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9fb126997be4ec79f8f60fcd6764b00 in term 25.
I20260709 13:04:48.625907  9148 raft_consensus.cc:697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
W20260709 13:04:48.628906   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1556)
I20260709 13:04:48.627364  9148 consensus_queue.cc:237] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:48.633940  9113 consensus_queue.cc:1048] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:48.634534  1576 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00; no voters: 
I20260709 13:04:48.635918  9146 raft_consensus.cc:2804] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:48.636617  9146 raft_consensus.cc:697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Becoming Leader. State: Replica: f9fb126997be4ec79f8f60fcd6764b00, State: Running, Role: LEADER
I20260709 13:04:48.637718  9146 consensus_queue.cc:237] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:48.644778  1574 consensus_peers.cc:597] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:48.646950  1574 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:48.671990  9146 raft_consensus.cc:2955] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 LEADER]: Committing config change with OpId 28.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:48.674010  2206 raft_consensus.cc:2955] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Committing config change with OpId 28.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:48.702481  1429 catalog_manager.cc:5697] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 20 to 22, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 22 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.705101  1429 catalog_manager.cc:5697] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 24 to 26, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 26 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.705384  1430 catalog_manager.cc:5697] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 reported cstate change: term changed from 23 to 25, leader changed from 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193) to f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.717149  1676 raft_consensus.cc:2955] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Committing config change with OpId 28.18: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
I20260709 13:04:48.722309  1432 catalog_manager.cc:5697] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: config changed from index 17 to 18, e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 28 leader_uuid: "f9fb126997be4ec79f8f60fcd6764b00" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } } }
W20260709 13:04:48.736984  1574 consensus_peers.cc:597] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:48.853858  1574 consensus_peers.cc:597] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:48.949571  1574 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:48.985430  1648 consensus_peers.cc:597] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:48.999051  1574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 13:04:48.999931  1574 consensus_peers.cc:597] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:49.011970  1608 raft_consensus.cc:1275] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:04:49.013845  9148 consensus_queue.cc:1048] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:49.062819  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.063220  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 52621.1us
W20260709 13:04:49.080483  1648 consensus_peers.cc:597] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:49.105792  1648 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.118907  1574 consensus_peers.cc:597] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.138747  1574 consensus_peers.cc:597] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:49.163085  1608 raft_consensus.cc:1275] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:04:49.177515  1648 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:49.166002  8754 consensus_queue.cc:1048] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:04:49.182579  1648 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:49.191087  1676 raft_consensus.cc:1275] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Refusing update from remote peer f9fb126997be4ec79f8f60fcd6764b00: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:49.195317  9146 consensus_queue.cc:1048] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:49.262455  2176 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.274189  1648 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.278234  1648 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.283701  1574 consensus_peers.cc:597] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.306751  2176 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.361639  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.392660  1574 consensus_peers.cc:597] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:49.407754  1648 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.417164  1648 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.432138  1648 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.432631  1648 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.440251  1576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 93605.9us
W20260709 13:04:49.485252  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:49.489785  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 85579.8us
W20260709 13:04:49.494376  1648 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.497792  1574 consensus_peers.cc:597] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.502352  1574 consensus_peers.cc:597] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.503307  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.510902  2176 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.511500  2176 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.511935  2176 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.538003  1574 consensus_peers.cc:597] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.547931  1574 consensus_peers.cc:597] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.551317  1574 consensus_peers.cc:597] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.555809  1574 consensus_peers.cc:597] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.577977  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.586454  1574 consensus_peers.cc:597] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.595458  1648 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.628149  2176 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:49.628453   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:49.636371  2176 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.645718  1574 consensus_peers.cc:597] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.810950  1574 consensus_peers.cc:597] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.848783  1574 consensus_peers.cc:597] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:49.849939  1648 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:49.960359  1648 consensus_peers.cc:597] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:50.030841  1574 consensus_peers.cc:597] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:50.152566  2176 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:50.209579  2176 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:50.440322   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:50.491210  2176 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:50.496235  2175 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.503973  1647 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.505934  1647 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.506170  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39631, user_credentials={real_user=slave}} blocked reactor thread for 48629.8us
W20260709 13:04:50.540745  1647 consensus_peers.cc:597] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.541373  1647 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.543674  1647 consensus_peers.cc:597] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.549219  1647 consensus_peers.cc:597] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.553001  2175 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.553825  2175 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.577600  1647 consensus_peers.cc:597] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.614740  1647 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.631471  1647 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.638861  1647 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.655330  1647 consensus_peers.cc:597] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.660969  1647 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.684389  2175 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.696647  2175 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.715719  1418 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 93207.8us
I20260709 13:04:50.726140   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:50.721587  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:50.739569   431 tablet_replica.cc:333] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:50.740752   431 raft_consensus.cc:2243] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.741437   431 raft_consensus.cc:2272] T b748cae74bbb4bdc9765bc293b0b6702 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.758370  2175 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.799934  1647 consensus_peers.cc:597] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.775409   431 tablet_replica.cc:333] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:50.842883   431 raft_consensus.cc:2243] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:50.846586  1647 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.849817   431 raft_consensus.cc:2272] T baf31533a97f4325919d60e19d73b3f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.856338   431 tablet_replica.cc:333] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:50.863880  1574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 74749.2us
I20260709 13:04:50.874902   431 raft_consensus.cc:2243] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.889904   431 raft_consensus.cc:2272] T 4fb69c6ea77a4b5680f9f2b453332415 P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.900343   431 tablet_replica.cc:333] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:50.901786  1647 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.907292   431 raft_consensus.cc:2243] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.909657   431 raft_consensus.cc:2272] T 9a39df5ae9144c118d4158b68b17044c P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.923640  1647 consensus_peers.cc:597] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.927462   431 tablet_replica.cc:333] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:50.933560   431 raft_consensus.cc:2243] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.937582   431 raft_consensus.cc:2272] T 208506ca334e4441af10e7c0e8432dbe P f9fb126997be4ec79f8f60fcd6764b00 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.942422   431 tablet_replica.cc:333] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:50.988873   431 raft_consensus.cc:2243] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.990077   431 raft_consensus.cc:2272] T 32221e86161141d39327e18efdbbb226 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.983187  1647 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.000290  1647 consensus_peers.cc:597] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.039451   431 tablet_replica.cc:333] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.040405   431 raft_consensus.cc:2243] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:51.072459  1647 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.074242  1647 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.041091   431 raft_consensus.cc:2272] T abc3085f661f457e8c8d15478c227311 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.077355   431 tablet_replica.cc:333] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.094878   431 raft_consensus.cc:2243] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.099601   431 raft_consensus.cc:2272] T 4e287a2761794958b3002cd2258cf2f2 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.118502   431 tablet_replica.cc:333] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.125313   431 raft_consensus.cc:2243] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.134096   431 raft_consensus.cc:2272] T d9a84223e947489c829c528c860660d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.175091   431 tablet_replica.cc:333] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.182583   431 raft_consensus.cc:2243] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.212508   431 raft_consensus.cc:2272] T e7f600ce14224412994ac233d95d67d1 P f9fb126997be4ec79f8f60fcd6764b00 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.248356   431 tablet_replica.cc:333] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.256358   431 raft_consensus.cc:2243] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.263634   431 raft_consensus.cc:2272] T 5adb51b03e1142c4b3d2fe81051fecb9 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.289270   431 tablet_replica.cc:333] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.304847   431 raft_consensus.cc:2243] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.306960   431 raft_consensus.cc:2272] T 3db5c09b405c47f6a1aaa189b76a0002 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.317405   431 tablet_replica.cc:333] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.322316   431 raft_consensus.cc:2243] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.327162   431 raft_consensus.cc:2272] T 891c34d92ded4b85948a508cf94b612c P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.337958   431 tablet_replica.cc:333] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.348712   431 raft_consensus.cc:2243] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.358223   431 raft_consensus.cc:2272] T 8cee4cb45f7c44278850093451991c78 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.361512   431 tablet_replica.cc:333] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.390090   431 raft_consensus.cc:2243] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.398635  9168 raft_consensus.cc:493] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.399477  9168 raft_consensus.cc:515] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.398777   431 raft_consensus.cc:2272] T c4cbda5372a24182a9982a0d35ff91b7 P f9fb126997be4ec79f8f60fcd6764b00 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.398022  1648 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.403340  9168 leader_election.cc:290] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.411478  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5396b1c71261414f9ca554acc690f489" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:51.413694  1574 consensus_peers.cc:597] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.416874  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.418923   431 tablet_replica.cc:333] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.420756   431 raft_consensus.cc:2243] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.426327   431 raft_consensus.cc:2272] T 1d120199a9d3441ab490816cfe76664f P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.438126   431 tablet_replica.cc:333] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.456836   431 raft_consensus.cc:2243] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.458236   431 raft_consensus.cc:2272] T ace772102403442daf5f360432c323e9 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.468194  1574 leader_election.cc:336] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.447429  9168 raft_consensus.cc:493] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.468765  1574 leader_election.cc:304] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.469544  9113 raft_consensus.cc:2749] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:51.468990  9168 raft_consensus.cc:515] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.474663  9168 leader_election.cc:290] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.477571   431 tablet_replica.cc:333] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.484918   431 raft_consensus.cc:2243] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.485972   431 raft_consensus.cc:2272] T 0f31cf514617428594649c1ecf3b2547 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.487069  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac0c25895864a4e8a2926c7c5198ee7" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.495963   431 tablet_replica.cc:333] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.507869   431 raft_consensus.cc:2243] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.515494   431 raft_consensus.cc:2272] T 1d5174ec6bd2452abb5d7617555ce4f7 P f9fb126997be4ec79f8f60fcd6764b00 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.518522   431 tablet_replica.cc:333] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.523999   431 raft_consensus.cc:2243] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.535669  9168 raft_consensus.cc:493] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.536278  9168 raft_consensus.cc:515] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.539417  9168 leader_election.cc:290] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.540473   431 raft_consensus.cc:2272] T eca33b3bd986485893d6724a68cb2430 P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.543526   431 tablet_replica.cc:333] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.545028  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69addfec4f4248bbabd86bd0f93ae32d" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.545825  9113 raft_consensus.cc:493] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.558969  9113 raft_consensus.cc:515] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.561169  9113 leader_election.cc:290] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.562146  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2343c932afb4d9aaa361b1e57330e8e" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.562536   431 raft_consensus.cc:2243] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.563902   431 raft_consensus.cc:2272] T 0246a4c90f2b48c5a3a10ad330723a67 P f9fb126997be4ec79f8f60fcd6764b00 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.569438  1574 leader_election.cc:336] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.583796  1574 leader_election.cc:304] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.585181  9113 raft_consensus.cc:493] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.592437  9113 raft_consensus.cc:515] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.594643  9113 leader_election.cc:290] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.595999  9113 raft_consensus.cc:2749] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:51.596072  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1845d3b47c5e4111a5c3c8f4e5de74ae" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.605414   431 tablet_replica.cc:333] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.612728   431 raft_consensus.cc:2243] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.616014   431 raft_consensus.cc:2272] T 3ba1b10b23d84716ad2e0452649e214e P f9fb126997be4ec79f8f60fcd6764b00 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.616624  9113 raft_consensus.cc:493] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
W20260709 13:04:51.613262  1574 leader_election.cc:336] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.617254  1574 leader_election.cc:304] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.617190  9113 raft_consensus.cc:515] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:51.618180  9168 raft_consensus.cc:2749] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:04:51.619897  9113 leader_election.cc:290] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:04:51.623773  1648 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.625710  9168 raft_consensus.cc:493] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.626272  9168 raft_consensus.cc:515] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.628496  9168 leader_election.cc:290] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.630877  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1665355552db4e4e97ba80c516768367" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.635898  9168 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:04:51.636264  1648 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.636559  9168 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:51.640560  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73161049b574469ea08e360e2def1aac" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:51.640815  9168 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:51.644779  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.638231   431 tablet_replica.cc:333] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.657588   431 raft_consensus.cc:2243] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.664520   431 raft_consensus.cc:2272] T 69addfec4f4248bbabd86bd0f93ae32d P f9fb126997be4ec79f8f60fcd6764b00 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.662791  1648 consensus_peers.cc:597] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:51.676223  1648 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.684180  1574 leader_election.cc:336] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.685484  9168 raft_consensus.cc:493] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:51.686113  9168 raft_consensus.cc:515] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:51.688542  9168 leader_election.cc:290] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:51.699115   431 tablet_replica.cc:333] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.700453   431 raft_consensus.cc:2243] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.701951   431 raft_consensus.cc:2272] T 9463f88e50794193abace66439f1975b P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.684976  1574 leader_election.cc:304] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.703830  9168 raft_consensus.cc:493] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.704895  9168 raft_consensus.cc:515] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:51.705293  1574 consensus_peers.cc:597] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.705750  1574 leader_election.cc:336] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.706130  1574 leader_election.cc:304] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.706938  9166 raft_consensus.cc:2749] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:51.707568  9166 raft_consensus.cc:2749] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:51.708675  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532c559048cc4785a9da4b7d8725f768" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.711603  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db0d135af1343458208be9b79d66635" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:51.712751  9168 leader_election.cc:290] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:51.718338  1574 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:51.721585  9168 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:51.736264  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe9105bf6ce4e118b6b4a3135515534" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:51.739142   431 tablet_replica.cc:333] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.740199   431 raft_consensus.cc:2243] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.741329   431 raft_consensus.cc:2272] T 57c2065ad5cf4ab19e1aabd16c64fe95 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.741907  2176 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.753449   431 tablet_replica.cc:333] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.757673   431 raft_consensus.cc:2243] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.758567   431 raft_consensus.cc:2272] T 5ea2020c26814418b630a447fc961d07 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.762981  1648 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:51.768079   431 tablet_replica.cc:333] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.773310   431 raft_consensus.cc:2243] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.780369   431 raft_consensus.cc:2272] T 5df6a74dd4014d38b1b536f6b0fc66ec P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.803110   431 tablet_replica.cc:333] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.807061   431 raft_consensus.cc:2243] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:04:51.803754  1574 leader_election.cc:336] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.812340  1574 leader_election.cc:304] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:51.815819  9113 raft_consensus.cc:2749] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:51.824893   431 raft_consensus.cc:2272] T 6d6c985edaa245138167af8ae5b22067 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.826007  1648 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.845117  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.828989  1574 leader_election.cc:336] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.850411  1574 leader_election.cc:304] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.860819  9168 raft_consensus.cc:2749] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:51.864195  1574 consensus_peers.cc:597] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:51.866180  9113 raft_consensus.cc:493] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ab72f324d545a6b4ecb1025df1f7c0)
I20260709 13:04:51.869717  9113 raft_consensus.cc:515] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:51.872555  9113 leader_election.cc:290] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:51.869108   431 tablet_replica.cc:333] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.880360   431 raft_consensus.cc:2243] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.886109   431 raft_consensus.cc:2272] T 1845d3b47c5e4111a5c3c8f4e5de74ae P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.889684  9168 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.890271  9168 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:51.893283  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.893549  9168 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:51.896411  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af5bea2a3c6428b9b6c07c96e3160ef" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:51.911170  9174 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:51.911897  9174 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.923504  9174 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:51.925685  1647 leader_election.cc:336] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:51.932345  9113 raft_consensus.cc:493] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:51.933228  9113 raft_consensus.cc:515] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:51.936502  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840e0e8b928b40ecab5e23c8ee0b22b3" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:51.938540  9113 leader_election.cc:290] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:51.948006  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:51.949919  1648 consensus_peers.cc:597] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:51.949288  1574 leader_election.cc:336] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.956811  1574 leader_election.cc:304] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:51.952294   431 tablet_replica.cc:333] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:51.958623   431 raft_consensus.cc:2243] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.960279  9113 raft_consensus.cc:2749] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:51.966100   431 raft_consensus.cc:2272] T 148d93cd579345f7bda3407d430fed95 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.964340  1574 leader_election.cc:336] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:51.988545  1574 leader_election.cc:304] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:51.989382  9113 raft_consensus.cc:2749] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:52.002738  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14d61cd3a034962afeaefb62f6d9986" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:04:52.008695  2176 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:51.987872   431 tablet_replica.cc:333] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:52.024426  1648 leader_election.cc:336] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.025139  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.027120  9167 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:52.028860  1648 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:52.017392   431 raft_consensus.cc:2243] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.041416   431 raft_consensus.cc:2272] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.042915  2176 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:52.044255   431 tablet_replica.cc:333] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.045137   431 raft_consensus.cc:2243] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.045735   431 raft_consensus.cc:2272] T 3db0d135af1343458208be9b79d66635 P f9fb126997be4ec79f8f60fcd6764b00 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.030682  1574 consensus_peers.cc:597] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.052431  1574 consensus_peers.cc:597] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.053006  1574 leader_election.cc:336] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.063959  9113 raft_consensus.cc:493] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:52.064604  9113 raft_consensus.cc:515] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.068926  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" candidate_uuid: "f9fb126997be4ec79f8f60fcd6764b00" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:52.070724  9113 leader_election.cc:290] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:52.071604  1574 leader_election.cc:304] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, e3ab72f324d545a6b4ecb1025df1f7c0
I20260709 13:04:52.072400  9113 raft_consensus.cc:2749] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:52.073778  1574 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0
W20260709 13:04:52.077431  1574 raft_consensus.cc:2686] T e14d61cd3a034962afeaefb62f6d9986 P f9fb126997be4ec79f8f60fcd6764b00: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:52.082986   431 tablet_replica.cc:333] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.090327   431 raft_consensus.cc:2243] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:52.086602  1648 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.093979  1648 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.100541  2176 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.102391  1574 consensus_peers.cc:597] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.104063  1574 consensus_peers.cc:597] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.124284  1574 leader_election.cc:336] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.124729  1574 leader_election.cc:304] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:52.125483  9113 raft_consensus.cc:2749] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:52.140867  1574 leader_election.cc:336] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.141484  1574 leader_election.cc:304] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9fb126997be4ec79f8f60fcd6764b00; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:52.146464  9113 raft_consensus.cc:2749] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:52.093209   431 raft_consensus.cc:2272] T 532c559048cc4785a9da4b7d8725f768 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.104662  9069 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.181445  9069 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:52.187389  9069 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:52.194830  2175 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.226260   431 tablet_replica.cc:333] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:52.228600  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 92101.8us
I20260709 13:04:52.232858  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:52.243278  2178 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.244196   431 raft_consensus.cc:2243] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.254105   431 raft_consensus.cc:2272] T 11658e0328124c609f964e633d7649bf P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.254709  9172 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:52.335564   431 tablet_replica.cc:333] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:52.336210  2176 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:52.343894  2176 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:52.347836   431 raft_consensus.cc:2243] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.351016   431 raft_consensus.cc:2272] T c56ae97ed5df4be18120cf680fd57f57 P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.349447  9174 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.394160  9174 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.397351  9174 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:52.370899  9167 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.398102  9167 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.400336  9167 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.341933  1648 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.401125  1648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 59251.4us
W20260709 13:04:52.402164  1648 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.402993  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:52.409313   431 tablet_replica.cc:333] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.424906   431 raft_consensus.cc:2243] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.429433   431 raft_consensus.cc:2272] T fac0c25895864a4e8a2926c7c5198ee7 P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.411489  2176 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:52.428457  1647 leader_election.cc:336] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.436599  1647 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.423588  1648 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:52.452690   431 tablet_replica.cc:333] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.460080  9174 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.460767   431 raft_consensus.cc:2243] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.458411  9167 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.467708   431 raft_consensus.cc:2272] T 5d54062a82c94b8c93a956fc9082a450 P f9fb126997be4ec79f8f60fcd6764b00 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.467994  9167 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:52.470515   431 tablet_replica.cc:333] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.470817  9167 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:52.460628  9174 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.471387   431 raft_consensus.cc:2243] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.487675  9174 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:52.491904   431 raft_consensus.cc:2272] T f2f5a84af4984d759b3126fa5852fb2e P f9fb126997be4ec79f8f60fcd6764b00 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.494953   431 tablet_replica.cc:333] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.499444   431 raft_consensus.cc:2243] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.500741   431 raft_consensus.cc:2272] T fb93316b761941d4be4cb8d1af0db97e P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.510923  2176 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:52.513373   431 tablet_replica.cc:333] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.514247   431 raft_consensus.cc:2243] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.514879   431 raft_consensus.cc:2272] T 840e0e8b928b40ecab5e23c8ee0b22b3 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.506160  1648 leader_election.cc:336] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.515666  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.519461  9167 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:52.520689  1648 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.523033  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.523794  9167 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:52.522576  1647 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.525964  1647 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.528321  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:52.529168  2212 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 28.
I20260709 13:04:52.517753   431 tablet_replica.cc:333] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.544169   431 raft_consensus.cc:2243] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.545490   431 raft_consensus.cc:2272] T 78a6859b4243476e8c4c421be70a6e19 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.552722   431 tablet_replica.cc:333] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.569123   431 raft_consensus.cc:2243] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.570391   431 raft_consensus.cc:2272] T 552871638635413bbd17d508b2a95e03 P f9fb126997be4ec79f8f60fcd6764b00 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.571668  1648 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.572183  1648 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.575901   431 tablet_replica.cc:333] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.576835   431 raft_consensus.cc:2243] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.577456  9167 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:04:52.578838  1648 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.579293   431 raft_consensus.cc:2272] T 1af5bea2a3c6428b9b6c07c96e3160ef P f9fb126997be4ec79f8f60fcd6764b00 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.582469   431 tablet_replica.cc:333] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.591661   431 raft_consensus.cc:2243] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.596683   431 raft_consensus.cc:2272] T 3f5eb582ff4540bb9b59540cc56f458a P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.579295  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.597621  9167 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:52.602385  9167 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.602933  9167 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.605260  9167 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.613889  1647 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.616261   431 tablet_replica.cc:333] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.617120   431 raft_consensus.cc:2243] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.617744   431 raft_consensus.cc:2272] T 73161049b574469ea08e360e2def1aac P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.654968  1648 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.656518  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.656102   431 tablet_replica.cc:333] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.657961   431 raft_consensus.cc:2243] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.658944  9112 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:52.663952   431 raft_consensus.cc:2272] T 5396b1c71261414f9ca554acc690f489 P f9fb126997be4ec79f8f60fcd6764b00 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.677790  1648 consensus_peers.cc:597] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:52.688608   431 tablet_replica.cc:333] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.689764   431 raft_consensus.cc:2243] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.695307  9179 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.695895  9179 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:52.702831  9112 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.703388  9112 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:52.706938  2175 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.707746  9112 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.709395  1647 leader_election.cc:336] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.708840  9179 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.708410  2176 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.711755  2176 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.712261   431 raft_consensus.cc:2272] T cbe9105bf6ce4e118b6b4a3135515534 P f9fb126997be4ec79f8f60fcd6764b00 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:52.713546  9179 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:52.717584  2176 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:52.726650   431 tablet_replica.cc:333] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.730365   431 raft_consensus.cc:2243] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:52.733808   431 raft_consensus.cc:2272] T fbbc977cdccf4f338a0e97226117c985 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.732589  1648 leader_election.cc:336] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.736475  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.739535  9112 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:52.744160  9167 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.744740  9167 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.746943  9167 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.767722  1647 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.777187  1647 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:52.780287   431 tablet_replica.cc:333] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
I20260709 13:04:52.795704   431 raft_consensus.cc:2243] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:52.813773   431 raft_consensus.cc:2272] T 1665355552db4e4e97ba80c516768367 P f9fb126997be4ec79f8f60fcd6764b00 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.807534  2175 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:52.819754   431 tablet_replica.cc:333] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00: stopping tablet replica
W20260709 13:04:52.806690  1647 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:52.826522  9112 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.832700  9112 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.835584  9112 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:52.830881  9167 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.840549   431 raft_consensus.cc:2243] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:52.841104  1648 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.837745  9167 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.843495  9167 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:52.841576  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.844715  9167 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:52.849395  9167 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.850031  9167 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.852530  9167 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:52.852766  1647 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.861619  1647 consensus_peers.cc:597] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.861681  1648 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.862455  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.863281  9167 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:52.864544  1648 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:52.866011  1647 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.866438  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.867228  9167 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:52.860387   431 raft_consensus.cc:2272] T f2343c932afb4d9aaa361b1e57330e8e P f9fb126997be4ec79f8f60fcd6764b00 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:52.870661  1648 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:52.882838  2176 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:52.884423  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:52.885316  1647 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.885823  1647 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.886704  9167 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:52.946393  9167 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.946918  9167 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:52.947988  9174 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:52.948578  9174 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:52.949421  9167 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:52.950526  9174 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:52.956513  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:04:52.963277  1647 leader_election.cc:336] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:52.963811  1647 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.964644  9112 raft_consensus.cc:2749] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:52.964766  1647 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:52.967597  1647 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.968358  1648 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:52.968830  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:52.969986  9167 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:04:52.978749  1647 consensus_peers.cc:597] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.004408  9167 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.005136  9167 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.009555  9167 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:53.012591  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:04:53.017132  1647 connection.cc:769] client connection to 127.0.107.194:33801 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:04:53.025211  1647 leader_election.cc:336] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.025753  1647 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.027495  9167 raft_consensus.cc:2749] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:53.036377  9179 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.036917  9179 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:53.047328  2175 leader_election.cc:336] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.055814  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:53.056556  1676 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 26.
I20260709 13:04:53.058017  2178 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.058956  9178 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:04:53.059338  9178 raft_consensus.cc:493] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.059675  9178 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:53.069162  9179 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:53.071038  9178 raft_consensus.cc:515] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:53.078326  2175 leader_election.cc:336] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.084687  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5174ec6bd2452abb5d7617555ce4f7" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:53.085376  1676 raft_consensus.cc:3060] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:04:53.102373  2175 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.111932  1676 raft_consensus.cc:2468] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 27.
I20260709 13:04:53.114284  2178 leader_election.cc:304] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.115290  9179 raft_consensus.cc:2804] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:04:53.118031  9179 raft_consensus.cc:697] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 27 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:53.119211  9179 consensus_queue.cc:237] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.112623  9178 leader_election.cc:290] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 27 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:53.157370  9172 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.158089  9172 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.160620  9172 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:53.161312  1647 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.161864  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:53.162698  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 22.
I20260709 13:04:53.167685  2178 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
W20260709 13:04:53.168648  2175 leader_election.cc:336] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.168782  9172 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:53.169289  9172 raft_consensus.cc:493] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.169647  9172 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:53.178447  9172 raft_consensus.cc:515] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.202865  1432 catalog_manager.cc:5697] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 26 to 27, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 27 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:53.213122  1647 consensus_peers.cc:597] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.215317  9172 leader_election.cc:290] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:53.217478  1647 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.210803  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9463f88e50794193abace66439f1975b" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
W20260709 13:04:53.213948  2175 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.222954  1676 raft_consensus.cc:3060] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:53.223768  2175 leader_election.cc:336] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:53.226150  1647 consensus_peers.cc:597] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.245730  1676 raft_consensus.cc:2468] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 23.
I20260709 13:04:53.248703  2178 leader_election.cc:304] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.249504  9172 raft_consensus.cc:2804] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:53.250017  9172 raft_consensus.cc:697] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:53.251101  9172 consensus_queue.cc:237] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:53.254900  2175 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.255893  1647 consensus_peers.cc:597] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.265520  9167 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.266224  9167 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:53.269407  9167 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.273016  2175 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.274411  1648 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:53.286830  9167 raft_consensus.cc:493] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.288489  9167 raft_consensus.cc:515] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:53.287734  1647 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.290586  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.291400  9112 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:53.292881  9167 leader_election.cc:290] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.302013  1648 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:53.302160  1647 consensus_peers.cc:597] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.308323  1647 leader_election.cc:336] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.308964  1647 leader_election.cc:304] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.309873  9112 raft_consensus.cc:2749] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:04:53.339380  1647 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.382441  1429 catalog_manager.cc:5697] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 22 to 23, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:53.385561  2175 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.405761  1647 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.417692  1647 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.424337  2176 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:53.524590  1647 consensus_peers.cc:597] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.534775  2175 consensus_peers.cc:597] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:53.537551  1647 consensus_peers.cc:597] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.538223  1647 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.551100  9167 raft_consensus.cc:493] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.551640  9167 raft_consensus.cc:515] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:53.553900  9167 leader_election.cc:290] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:53.559237  9172 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
W20260709 13:04:53.561360  1648 leader_election.cc:336] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:53.562530  1647 leader_election.cc:336] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.562994  1647 leader_election.cc:304] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.563820  9112 raft_consensus.cc:2749] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:53.559885  9172 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.568181  9172 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:53.570341  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
W20260709 13:04:53.576273  2175 leader_election.cc:336] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.576785  2175 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.577569  9172 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:53.592396  1647 consensus_peers.cc:597] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.597959  1647 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.614504  1647 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.630976  9112 raft_consensus.cc:493] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.631543  9112 raft_consensus.cc:515] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:53.633734  9112 leader_election.cc:290] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.642160  1647 leader_election.cc:336] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:53.643141  1648 leader_election.cc:336] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:53.643605  1648 leader_election.cc:304] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.644333  9112 raft_consensus.cc:2749] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:53.662662  9112 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.663235  9112 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.665385  9112 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:53.668597  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
W20260709 13:04:53.673195  1647 leader_election.cc:336] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.673678  1647 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: e3ab72f324d545a6b4ecb1025df1f7c0, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.674407  9112 raft_consensus.cc:2749] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:53.677271  1648 consensus_peers.cc:597] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:53.696461  9167 raft_consensus.cc:493] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.697119  9167 raft_consensus.cc:515] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:53.701814  1676 raft_consensus.cc:1275] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:04:53.702996  9167 leader_election.cc:290] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:53.711031  9172 consensus_queue.cc:1048] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:04:53.716859  1647 leader_election.cc:336] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:53.728641  1648 leader_election.cc:336] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:53.729175  1648 leader_election.cc:304] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.729969  9190 raft_consensus.cc:2749] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:53.769166  1683 raft_consensus.cc:1275] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:53.770643  9179 consensus_queue.cc:1048] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:53.777599  9178 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.778133  9178 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.780627  9178 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.790138  2175 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:53.807559  2176 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:53.808137  2176 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.808921  9179 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:53.825063  9179 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.825654  9179 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.829025  9112 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.829648  9112 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.835143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e" is_pre_election: true
I20260709 13:04:53.835887  1683 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 20.
I20260709 13:04:53.831679  9112 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:53.837121  2178 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:53.838110  9178 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:53.838502  9178 raft_consensus.cc:493] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.838901  9178 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:53.840380  1647 leader_election.cc:336] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.845566  9179 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:53.866487  9179 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.867103  9179 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.869773  9179 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.870728  2175 consensus_peers.cc:597] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:53.871732  2175 leader_election.cc:336] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.890111  2212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:53.890889  2212 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 17.
I20260709 13:04:53.852085  9178 raft_consensus.cc:515] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.898830  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a6859b4243476e8c4c421be70a6e19" candidate_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6031790cc44edfba5c3964e6f27c6e"
I20260709 13:04:53.899456  1683 raft_consensus.cc:3060] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:53.908411  1683 raft_consensus.cc:2468] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ab72f324d545a6b4ecb1025df1f7c0 in term 21.
I20260709 13:04:53.909662  2178 leader_election.cc:304] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 
I20260709 13:04:53.910522  9172 raft_consensus.cc:2804] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:53.920425  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:53.921954  9190 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:53.922504  9190 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.922946  9190 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.934978  9178 leader_election.cc:290] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:53.946903  9172 raft_consensus.cc:697] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Becoming Leader. State: Replica: e3ab72f324d545a6b4ecb1025df1f7c0, State: Running, Role: LEADER
I20260709 13:04:53.947999  9172 consensus_queue.cc:237] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:53.952416  9112 raft_consensus.cc:493] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:53.953123  9112 raft_consensus.cc:515] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:53.955368  9112 leader_election.cc:290] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:53.960235  2175 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.931303  9190 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:53.968003  2175 leader_election.cc:336] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:53.969770  1648 leader_election.cc:336] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:53.988188  1647 leader_election.cc:336] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.992570  1647 leader_election.cc:304] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:54.004678  1647 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111) [suppressed 645 similar messages]
I20260709 13:04:54.007294  9167 raft_consensus.cc:2749] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:54.002381  1429 catalog_manager.cc:5697] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 reported cstate change: term changed from 20 to 21, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:54.024725  1647 leader_election.cc:336] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:53.969736  9190 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Requested vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
W20260709 13:04:53.980011  2176 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.035351  2176 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.036913  9172 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:54.038388  2176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34325, user_credentials={real_user=slave}} blocked reactor thread for 58434.8us
I20260709 13:04:54.073987  2211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ae97ed5df4be18120cf680fd57f57" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0"
I20260709 13:04:54.074882  2211 raft_consensus.cc:3060] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.107179  2211 raft_consensus.cc:2468] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 18.
W20260709 13:04:54.137830  1648 consensus_peers.cc:597] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.143693  9112 raft_consensus.cc:493] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.144258  9112 raft_consensus.cc:515] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.146481  9112 leader_election.cc:290] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.153690  1647 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.161088  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.167621  1648 leader_election.cc:336] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.168175  1648 leader_election.cc:304] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.170260  9112 raft_consensus.cc:2749] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:54.173941  1648 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e, e3ab72f324d545a6b4ecb1025df1f7c0; no voters: f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.174721  9190 raft_consensus.cc:2804] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:54.175238  9190 raft_consensus.cc:697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Becoming Leader. State: Replica: 8c6031790cc44edfba5c3964e6f27c6e, State: Running, Role: LEADER
I20260709 13:04:54.176131  9190 consensus_queue.cc:237] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:54.180855  1648 consensus_peers.cc:597] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.184299  1648 consensus_peers.cc:597] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.199059  1648 consensus_peers.cc:597] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.205839  1429 catalog_manager.cc:5697] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e reported cstate change: term changed from 17 to 18, leader changed from f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194) to 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195). New cstate: current_term: 18 leader_uuid: "8c6031790cc44edfba5c3964e6f27c6e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:54.229140  1648 consensus_peers.cc:597] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.323269  9112 raft_consensus.cc:493] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.323791  9112 raft_consensus.cc:515] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.326164  9112 leader_election.cc:290] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.336479  1647 leader_election.cc:336] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.340924  1648 leader_election.cc:336] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.341403  1648 leader_election.cc:304] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.344754  9190 raft_consensus.cc:2749] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:54.365932  1648 consensus_peers.cc:597] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:54.368166  9167 raft_consensus.cc:493] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.368786  9167 raft_consensus.cc:515] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.370803  9167 leader_election.cc:290] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.375506  2175 consensus_peers.cc:597] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:54.379096  1647 leader_election.cc:336] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.381850  1648 leader_election.cc:336] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.382318  1648 leader_election.cc:304] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.383307  9167 raft_consensus.cc:2749] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:54.383333  1648 consensus_peers.cc:597] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.391342  9167 raft_consensus.cc:493] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.398752  9167 raft_consensus.cc:515] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.407573  9167 leader_election.cc:290] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.408806  1647 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.418344  1648 leader_election.cc:336] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.419157  1648 leader_election.cc:304] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:54.422081  1648 consensus_peers.cc:597] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:54.422271  9167 raft_consensus.cc:2749] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:54.428560  9167 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.429148  9167 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:54.437801  1648 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:54.443301  1647 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.443800  1647 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.447846  9112 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:54.449599  9167 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), e3ab72f324d545a6b4ecb1025df1f7c0 (127.0.107.196:39631)
I20260709 13:04:54.451061  2206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208506ca334e4441af10e7c0e8432dbe" candidate_uuid: "8c6031790cc44edfba5c3964e6f27c6e" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" is_pre_election: true
I20260709 13:04:54.451860  2206 raft_consensus.cc:2468] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6031790cc44edfba5c3964e6f27c6e in term 28.
I20260709 13:04:54.453785   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:54.476377  2176 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.524699  1683 raft_consensus.cc:1275] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Refusing update from remote peer e3ab72f324d545a6b4ecb1025df1f7c0: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:04:54.526614  9195 consensus_queue.cc:1048] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:04:54.527709  1648 consensus_peers.cc:597] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.539057  9195 raft_consensus.cc:493] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.539754  9195 raft_consensus.cc:515] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:54.541728  1648 consensus_peers.cc:597] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.554333  9195 leader_election.cc:290] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.597308  2175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33801, user_credentials={real_user=slave}} blocked reactor thread for 49090us
I20260709 13:04:54.598392  9190 raft_consensus.cc:493] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.599014  9190 raft_consensus.cc:515] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:54.605208  2176 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.605214  9190 leader_election.cc:290] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.608659  2175 leader_election.cc:336] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.609511  2175 leader_election.cc:304] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:54.614162  2178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43535, user_credentials={real_user=slave}} blocked reactor thread for 66267.6us
W20260709 13:04:54.618402  1647 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.622889  9195 raft_consensus.cc:2749] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:54.625242  2176 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.638366  1648 consensus_peers.cc:597] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.638926  1648 leader_election.cc:336] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.639441  1648 leader_election.cc:304] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
W20260709 13:04:54.639745  2176 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.640609  1648 consensus_peers.cc:597] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:54.644979  9203 raft_consensus.cc:2749] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:54.640760  9190 raft_consensus.cc:493] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.647166  9190 raft_consensus.cc:515] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
W20260709 13:04:54.651993  1647 consensus_peers.cc:597] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:54.653841  9190 leader_election.cc:290] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.662166  1647 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.668670  9190 raft_consensus.cc:493] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.669348  9190 raft_consensus.cc:515] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.671447  9190 leader_election.cc:290] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.679131  1647 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.684270  2176 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.688230  1648 consensus_peers.cc:597] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:54.688796  1648 leader_election.cc:336] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.689208  1648 leader_election.cc:304] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.690003  9112 raft_consensus.cc:2749] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:54.690488  1648 consensus_peers.cc:597] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.690984  1648 consensus_peers.cc:597] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:54.691370  1648 leader_election.cc:336] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.691756  1648 leader_election.cc:304] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.692557  9112 raft_consensus.cc:2749] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:54.700381  2206 raft_consensus.cc:1275] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Refusing update from remote peer 8c6031790cc44edfba5c3964e6f27c6e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:04:54.702455  9112 consensus_queue.cc:1048] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:54.745697   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:54.760636  2178 consensus_peers.cc:597] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:54.780876  9112 raft_consensus.cc:493] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.781597  9112 raft_consensus.cc:515] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.783988  9112 leader_election.cc:290] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.791025  1647 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.794019  1648 leader_election.cc:336] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.794438  1648 leader_election.cc:304] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.796518  9206 raft_consensus.cc:2749] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:54.817734  9112 raft_consensus.cc:493] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.818246  9112 raft_consensus.cc:515] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.829808  9112 leader_election.cc:290] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.835275  1647 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:54.842600  2176 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:54.843327  1648 leader_election.cc:336] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.843964  1648 leader_election.cc:304] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.844679  9112 raft_consensus.cc:2749] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:54.853591  1648 consensus_peers.cc:597] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.871372   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:54.874711   431 tablet_replica.cc:333] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.875653   431 raft_consensus.cc:2243] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.877097   431 raft_consensus.cc:2272] T baf31533a97f4325919d60e19d73b3f2 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.880213   431 tablet_replica.cc:333] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.890421   431 raft_consensus.cc:2243] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.891530   431 raft_consensus.cc:2272] T b748cae74bbb4bdc9765bc293b0b6702 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.892351  9112 raft_consensus.cc:493] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.892817  9112 raft_consensus.cc:515] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.894420   431 tablet_replica.cc:333] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
W20260709 13:04:54.901029  1648 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.895042  9112 leader_election.cc:290] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.908612  2178 consensus_peers.cc:597] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:54.908684  9112 raft_consensus.cc:493] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:54.909328   431 raft_consensus.cc:2243] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.909385  9112 raft_consensus.cc:515] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } }
I20260709 13:04:54.910313   431 raft_consensus.cc:2272] T 4fb69c6ea77a4b5680f9f2b453332415 P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.912048  9112 leader_election.cc:290] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:54.908654  1647 leader_election.cc:336] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.913245  1647 leader_election.cc:304] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.915323  9190 raft_consensus.cc:2749] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:54.916386  1648 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:54.921054   431 tablet_replica.cc:333] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.922039   431 raft_consensus.cc:2243] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.922781   431 raft_consensus.cc:2272] T 32221e86161141d39327e18efdbbb226 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.925529   431 tablet_replica.cc:333] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.926326   431 raft_consensus.cc:2243] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.927268   431 raft_consensus.cc:2272] T 208506ca334e4441af10e7c0e8432dbe P 8c6031790cc44edfba5c3964e6f27c6e [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:54.927722  1647 leader_election.cc:336] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:54.928221  1647 leader_election.cc:304] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6031790cc44edfba5c3964e6f27c6e; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:54.929800  9112 raft_consensus.cc:2749] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:54.931290   431 tablet_replica.cc:333] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
W20260709 13:04:54.936154  2178 consensus_peers.cc:597] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:54.937983  2176 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:54.939553   431 raft_consensus.cc:2243] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.940965   431 raft_consensus.cc:2272] T 9a39df5ae9144c118d4158b68b17044c P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.943933   431 tablet_replica.cc:333] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.945245   431 raft_consensus.cc:2243] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.946008   431 raft_consensus.cc:2272] T bb1b18d08269419485367169ac7d79c5 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.949229   431 tablet_replica.cc:333] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.950139   431 raft_consensus.cc:2243] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.950826   431 raft_consensus.cc:2272] T d9a84223e947489c829c528c860660d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.954569   431 tablet_replica.cc:333] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.957072   431 raft_consensus.cc:2243] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.958119   431 raft_consensus.cc:2272] T e7f600ce14224412994ac233d95d67d1 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.960943   431 tablet_replica.cc:333] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.961813   431 raft_consensus.cc:2243] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.962432   431 raft_consensus.cc:2272] T 891c34d92ded4b85948a508cf94b612c P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.965394   431 tablet_replica.cc:333] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.966212   431 raft_consensus.cc:2243] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.966802   431 raft_consensus.cc:2272] T 8cee4cb45f7c44278850093451991c78 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.969565   431 tablet_replica.cc:333] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.970377   431 raft_consensus.cc:2243] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.970942   431 raft_consensus.cc:2272] T 4b6b1fc817984924ac96a7a2a29d76de P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.973659   431 tablet_replica.cc:333] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.974390   431 raft_consensus.cc:2243] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.974941   431 raft_consensus.cc:2272] T bc704e97e2774b19b6d4867b31f50723 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.986294   431 tablet_replica.cc:333] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.987059   431 raft_consensus.cc:2243] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.988646   431 raft_consensus.cc:2272] T 0f31cf514617428594649c1ecf3b2547 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.992506   431 tablet_replica.cc:333] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.993366   431 raft_consensus.cc:2243] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.994446   431 raft_consensus.cc:2272] T 8501e8317ed348cca428d77d106f937c P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.997222   431 tablet_replica.cc:333] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:54.997993   431 raft_consensus.cc:2243] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:54.998275  2176 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:54.998693   431 raft_consensus.cc:2272] T 1d5174ec6bd2452abb5d7617555ce4f7 P 8c6031790cc44edfba5c3964e6f27c6e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.003031   431 tablet_replica.cc:333] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.003831   431 raft_consensus.cc:2243] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.004439   431 raft_consensus.cc:2272] T ace772102403442daf5f360432c323e9 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.007026   431 tablet_replica.cc:333] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.007782   431 raft_consensus.cc:2243] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.008873   431 raft_consensus.cc:2272] T 3db5c09b405c47f6a1aaa189b76a0002 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.011374   431 tablet_replica.cc:333] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.012187   431 raft_consensus.cc:2243] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.012774   431 raft_consensus.cc:2272] T 5adb51b03e1142c4b3d2fe81051fecb9 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.015686   431 tablet_replica.cc:333] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.016674   431 raft_consensus.cc:2243] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.018046   431 raft_consensus.cc:2272] T eca33b3bd986485893d6724a68cb2430 P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.020452   431 tablet_replica.cc:333] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.021214   431 raft_consensus.cc:2243] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.021790   431 raft_consensus.cc:2272] T fb93316b761941d4be4cb8d1af0db97e P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.024585   431 tablet_replica.cc:333] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.025502   431 raft_consensus.cc:2243] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.026072   431 raft_consensus.cc:2272] T f2f5a84af4984d759b3126fa5852fb2e P 8c6031790cc44edfba5c3964e6f27c6e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.028725   431 tablet_replica.cc:333] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.029641   431 raft_consensus.cc:2243] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.030423   431 raft_consensus.cc:2272] T 0246a4c90f2b48c5a3a10ad330723a67 P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:55.033449  2178 consensus_peers.cc:597] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:55.038244   431 tablet_replica.cc:333] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.039254   431 raft_consensus.cc:2243] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.040728   431 raft_consensus.cc:2272] T 3ba1b10b23d84716ad2e0452649e214e P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.043263   431 tablet_replica.cc:333] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.044240   431 raft_consensus.cc:2243] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.050287   431 raft_consensus.cc:2272] T 11e72d8320164ed18fc7fccba3a0ecd3 P 8c6031790cc44edfba5c3964e6f27c6e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.053153   431 tablet_replica.cc:333] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.054356   431 raft_consensus.cc:2243] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.055498   431 raft_consensus.cc:2272] T 69addfec4f4248bbabd86bd0f93ae32d P 8c6031790cc44edfba5c3964e6f27c6e [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.058271   431 tablet_replica.cc:333] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.059479   431 raft_consensus.cc:2243] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.060184   431 raft_consensus.cc:2272] T 9463f88e50794193abace66439f1975b P 8c6031790cc44edfba5c3964e6f27c6e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.062858   431 tablet_replica.cc:333] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.063655   431 raft_consensus.cc:2243] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.064309   431 raft_consensus.cc:2272] T 57c2065ad5cf4ab19e1aabd16c64fe95 P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.066936   431 tablet_replica.cc:333] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.067950   431 raft_consensus.cc:2243] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.069096   431 raft_consensus.cc:2272] T 5ea2020c26814418b630a447fc961d07 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.074545   431 tablet_replica.cc:333] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.075356   431 raft_consensus.cc:2243] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.076416   431 raft_consensus.cc:2272] T 5df6a74dd4014d38b1b536f6b0fc66ec P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.079005   431 tablet_replica.cc:333] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.079875   431 raft_consensus.cc:2243] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.080528   431 raft_consensus.cc:2272] T 6d6c985edaa245138167af8ae5b22067 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.089573   431 tablet_replica.cc:333] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.090448   431 raft_consensus.cc:2243] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.091552   431 raft_consensus.cc:2272] T 3db0d135af1343458208be9b79d66635 P 8c6031790cc44edfba5c3964e6f27c6e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.094425   431 tablet_replica.cc:333] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.095232   431 raft_consensus.cc:2243] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.096382   431 raft_consensus.cc:2272] T 532c559048cc4785a9da4b7d8725f768 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.099282   431 tablet_replica.cc:333] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.100067   431 raft_consensus.cc:2243] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.101897   431 raft_consensus.cc:2272] T 3f5eb582ff4540bb9b59540cc56f458a P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.105736   431 tablet_replica.cc:333] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.106499   431 raft_consensus.cc:2243] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.107916   431 raft_consensus.cc:2272] T 5396b1c71261414f9ca554acc690f489 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.110812   431 tablet_replica.cc:333] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.111596   431 raft_consensus.cc:2243] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.112200   431 raft_consensus.cc:2272] T 11658e0328124c609f964e633d7649bf P 8c6031790cc44edfba5c3964e6f27c6e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.114807   431 tablet_replica.cc:333] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.115561   431 raft_consensus.cc:2243] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.116209   431 raft_consensus.cc:2272] T f66f028938a14af4a39a0e553938682b P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.118753   431 tablet_replica.cc:333] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.119464   431 raft_consensus.cc:2243] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.127151   431 raft_consensus.cc:2272] T c56ae97ed5df4be18120cf680fd57f57 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.142993   431 tablet_replica.cc:333] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.143795   431 raft_consensus.cc:2243] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.145085   431 raft_consensus.cc:2272] T 1845d3b47c5e4111a5c3c8f4e5de74ae P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.160382   431 tablet_replica.cc:333] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.161231   431 raft_consensus.cc:2243] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.161952   431 raft_consensus.cc:2272] T 148d93cd579345f7bda3407d430fed95 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.164817   431 tablet_replica.cc:333] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.165586   431 raft_consensus.cc:2243] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.166713   431 raft_consensus.cc:2272] T e14d61cd3a034962afeaefb62f6d9986 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.169672   431 tablet_replica.cc:333] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.170408   431 raft_consensus.cc:2243] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.171486   431 raft_consensus.cc:2272] T fac0c25895864a4e8a2926c7c5198ee7 P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.174185   431 tablet_replica.cc:333] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.174990   431 raft_consensus.cc:2243] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.176229   431 raft_consensus.cc:2272] T c4443c0ffc3140788a1384ff8bc1b047 P 8c6031790cc44edfba5c3964e6f27c6e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.178845   431 tablet_replica.cc:333] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.179534   431 raft_consensus.cc:2243] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.180747   431 raft_consensus.cc:2272] T 1665355552db4e4e97ba80c516768367 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.183420   431 tablet_replica.cc:333] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.184299   431 raft_consensus.cc:2243] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.185370   431 raft_consensus.cc:2272] T f2343c932afb4d9aaa361b1e57330e8e P 8c6031790cc44edfba5c3964e6f27c6e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.187963   431 tablet_replica.cc:333] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.188777   431 raft_consensus.cc:2243] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.190793   431 raft_consensus.cc:2272] T d501527377474732bddb08ed904bd34d P 8c6031790cc44edfba5c3964e6f27c6e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.193533   431 tablet_replica.cc:333] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.194243   431 raft_consensus.cc:2243] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.195267   431 raft_consensus.cc:2272] T 840e0e8b928b40ecab5e23c8ee0b22b3 P 8c6031790cc44edfba5c3964e6f27c6e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.197939   431 tablet_replica.cc:333] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.198608   431 raft_consensus.cc:2243] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.199281   431 raft_consensus.cc:2272] T 552871638635413bbd17d508b2a95e03 P 8c6031790cc44edfba5c3964e6f27c6e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.202129   431 tablet_replica.cc:333] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.202853   431 raft_consensus.cc:2243] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:55.203672   431 raft_consensus.cc:2272] T 78a6859b4243476e8c4c421be70a6e19 P 8c6031790cc44edfba5c3964e6f27c6e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:55.207082   431 tablet_replica.cc:333] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e: stopping tablet replica
I20260709 13:04:55.207746   431 raft_consensus.cc:2243] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:55.208905   431 raft_consensus.cc:2272] T 443ffcfd9be74d9891a8cb9596947ca3 P 8c6031790cc44edfba5c3964e6f27c6e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:55.213582  2178 consensus_peers.cc:597] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:55.216923  2178 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:55.227051  2176 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:55.255116  2176 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:55.264734  2178 consensus_peers.cc:597] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:55.267838  2175 consensus_peers.cc:597] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:55.331244  2178 consensus_peers.cc:597] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Couldn't send request to peer 8c6031790cc44edfba5c3964e6f27c6e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:55.599885  2175 consensus_peers.cc:597] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:55.729162  9208 raft_consensus.cc:493] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:55.729746  9208 raft_consensus.cc:515] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:55.731765  9208 leader_election.cc:290] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
W20260709 13:04:55.746706  2175 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:55.749862  2176 leader_election.cc:336] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:55.750330  2176 leader_election.cc:304] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:55.751055  9214 raft_consensus.cc:2749] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:55.817533  2175 consensus_peers.cc:597] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:55.819417  2175 consensus_peers.cc:597] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:55.866250  2176 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:55.878392  2175 consensus_peers.cc:597] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:55.948596  2175 consensus_peers.cc:597] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:55.951354  2175 consensus_peers.cc:597] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:56.172690  9208 raft_consensus.cc:493] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.174656  9207 raft_consensus.cc:493] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.174232  9208 raft_consensus.cc:515] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.175689  9207 raft_consensus.cc:515] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.181538  9208 leader_election.cc:290] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.184620  2176 leader_election.cc:336] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:56.185940  2175 leader_election.cc:336] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:56.186474  2178 leader_election.cc:336] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.186921  2178 leader_election.cc:304] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:56.187582  9207 leader_election.cc:290] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:56.189203  9213 raft_consensus.cc:2749] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:56.194507  2178 leader_election.cc:336] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.195071  2178 leader_election.cc:304] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.195822  9208 raft_consensus.cc:2749] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:56.233429  9208 raft_consensus.cc:493] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:56.234719  9208 raft_consensus.cc:515] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.238535  9213 raft_consensus.cc:493] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.239511  9213 raft_consensus.cc:515] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.242190  9213 leader_election.cc:290] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:56.243496  9213 raft_consensus.cc:493] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
W20260709 13:04:56.243554  2175 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:56.244141  9208 leader_election.cc:290] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801)
I20260709 13:04:56.244819  9213 raft_consensus.cc:515] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:56.252171  2176 leader_election.cc:336] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:56.252673  2176 leader_election.cc:304] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.253466  9208 raft_consensus.cc:2749] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:56.254421  2176 leader_election.cc:336] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:56.256454  9213 leader_election.cc:290] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.259778  2178 leader_election.cc:336] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.260607  2178 leader_election.cc:304] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:56.263023  9213 raft_consensus.cc:2749] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:04:56.263926  2178 leader_election.cc:336] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
W20260709 13:04:56.265442  2175 leader_election.cc:336] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:56.265856  2175 leader_election.cc:304] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.266639  9213 raft_consensus.cc:2749] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:56.293502  9208 raft_consensus.cc:493] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.294420  9213 raft_consensus.cc:493] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.294333  9208 raft_consensus.cc:515] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.295276  9213 raft_consensus.cc:515] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.296952  9208 leader_election.cc:290] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:56.300364  9213 leader_election.cc:290] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.305922  2176 leader_election.cc:336] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:56.306479  2176 consensus_peers.cc:597] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Couldn't send request to peer 36f53e9bfce749bbba4a4b34829f563d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:56.309787  9213 raft_consensus.cc:493] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f9fb126997be4ec79f8f60fcd6764b00)
I20260709 13:04:56.310804  9213 raft_consensus.cc:515] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } attrs { replace: true } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.313824  9213 leader_election.cc:290] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.313894  2178 leader_election.cc:336] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
W20260709 13:04:56.316984  2178 leader_election.cc:336] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
W20260709 13:04:56.317706  2175 leader_election.cc:336] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:56.318208  2175 leader_election.cc:304] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.317885  2178 leader_election.cc:304] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:56.318955  9208 raft_consensus.cc:2749] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:56.319491  9207 raft_consensus.cc:2749] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:56.321766  9207 raft_consensus.cc:493] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.322608  9207 raft_consensus.cc:515] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.325094  9207 leader_election.cc:290] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.333618  2176 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
W20260709 13:04:56.334228  2176 leader_election.cc:336] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:56.335631  9213 raft_consensus.cc:493] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.336534  9213 raft_consensus.cc:515] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
W20260709 13:04:56.340881  2175 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:56.341342  2175 leader_election.cc:304] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.342046  9207 raft_consensus.cc:2749] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:04:56.344234  2178 leader_election.cc:336] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
W20260709 13:04:56.345113  2178 leader_election.cc:336] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.345285  9213 leader_election.cc:290] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
I20260709 13:04:56.345495  2178 leader_election.cc:304] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 36f53e9bfce749bbba4a4b34829f563d, 8c6031790cc44edfba5c3964e6f27c6e
I20260709 13:04:56.347734  9213 raft_consensus.cc:2749] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:56.350656  2175 leader_election.cc:336] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:56.354820  2178 leader_election.cc:336] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.355358  2178 leader_election.cc:304] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.356195  9213 raft_consensus.cc:2749] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:56.364830  9213 raft_consensus.cc:493] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.365711  9213 raft_consensus.cc:515] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.368009  9213 leader_election.cc:290] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.371759  2175 leader_election.cc:336] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:56.372659  2178 leader_election.cc:336] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.373208  2178 leader_election.cc:304] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.373982  9213 raft_consensus.cc:2749] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.388429  9207 raft_consensus.cc:493] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.389341  9207 raft_consensus.cc:515] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.391839  9207 leader_election.cc:290] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.398039  2175 leader_election.cc:336] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
W20260709 13:04:56.401216  2178 leader_election.cc:336] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
I20260709 13:04:56.401676  2178 leader_election.cc:304] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.402496  9213 raft_consensus.cc:2749] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:56.492420  9213 raft_consensus.cc:493] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6031790cc44edfba5c3964e6f27c6e)
I20260709 13:04:56.493466  9213 raft_consensus.cc:515] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: false } }
I20260709 13:04:56.495806   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:56.495934  9213 leader_election.cc:290] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801), 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535)
W20260709 13:04:56.501519  2178 leader_election.cc:336] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8c6031790cc44edfba5c3964e6f27c6e (127.0.107.195:43535): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43535: connect: Connection refused (error 111)
W20260709 13:04:56.505389  2175 leader_election.cc:336] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111)
I20260709 13:04:56.505944  2175 leader_election.cc:304] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ab72f324d545a6b4ecb1025df1f7c0; no voters: 8c6031790cc44edfba5c3964e6f27c6e, f9fb126997be4ec79f8f60fcd6764b00
I20260709 13:04:56.506919  9213 raft_consensus.cc:2749] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:56.589293  2175 consensus_peers.cc:597] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 -> Peer f9fb126997be4ec79f8f60fcd6764b00 (127.0.107.194:33801): Couldn't send request to peer f9fb126997be4ec79f8f60fcd6764b00. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:56.669659   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:04:56.684314  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080000a440 after lost signal to thread 434
W20260709 13:04:56.686060  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080032ce80 after lost signal to thread 1467
W20260709 13:04:56.688589  1464 debug-util.cc:398] Leaking SignalData structure 0x7b080010c740 after lost signal to thread 2236
I20260709 13:04:56.723376   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:56.724778   431 tablet_replica.cc:333] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.726533   431 raft_consensus.cc:2243] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.727926   431 raft_consensus.cc:2272] T 208506ca334e4441af10e7c0e8432dbe P e3ab72f324d545a6b4ecb1025df1f7c0 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.732372   431 tablet_replica.cc:333] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.733702   431 raft_consensus.cc:2243] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.735648   431 raft_consensus.cc:2272] T cbe9105bf6ce4e118b6b4a3135515534 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.739719   431 tablet_replica.cc:333] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.740995   431 raft_consensus.cc:2243] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.742797   431 raft_consensus.cc:2272] T fbbc977cdccf4f338a0e97226117c985 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.747505   431 tablet_replica.cc:333] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.748706   431 raft_consensus.cc:2243] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.750146   431 raft_consensus.cc:2272] T 5df6a74dd4014d38b1b536f6b0fc66ec P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.753846   431 tablet_replica.cc:333] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.754807   431 raft_consensus.cc:2243] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.756283   431 raft_consensus.cc:2272] T bc704e97e2774b19b6d4867b31f50723 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.760185   431 tablet_replica.cc:333] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.761416   431 raft_consensus.cc:2243] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.762795   431 raft_consensus.cc:2272] T 9463f88e50794193abace66439f1975b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.766613   431 tablet_replica.cc:333] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.767432   431 raft_consensus.cc:2243] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.768908   431 raft_consensus.cc:2272] T c4443c0ffc3140788a1384ff8bc1b047 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.772581   431 tablet_replica.cc:333] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.773393   431 raft_consensus.cc:2243] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.774501   431 raft_consensus.cc:2272] T 5d54062a82c94b8c93a956fc9082a450 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.778167   431 tablet_replica.cc:333] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.778790   431 raft_consensus.cc:2243] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.780287   431 raft_consensus.cc:2272] T c4cbda5372a24182a9982a0d35ff91b7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.783468   431 tablet_replica.cc:333] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.784335   431 raft_consensus.cc:2243] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.785511   431 raft_consensus.cc:2272] T 4b6b1fc817984924ac96a7a2a29d76de P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.788605   431 tablet_replica.cc:333] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.789357   431 raft_consensus.cc:2243] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.790105   431 raft_consensus.cc:2272] T 1d120199a9d3441ab490816cfe76664f P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.794492   431 tablet_replica.cc:333] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.795442   431 raft_consensus.cc:2243] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.797595   431 raft_consensus.cc:2272] T 1d5174ec6bd2452abb5d7617555ce4f7 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.801991   431 tablet_replica.cc:333] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.802836   431 raft_consensus.cc:2243] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.804306   431 raft_consensus.cc:2272] T 8501e8317ed348cca428d77d106f937c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.807574   431 tablet_replica.cc:333] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.808498   431 raft_consensus.cc:2243] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.809603   431 raft_consensus.cc:2272] T e14d61cd3a034962afeaefb62f6d9986 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.812914   431 tablet_replica.cc:333] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.813602   431 raft_consensus.cc:2243] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.814918   431 raft_consensus.cc:2272] T 4e287a2761794958b3002cd2258cf2f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.818192   431 tablet_replica.cc:333] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.818840   431 raft_consensus.cc:2243] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.820256   431 raft_consensus.cc:2272] T bb1b18d08269419485367169ac7d79c5 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.824586   431 tablet_replica.cc:333] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.825263   431 raft_consensus.cc:2243] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.826821   431 raft_consensus.cc:2272] T 78a6859b4243476e8c4c421be70a6e19 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.830497   431 tablet_replica.cc:333] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.831092   431 raft_consensus.cc:2243] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.832419   431 raft_consensus.cc:2272] T abc3085f661f457e8c8d15478c227311 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.834818   431 tablet_replica.cc:333] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.835494   431 raft_consensus.cc:2243] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.836551   431 raft_consensus.cc:2272] T d501527377474732bddb08ed904bd34d P e3ab72f324d545a6b4ecb1025df1f7c0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.839854   431 tablet_replica.cc:333] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.840471   431 raft_consensus.cc:2243] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.841045   431 raft_consensus.cc:2272] T 443ffcfd9be74d9891a8cb9596947ca3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.843729   431 tablet_replica.cc:333] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.844547   431 raft_consensus.cc:2243] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEARNER]: Raft consensus shutting down.
I20260709 13:04:56.845115   431 pending_rounds.cc:70] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Trying to abort 2 pending ops.
I20260709 13:04:56.845417   431 pending_rounds.cc:77] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634158635495424 op_type: NO_OP noop_request { }
I20260709 13:04:56.846035   431 raft_consensus.cc:2889] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:56.846385   431 pending_rounds.cc:77] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305634144016621568 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "3f5eb582ff4540bb9b59540cc56f458a" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "36f53e9bfce749bbba4a4b34829f563d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34325 } } peers { permanent_uuid: "f9fb126997be4ec79f8f60fcd6764b00" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33801 } attrs { replace: true } } peers { permanent_uuid: "8c6031790cc44edfba5c3964e6f27c6e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43535 } } peers { permanent_uuid: "e3ab72f324d545a6b4ecb1025df1f7c0" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39631 } attrs { promote: true } } } }
I20260709 13:04:56.847592   431 raft_consensus.cc:2917] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:04:56.848106   431 raft_consensus.cc:2889] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:04:56.848423   431 raft_consensus.cc:2272] T 3f5eb582ff4540bb9b59540cc56f458a P e3ab72f324d545a6b4ecb1025df1f7c0 [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:04:56.851531   431 tablet_replica.cc:333] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.852233   431 raft_consensus.cc:2243] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.853065   431 raft_consensus.cc:2272] T 3db0d135af1343458208be9b79d66635 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.855695   431 tablet_replica.cc:333] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.856465   431 raft_consensus.cc:2243] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.857024   431 raft_consensus.cc:2272] T 9a39df5ae9144c118d4158b68b17044c P e3ab72f324d545a6b4ecb1025df1f7c0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.860349   431 tablet_replica.cc:333] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.861337   431 raft_consensus.cc:2243] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.862571   431 raft_consensus.cc:2272] T baf31533a97f4325919d60e19d73b3f2 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.866520   431 tablet_replica.cc:333] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.867316   431 raft_consensus.cc:2243] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.869118   431 raft_consensus.cc:2272] T 73161049b574469ea08e360e2def1aac P e3ab72f324d545a6b4ecb1025df1f7c0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.872087   431 tablet_replica.cc:333] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.872851   431 raft_consensus.cc:2243] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.874023   431 raft_consensus.cc:2272] T c56ae97ed5df4be18120cf680fd57f57 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.877724   431 tablet_replica.cc:333] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.878427   431 raft_consensus.cc:2243] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.879676   431 raft_consensus.cc:2272] T f66f028938a14af4a39a0e553938682b P e3ab72f324d545a6b4ecb1025df1f7c0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.882210   431 tablet_replica.cc:333] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.882710   431 raft_consensus.cc:2243] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:56.883261   431 raft_consensus.cc:2272] T 0f31cf514617428594649c1ecf3b2547 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.885480   431 tablet_replica.cc:333] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.886040   431 raft_consensus.cc:2243] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.887198   431 raft_consensus.cc:2272] T 1af5bea2a3c6428b9b6c07c96e3160ef P e3ab72f324d545a6b4ecb1025df1f7c0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:56.890038   431 tablet_replica.cc:333] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0: stopping tablet replica
I20260709 13:04:56.890637   431 raft_consensus.cc:2243] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:56.891860   431 raft_consensus.cc:2272] T 11e72d8320164ed18fc7fccba3a0ecd3 P e3ab72f324d545a6b4ecb1025df1f7c0 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:57.035641  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:04:57.325515   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:57.434060   431 master.cc:562] Master@127.0.107.254:37403 shutting down...
W20260709 13:04:57.476526  1481 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:04:57.476940  1481 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:57.477208  1481 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:05:05.218210  1464 debug-util.cc:398] Leaking SignalData structure 0x7b0800189140 after lost signal to thread 434
W20260709 13:05:05.218698  1464 debug-util.cc:398] Leaking SignalData structure 0x7b0800084460 after lost signal to thread 1467
W20260709 13:05:05.274369  1418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111) [suppressed 288 similar messages]
W20260709 13:05:05.277889  1418 catalog_manager.cc:4755] TS 36f53e9bfce749bbba4a4b34829f563d (127.0.107.193:34325): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5df6a74dd4014d38b1b536f6b0fc66ec: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34325: connect: Connection refused (error 111)
I20260709 13:05:06.221449   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.222663   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.223090   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0d9f4d25497a4ade8ff13a53360853c8: stopping tablet replica
I20260709 13:05:06.436594   431 master.cc:584] Master@127.0.107.254:37403 shutdown complete.
I20260709 13:05:06.495363   431 test_util.cc:182] -----------------------------------------------
I20260709 13:05:06.495621   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602043384352-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (239439 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:05:06.499768   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46283
I20260709 13:05:06.501791   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.511771  9228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.511452  9225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.511475  9226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.513233   431 server_base.cc:1061] running on GCE node
I20260709 13:05:06.518728   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.519026   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.519260   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602306519241 us; error 0 us; skew 500 ppm
I20260709 13:05:06.519950   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.523381   431 webserver.cc:533] Webserver started at http://127.0.107.254:37747/ using document root <none> and password file <none>
I20260709 13:05:06.524022   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.524286   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.524673   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.526142   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "6d7d8389dff34b7188c99f171c636387"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.533631   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:06.538347  9233 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.539680   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:05:06.540148   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "6d7d8389dff34b7188c99f171c636387"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.540540   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.559365   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.560827   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.610288   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46283
I20260709 13:05:06.610378  9284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46283 every 8 connection(s)
I20260709 13:05:06.615114  9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.629588  9285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387: Bootstrap starting.
I20260709 13:05:06.636157  9285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.641767  9285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387: No bootstrap required, opened a new log
I20260709 13:05:06.644381  9285 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER }
I20260709 13:05:06.644860  9285 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.645179  9285 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7d8389dff34b7188c99f171c636387, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.646183  9285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER }
I20260709 13:05:06.646725  9285 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:06.646974  9285 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:06.647580  9285 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.654009  9285 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER }
I20260709 13:05:06.655097  9285 leader_election.cc:304] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d7d8389dff34b7188c99f171c636387; no voters: 
I20260709 13:05:06.656695  9285 leader_election.cc:290] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:06.657101  9288 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.658727  9288 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 1 LEADER]: Becoming Leader. State: Replica: 6d7d8389dff34b7188c99f171c636387, State: Running, Role: LEADER
I20260709 13:05:06.659611  9288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER }
I20260709 13:05:06.660218  9285 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:06.674142  9289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d7d8389dff34b7188c99f171c636387" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER } }
I20260709 13:05:06.675047  9290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d7d8389dff34b7188c99f171c636387. Latest consensus state: current_term: 1 leader_uuid: "6d7d8389dff34b7188c99f171c636387" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d7d8389dff34b7188c99f171c636387" member_type: VOTER } }
I20260709 13:05:06.675383  9289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.675659  9290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.677263  9298 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:06.683950  9298 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:06.685256   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:06.697003  9298 catalog_manager.cc:1383] Generated new cluster ID: 842229ca09c940cdaba7b529baea612a
I20260709 13:05:06.697453  9298 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:06.717826  9298 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:06.719229  9298 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:06.734141  9298 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387: Generated new TSK 0
I20260709 13:05:06.734817  9298 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:06.756608   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.765682  9306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.767063  9307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.768625  9309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.770972   431 server_base.cc:1061] running on GCE node
I20260709 13:05:06.774073   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.774322   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.774623   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602306774591 us; error 0 us; skew 500 ppm
I20260709 13:05:06.775483   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.778750   431 webserver.cc:533] Webserver started at http://127.0.107.193:43623/ using document root <none> and password file <none>
I20260709 13:05:06.779237   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.779397   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.779630   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.780928   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "eae0fc1c2353497a889fdda2eda53679"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.786571   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:06.791848  9314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.793202   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:06.793578   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "eae0fc1c2353497a889fdda2eda53679"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.794106   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.811144   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.813160   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.815645   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:06.818359   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:06.818732   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.819015   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:06.819206   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.885691   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33181
I20260709 13:05:06.885774  9376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33181 every 8 connection(s)
I20260709 13:05:06.893967   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.905296  9382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.905493  9381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.908651  9384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.911033   431 server_base.cc:1061] running on GCE node
I20260709 13:05:06.916170   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:06.916353  9377 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46283
W20260709 13:05:06.916471   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.916883   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602306916860 us; error 0 us; skew 500 ppm
I20260709 13:05:06.916965  9377 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:06.917842   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.918174  9377 heartbeater.cc:507] Master 127.0.107.254:46283 requested a full tablet report, sending...
I20260709 13:05:06.921017   431 webserver.cc:533] Webserver started at http://127.0.107.194:42093/ using document root <none> and password file <none>
I20260709 13:05:06.921097  9250 ts_manager.cc:194] Registered new tserver with Master: eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:06.921813   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.922071   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.922374   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.923715   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "35817eed7a6449bc913deabeec3a66a2"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.923715  9250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55082
I20260709 13:05:06.932628   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:06.937271  9389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.938179   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:06.938623   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "35817eed7a6449bc913deabeec3a66a2"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:06.938911   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.963380   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.964872   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.967144   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:06.970029   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:06.970242   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.970674   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:06.970825   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.029654   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34067
I20260709 13:05:07.029762  9451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34067 every 8 connection(s)
I20260709 13:05:07.036175   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.048007  9456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.048717  9455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.049660   431 server_base.cc:1061] running on GCE node
W20260709 13:05:07.050254  9458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.051707   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.052060   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.052285   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602307052265 us; error 0 us; skew 500 ppm
I20260709 13:05:07.052883   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.053539  9452 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46283
I20260709 13:05:07.053906  9452 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.054949  9452 heartbeater.cc:507] Master 127.0.107.254:46283 requested a full tablet report, sending...
I20260709 13:05:07.056252   431 webserver.cc:533] Webserver started at http://127.0.107.195:42177/ using document root <none> and password file <none>
I20260709 13:05:07.057192   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.057411   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.057722   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.058283  9250 ts_manager.cc:194] Registered new tserver with Master: 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:07.059710   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "2319bdfca4124710b4064192c524a068"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-rrf3"
I20260709 13:05:07.059868  9250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55086
I20260709 13:05:07.065281   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:05:07.069988  9463 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.071205   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:05:07.071650   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "2319bdfca4124710b4064192c524a068"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-rrf3"
I20260709 13:05:07.071965   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.083509   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.085121   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.087437   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.091087   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.091333   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.091665   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.091845   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.145735   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34127
I20260709 13:05:07.145902  9525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34127 every 8 connection(s)
I20260709 13:05:07.151399   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.161942  9530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.161943  9529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.165684  9532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.168056   431 server_base.cc:1061] running on GCE node
I20260709 13:05:07.168924  9526 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46283
I20260709 13:05:07.169283  9526 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.169529   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:07.169934   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.170173   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602307170151 us; error 0 us; skew 500 ppm
I20260709 13:05:07.170389  9526 heartbeater.cc:507] Master 127.0.107.254:46283 requested a full tablet report, sending...
I20260709 13:05:07.171018   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.172902  9250 ts_manager.cc:194] Registered new tserver with Master: 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:07.174276   431 webserver.cc:533] Webserver started at http://127.0.107.196:35325/ using document root <none> and password file <none>
I20260709 13:05:07.174750  9250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55098
I20260709 13:05:07.174952   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.175288   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.175618   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.177794   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-3-root/instance:
uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-rrf3"
I20260709 13:05:07.186870   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:05:07.192689  9537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.193945   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:05:07.194509   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-3-root
uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-rrf3"
I20260709 13:05:07.194972   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.221232   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.223104   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.225093   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.228128   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.228531   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.229086   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.229250   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.280313   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:44225
I20260709 13:05:07.280699  9599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:44225 every 8 connection(s)
I20260709 13:05:07.297731  9600 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46283
I20260709 13:05:07.298242  9600 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.299067  9600 heartbeater.cc:507] Master 127.0.107.254:46283 requested a full tablet report, sending...
I20260709 13:05:07.301775  9250 ts_manager.cc:194] Registered new tserver with Master: e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:07.301997   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018239649s
I20260709 13:05:07.303726  9250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55106
I20260709 13:05:07.335044  9250 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55112:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:05:07.637589  9565 tablet_service.cc:1511] Processing CreateTablet for tablet 0aee84f299b340bbad1f7999d6bb35b7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:07.639321  9565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aee84f299b340bbad1f7999d6bb35b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.640257  9564 tablet_service.cc:1511] Processing CreateTablet for tablet 1786e708043842a3884b58092b23b91b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:07.640875  9490 tablet_service.cc:1511] Processing CreateTablet for tablet 1786e708043842a3884b58092b23b91b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:07.642165  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1786e708043842a3884b58092b23b91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.642295  9490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1786e708043842a3884b58092b23b91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.644445  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 22747041983e40adb9eafaae809e7651 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:07.645998  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22747041983e40adb9eafaae809e7651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.646924  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 22747041983e40adb9eafaae809e7651 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:07.648581  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22747041983e40adb9eafaae809e7651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.649276  9417 tablet_service.cc:1511] Processing CreateTablet for tablet 3258bebb55ec437b935b7b7e8f192ded (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:07.650812  9417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3258bebb55ec437b935b7b7e8f192ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.652284  9562 tablet_service.cc:1511] Processing CreateTablet for tablet 6894e48d005e4cabb8a0482567ba71de (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:07.653242  9416 tablet_service.cc:1511] Processing CreateTablet for tablet 0aee84f299b340bbad1f7999d6bb35b7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:07.654001  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894e48d005e4cabb8a0482567ba71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.660351  9488 tablet_service.cc:1511] Processing CreateTablet for tablet 852931ef972a4b4d835cf4238e0a194e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:07.660837  9561 tablet_service.cc:1511] Processing CreateTablet for tablet 7191b50632234abe9017c3d7f8cd9879 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:07.661966  9488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852931ef972a4b4d835cf4238e0a194e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.662454  9561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7191b50632234abe9017c3d7f8cd9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.655555  9415 tablet_service.cc:1511] Processing CreateTablet for tablet 22747041983e40adb9eafaae809e7651 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:07.639451  9491 tablet_service.cc:1511] Processing CreateTablet for tablet 3258bebb55ec437b935b7b7e8f192ded (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:07.666771  9415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22747041983e40adb9eafaae809e7651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.663507  9487 tablet_service.cc:1511] Processing CreateTablet for tablet 7191b50632234abe9017c3d7f8cd9879 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:07.669641  9485 tablet_service.cc:1511] Processing CreateTablet for tablet 9832319718e143058c54278ed4f330ae (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:07.674343  9560 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25e2626c84a989dd00de807fb51c6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20260709 13:05:07.678902  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:07.682145  9414 tablet_service.cc:1511] Processing CreateTablet for tablet 852931ef972a4b4d835cf4238e0a194e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:07.682632  9413 tablet_service.cc:1511] Processing CreateTablet for tablet 6894e48d005e4cabb8a0482567ba71de (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:07.668110  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25e2626c84a989dd00de807fb51c6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:07.685104  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25e2626c84a989dd00de807fb51c6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:07.686022  9560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25e2626c84a989dd00de807fb51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.687764  9411 tablet_service.cc:1511] Processing CreateTablet for tablet 9832319718e143058c54278ed4f330ae (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:07.688501  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25e2626c84a989dd00de807fb51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.689349  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9832319718e143058c54278ed4f330ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.692621  9559 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:07.694216  9559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.695749  9409 tablet_service.cc:1511] Processing CreateTablet for tablet bf0a254f4e734ae0878ae119cade4f15 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:07.696907  9558 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8e0525be1147f4827361f2bd94ff3b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:07.698514  9558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8e0525be1147f4827361f2bd94ff3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.698582  9483 tablet_service.cc:1511] Processing CreateTablet for tablet bf0a254f4e734ae0878ae119cade4f15 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:07.697558  9491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3258bebb55ec437b935b7b7e8f192ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.701310  9557 tablet_service.cc:1511] Processing CreateTablet for tablet bf0a254f4e734ae0878ae119cade4f15 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:07.703158  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0a254f4e734ae0878ae119cade4f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.703584  9482 tablet_service.cc:1511] Processing CreateTablet for tablet acc97c47c7054b42b01d2541e311211f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:07.705377  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852931ef972a4b4d835cf4238e0a194e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.706133  9413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894e48d005e4cabb8a0482567ba71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.693760  9484 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8e0525be1147f4827361f2bd94ff3b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:07.701445  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:07.707754  9409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0a254f4e734ae0878ae119cade4f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.708501  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25e2626c84a989dd00de807fb51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.711699  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.712833  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aee84f299b340bbad1f7999d6bb35b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.716241  9408 tablet_service.cc:1511] Processing CreateTablet for tablet acc97c47c7054b42b01d2541e311211f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:07.717931  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc97c47c7054b42b01d2541e311211f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.717485  9556 tablet_service.cc:1511] Processing CreateTablet for tablet 59044d7cb08e42079f85266aaa548e2a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:07.720991  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59044d7cb08e42079f85266aaa548e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.701260  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9832319718e143058c54278ed4f330ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.740933  9482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc97c47c7054b42b01d2541e311211f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.741813  9342 tablet_service.cc:1511] Processing CreateTablet for tablet 3258bebb55ec437b935b7b7e8f192ded (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:07.744274  9337 tablet_service.cc:1511] Processing CreateTablet for tablet 7191b50632234abe9017c3d7f8cd9879 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:07.744777  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 0aee84f299b340bbad1f7999d6bb35b7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:07.747350  9333 tablet_service.cc:1511] Processing CreateTablet for tablet acc97c47c7054b42b01d2541e311211f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:07.747901  9340 tablet_service.cc:1511] Processing CreateTablet for tablet 1786e708043842a3884b58092b23b91b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:07.750268  9339 tablet_service.cc:1511] Processing CreateTablet for tablet 852931ef972a4b4d835cf4238e0a194e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:07.752100  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0a254f4e734ae0878ae119cade4f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.754323  9484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8e0525be1147f4827361f2bd94ff3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.756548  9335 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:07.759315  9334 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8e0525be1147f4827361f2bd94ff3b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:07.761461  9487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7191b50632234abe9017c3d7f8cd9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.762048  9336 tablet_service.cc:1511] Processing CreateTablet for tablet 9832319718e143058c54278ed4f330ae (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:07.763365  9342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3258bebb55ec437b935b7b7e8f192ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.764119  9337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7191b50632234abe9017c3d7f8cd9879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.753950  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 6894e48d005e4cabb8a0482567ba71de (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:07.765395  9333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc97c47c7054b42b01d2541e311211f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.766122  9335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc8e68c8d8f4c6380be2ffc0070d2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.766762  9340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1786e708043842a3884b58092b23b91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.767444  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9832319718e143058c54278ed4f330ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.769002  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aee84f299b340bbad1f7999d6bb35b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.771196  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8e0525be1147f4827361f2bd94ff3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.775429  9339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852931ef972a4b4d835cf4238e0a194e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.780730  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894e48d005e4cabb8a0482567ba71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.833164  9411 tablet_service.cc:1511] Processing CreateTablet for tablet 59044d7cb08e42079f85266aaa548e2a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:07.834688  9563 tablet_service.cc:1511] Processing CreateTablet for tablet d1f556aa1381434c93d58d5e4827c8ef (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:07.836575  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f556aa1381434c93d58d5e4827c8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.834758  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59044d7cb08e42079f85266aaa548e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.863910  9621 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:07.887833  9622 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:07.882987  9620 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:07.918696  9621 tablet_bootstrap.cc:654] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.920441  9336 tablet_service.cc:1511] Processing CreateTablet for tablet 59044d7cb08e42079f85266aaa548e2a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:07.924510  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5f2184d23f426b99f302ec643dbf6c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:07.928831  9377 heartbeater.cc:499] Master 127.0.107.254:46283 was elected leader, sending a full tablet report...
I20260709 13:05:07.929042  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5f2184d23f426b99f302ec643dbf6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.946070  9620 tablet_bootstrap.cc:654] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.926184  9562 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5f2184d23f426b99f302ec643dbf6c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:07.951576  9489 tablet_service.cc:1511] Processing CreateTablet for tablet d1f556aa1381434c93d58d5e4827c8ef (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:07.953078  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5f2184d23f426b99f302ec643dbf6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.954906  9622 tablet_bootstrap.cc:654] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.960772  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59044d7cb08e42079f85266aaa548e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.953188  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f556aa1381434c93d58d5e4827c8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.973572  9338 tablet_service.cc:1511] Processing CreateTablet for tablet d1f556aa1381434c93d58d5e4827c8ef (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:07.975181  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f556aa1381434c93d58d5e4827c8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.989851  9623 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:07.990689  9485 tablet_service.cc:1511] Processing CreateTablet for tablet a465b137da5e49fb9465b378d628cac9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:07.993415  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465b137da5e49fb9465b378d628cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.993687  9410 tablet_service.cc:1511] Processing CreateTablet for tablet a465b137da5e49fb9465b378d628cac9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:08.007829  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465b137da5e49fb9465b378d628cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.993927  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5f2184d23f426b99f302ec643dbf6c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:08.012969  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5f2184d23f426b99f302ec643dbf6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:08.020457  9235 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 44144.9us
I20260709 13:05:08.032281  9334 tablet_service.cc:1511] Processing CreateTablet for tablet a465b137da5e49fb9465b378d628cac9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:08.033787  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465b137da5e49fb9465b378d628cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.040920  9557 tablet_service.cc:1511] Processing CreateTablet for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:08.042514  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.043125  9623 tablet_bootstrap.cc:654] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.049952  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 1f73ab9ca562450b8098926bae7ab820 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:08.051509  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f73ab9ca562450b8098926bae7ab820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.063118  9452 heartbeater.cc:499] Master 127.0.107.254:46283 was elected leader, sending a full tablet report...
I20260709 13:05:08.069762  9621 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:08.086047  9621 ts_tablet_manager.cc:1403] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.014s
I20260709 13:05:08.090210  9556 tablet_service.cc:1511] Processing CreateTablet for tablet 1f73ab9ca562450b8098926bae7ab820 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:08.091395  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f73ab9ca562450b8098926bae7ab820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.091621  9621 raft_consensus.cc:359] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.092351  9621 raft_consensus.cc:385] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.092679  9621 raft_consensus.cc:740] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.095162  9416 tablet_service.cc:1511] Processing CreateTablet for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:08.095252  9333 tablet_service.cc:1511] Processing CreateTablet for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:08.099104  9333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.101614  9408 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9cd875495e4489a7ae864416b8e233 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:08.096596  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e05a12bacf4f7fa5e42fa62b7c03c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.104585  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9cd875495e4489a7ae864416b8e233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.097749  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 1f73ab9ca562450b8098926bae7ab820 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:08.105799  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f73ab9ca562450b8098926bae7ab820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.107236  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9cd875495e4489a7ae864416b8e233 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:08.108608  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9cd875495e4489a7ae864416b8e233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.109470  9339 tablet_service.cc:1511] Processing CreateTablet for tablet 85690a80dd3046bca704808f907ec24c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:08.110736  9339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85690a80dd3046bca704808f907ec24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.113059  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9cd875495e4489a7ae864416b8e233 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:08.114466  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9cd875495e4489a7ae864416b8e233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.116400  9620 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:08.116294  9414 tablet_service.cc:1511] Processing CreateTablet for tablet 85690a80dd3046bca704808f907ec24c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:08.116986  9620 ts_tablet_manager.cc:1403] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.024s
I20260709 13:05:08.121311  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85690a80dd3046bca704808f907ec24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.128510  9622 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:08.129117  9622 ts_tablet_manager.cc:1403] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.242s	user 0.021s	sys 0.005s
I20260709 13:05:08.129769  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 85690a80dd3046bca704808f907ec24c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:08.131232  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85690a80dd3046bca704808f907ec24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.131060  9561 tablet_service.cc:1511] Processing CreateTablet for tablet fff33ba3467b4aa5ac7085e94405a30c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:08.132582  9561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff33ba3467b4aa5ac7085e94405a30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.126368  9621 consensus_queue.cc:260] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.158409  9334 tablet_service.cc:1511] Processing CreateTablet for tablet fff33ba3467b4aa5ac7085e94405a30c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:08.159821  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff33ba3467b4aa5ac7085e94405a30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.134805  9620 raft_consensus.cc:359] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:08.168766  9620 raft_consensus.cc:385] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.169121  9620 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.170113  9620 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:08.171867  9622 raft_consensus.cc:359] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.172735  9622 raft_consensus.cc:385] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.173064  9622 raft_consensus.cc:740] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.173928  9622 consensus_queue.cc:260] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.178850  9526 heartbeater.cc:499] Master 127.0.107.254:46283 was elected leader, sending a full tablet report...
I20260709 13:05:08.199747  9483 tablet_service.cc:1511] Processing CreateTablet for tablet f607d360325242ad9ca1ce2b690f164a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:08.200739  9622 ts_tablet_manager.cc:1434] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.071s	user 0.011s	sys 0.000s
I20260709 13:05:08.201355  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607d360325242ad9ca1ce2b690f164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.202306  9622 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:08.213658  9410 tablet_service.cc:1511] Processing CreateTablet for tablet fff33ba3467b4aa5ac7085e94405a30c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:08.219717  9334 tablet_service.cc:1511] Processing CreateTablet for tablet f607d360325242ad9ca1ce2b690f164a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:08.221432  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607d360325242ad9ca1ce2b690f164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.223963  9412 tablet_service.cc:1511] Processing CreateTablet for tablet af16b22a6c904b34aef360a0f7cd9e20 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:08.218480  9556 tablet_service.cc:1511] Processing CreateTablet for tablet f607d360325242ad9ca1ce2b690f164a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:08.230103  9623 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:08.230679  9623 ts_tablet_manager.cc:1403] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.032s
I20260709 13:05:08.232232  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f607d360325242ad9ca1ce2b690f164a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.233800  9338 tablet_service.cc:1511] Processing CreateTablet for tablet d708b40047da45dba2adaacf9a0c4b30 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:08.240345  9620 ts_tablet_manager.cc:1434] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.123s	user 0.011s	sys 0.017s
I20260709 13:05:08.241180  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d708b40047da45dba2adaacf9a0c4b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.241385  9600 heartbeater.cc:499] Master 127.0.107.254:46283 was elected leader, sending a full tablet report...
I20260709 13:05:08.241629  9483 tablet_service.cc:1511] Processing CreateTablet for tablet af16b22a6c904b34aef360a0f7cd9e20 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:08.244308  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af16b22a6c904b34aef360a0f7cd9e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.250083  9623 raft_consensus.cc:359] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.250991  9623 raft_consensus.cc:385] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.251296  9623 raft_consensus.cc:740] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.238883  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff33ba3467b4aa5ac7085e94405a30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.235670  9411 tablet_service.cc:1511] Processing CreateTablet for tablet d708b40047da45dba2adaacf9a0c4b30 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:08.273770  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af16b22a6c904b34aef360a0f7cd9e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.252882  9620 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:08.237624  9562 tablet_service.cc:1511] Processing CreateTablet for tablet af16b22a6c904b34aef360a0f7cd9e20 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:08.256872  9485 tablet_service.cc:1511] Processing CreateTablet for tablet d708b40047da45dba2adaacf9a0c4b30 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:08.257714  9557 tablet_service.cc:1511] Processing CreateTablet for tablet ebd83b93312541268dff3bd7a85eec65 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:08.288996  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd83b93312541268dff3bd7a85eec65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:08.289248  9601 tablet.cc:2406] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:08.291457  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d708b40047da45dba2adaacf9a0c4b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.292884  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af16b22a6c904b34aef360a0f7cd9e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.288951  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d708b40047da45dba2adaacf9a0c4b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.296820  9621 ts_tablet_manager.cc:1434] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.208s	user 0.027s	sys 0.004s
I20260709 13:05:08.298297  9621 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:08.306918  9623 consensus_queue.cc:260] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.309190  9622 tablet_bootstrap.cc:654] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.314878  9416 tablet_service.cc:1511] Processing CreateTablet for tablet ebd83b93312541268dff3bd7a85eec65 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:08.315788  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae838928be04675a8741bd898683d34 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:08.317459  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae838928be04675a8741bd898683d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.319389  9621 tablet_bootstrap.cc:654] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.303824  9620 tablet_bootstrap.cc:654] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.328616  9339 tablet_service.cc:1511] Processing CreateTablet for tablet ebd83b93312541268dff3bd7a85eec65 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:08.337461  9339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd83b93312541268dff3bd7a85eec65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.362795  9623 ts_tablet_manager.cc:1434] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.132s	user 0.013s	sys 0.002s
I20260709 13:05:08.357069  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd83b93312541268dff3bd7a85eec65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.368880  9334 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae838928be04675a8741bd898683d34 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:08.370654  9623 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:08.370802  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae838928be04675a8741bd898683d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.374290  9629 raft_consensus.cc:493] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.374874  9629 raft_consensus.cc:515] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.377786  9630 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.378430  9630 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.382191  9561 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae838928be04675a8741bd898683d34 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:08.397347  9561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae838928be04675a8741bd898683d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.408495  9629 leader_election.cc:290] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:08.438215  9622 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:08.438865  9622 ts_tablet_manager.cc:1403] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.033s
I20260709 13:05:08.437743  9621 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:08.440762  9621 ts_tablet_manager.cc:1403] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.006s
I20260709 13:05:08.437752  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 8541dc1cb441446a86bd73a864b794e0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:08.447129  9628 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.448117  9628 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:08.449502  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541dc1cb441446a86bd73a864b794e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.450557  9621 raft_consensus.cc:359] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.451341  9621 raft_consensus.cc:385] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.436160  9630 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:08.451866  9621 raft_consensus.cc:740] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.439874  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 0d601528765d4c458eac4ca0aa48f348 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:08.454669  9628 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:08.473228  9631 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.473941  9631 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.474411  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d601528765d4c458eac4ca0aa48f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.487068  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 0d601528765d4c458eac4ca0aa48f348 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:08.488436  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d601528765d4c458eac4ca0aa48f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.488148  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 8541dc1cb441446a86bd73a864b794e0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:08.517547  9620 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:08.518123  9620 ts_tablet_manager.cc:1403] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.005s
I20260709 13:05:08.518184  9556 tablet_service.cc:1511] Processing CreateTablet for tablet 0d601528765d4c458eac4ca0aa48f348 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:08.519631  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d601528765d4c458eac4ca0aa48f348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.524051  9333 tablet_service.cc:1511] Processing CreateTablet for tablet 3394a244b95c412a9b0d4a2db10fc64a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:08.525427  9333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3394a244b95c412a9b0d4a2db10fc64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.527189  9631 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:08.515748  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541dc1cb441446a86bd73a864b794e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.529690  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b44dd93e242a2972ad2926225583d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:08.531004  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b44dd93e242a2972ad2926225583d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.531329  9623 tablet_bootstrap.cc:654] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.493786  9621 consensus_queue.cc:260] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.493566  9622 raft_consensus.cc:359] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.537498  9620 raft_consensus.cc:359] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.538362  9620 raft_consensus.cc:385] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.515143  9562 tablet_service.cc:1511] Processing CreateTablet for tablet 3394a244b95c412a9b0d4a2db10fc64a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:08.543337  9620 raft_consensus.cc:740] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.535259  9622 raft_consensus.cc:385] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.564005  9621 ts_tablet_manager.cc:1434] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.002s
I20260709 13:05:08.556861  9622 raft_consensus.cc:740] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.568866  9622 consensus_queue.cc:260] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.571194  9622 ts_tablet_manager.cc:1434] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.002s
I20260709 13:05:08.579716  9621 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:08.586757  9621 tablet_bootstrap.cc:654] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.587869  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 8541dc1cb441446a86bd73a864b794e0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:08.592867  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3394a244b95c412a9b0d4a2db10fc64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.612923  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541dc1cb441446a86bd73a864b794e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.607704  9622 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:08.628925  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b44dd93e242a2972ad2926225583d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:08.630718  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b44dd93e242a2972ad2926225583d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.647316  9623 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:08.655257  9336 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5f31b62d11440182534d9ea52a469c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:08.657079  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5f31b62d11440182534d9ea52a469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.651227  9630 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.663226  9630 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.665931  9630 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:08.682868  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:08.682611  9556 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b44dd93e242a2972ad2926225583d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:08.623021  9620 consensus_queue.cc:260] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.685072  9622 tablet_bootstrap.cc:654] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.685511  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:08.686431  9620 ts_tablet_manager.cc:1434] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.168s	user 0.010s	sys 0.001s
W20260709 13:05:08.687407  9465 leader_election.cc:343] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.680486  9623 ts_tablet_manager.cc:1403] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.308s	user 0.016s	sys 0.033s
I20260709 13:05:08.687781  9620 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:08.707880  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b44dd93e242a2972ad2926225583d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.728371  9484 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5f31b62d11440182534d9ea52a469c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:08.730396  9484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5f31b62d11440182534d9ea52a469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.643934  9487 tablet_service.cc:1511] Processing CreateTablet for tablet 57bf6d31f0484d90903e72e4e463f5a0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:08.733520  9487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bf6d31f0484d90903e72e4e463f5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.746263  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
W20260709 13:05:08.748880  9392 leader_election.cc:343] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.752642  9334 tablet_service.cc:1511] Processing CreateTablet for tablet 191f9b27ce534ccba550f1ec90d42114 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:08.754107  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191f9b27ce534ccba550f1ec90d42114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.755733  9623 raft_consensus.cc:359] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.756640  9623 raft_consensus.cc:385] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.757007  9623 raft_consensus.cc:740] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.757961  9623 consensus_queue.cc:260] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.760565  9623 ts_tablet_manager.cc:1434] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:05:08.761677  9623 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:08.768733  9623 tablet_bootstrap.cc:654] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.769172  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 3394a244b95c412a9b0d4a2db10fc64a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:08.775427  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3394a244b95c412a9b0d4a2db10fc64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.780318  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 57bf6d31f0484d90903e72e4e463f5a0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:08.782282  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bf6d31f0484d90903e72e4e463f5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.806941  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 50c24c026c7048d9847a58777efe8770 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:08.808914  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c24c026c7048d9847a58777efe8770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.820950  9620 tablet_bootstrap.cc:654] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.828707  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 50c24c026c7048d9847a58777efe8770 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:08.830180  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c24c026c7048d9847a58777efe8770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.829187  9621 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:08.831948  9621 ts_tablet_manager.cc:1403] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.256s	user 0.029s	sys 0.029s
I20260709 13:05:08.835285  9621 raft_consensus.cc:359] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.836334  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:08.838655  9621 raft_consensus.cc:385] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.839092  9621 raft_consensus.cc:740] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.847185  9631 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.847780  9631 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.850132  9631 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:08.851143  9539 leader_election.cc:343] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.839866  9621 consensus_queue.cc:260] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.858162  9622 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:08.859012  9622 ts_tablet_manager.cc:1403] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.284s	user 0.021s	sys 0.006s
I20260709 13:05:08.862246  9620 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:08.862865  9620 ts_tablet_manager.cc:1403] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.175s	user 0.021s	sys 0.008s
I20260709 13:05:08.861801  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5f31b62d11440182534d9ea52a469c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:08.862450  9622 raft_consensus.cc:359] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:08.873814  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:08.872888  9561 tablet_service.cc:1511] Processing CreateTablet for tablet 191f9b27ce534ccba550f1ec90d42114 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:08.956944  9352 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:08.958352  9561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191f9b27ce534ccba550f1ec90d42114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.959024  9391 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:08.873335  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:08.877362  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:08.961099  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 930e01c56898417191283e02b2ae37c9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:08.961694  9628 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:08.962467  9390 leader_election.cc:343] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.962245  9628 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:08.879308  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:08.963871  9336 tablet_service.cc:1511] Processing CreateTablet for tablet 2598613081aa46f793a217ccf880c19e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:08.964299  9630 raft_consensus.cc:2804] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:08.964581  9464 leader_election.cc:343] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.964751  9630 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.965279  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2598613081aa46f793a217ccf880c19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.965154  9464 leader_election.cc:304] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:08.962182  9485 tablet_service.cc:1511] Processing CreateTablet for tablet 2598613081aa46f793a217ccf880c19e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:08.864611  9621 ts_tablet_manager.cc:1434] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:05:08.878602  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:08.969403  9620 raft_consensus.cc:359] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.874792  9557 tablet_service.cc:1511] Processing CreateTablet for tablet 50c24c026c7048d9847a58777efe8770 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:08.961112  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 930e01c56898417191283e02b2ae37c9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:08.970166  9620 raft_consensus.cc:385] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.970520  9620 raft_consensus.cc:740] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.971004  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930e01c56898417191283e02b2ae37c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:08.971199  9316 leader_election.cc:343] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.965204  9630 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.976424  9620 consensus_queue.cc:260] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:08.873116  9629 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.873456  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:08.865357  9416 tablet_service.cc:1511] Processing CreateTablet for tablet 191f9b27ce534ccba550f1ec90d42114 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:08.875528  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:08.956997  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5f31b62d11440182534d9ea52a469c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.013870  9628 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:08.998603  9629 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.007567  9623 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:09.009011  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:08.972577  9622 raft_consensus.cc:385] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.018422  9622 raft_consensus.cc:740] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.009948  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:09.010195  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c24c026c7048d9847a58777efe8770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.011864  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2598613081aa46f793a217ccf880c19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.011427  9564 tablet_service.cc:1511] Processing CreateTablet for tablet eb3c57d630a44e97be12c1acca969da6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:05:09.036468  9464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 72092.6us
I20260709 13:05:09.036922  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3c57d630a44e97be12c1acca969da6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:09.037647  9540 leader_election.cc:343] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.038143  9540 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:08.870826  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 930e01c56898417191283e02b2ae37c9 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:09.040284  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930e01c56898417191283e02b2ae37c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.040511  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:09.041255  9500 raft_consensus.cc:2468] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:09.041399  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.025897  9622 consensus_queue.cc:260] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.042626  9540 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
W20260709 13:05:09.043284  9539 leader_election.cc:343] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:09.012660  9391 leader_election.cc:343] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.013614  9411 tablet_service.cc:1511] Processing CreateTablet for tablet 2598613081aa46f793a217ccf880c19e (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:09.016671  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930e01c56898417191283e02b2ae37c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.897683  9562 tablet_service.cc:1511] Processing CreateTablet for tablet 57bf6d31f0484d90903e72e4e463f5a0 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:09.018708  9623 ts_tablet_manager.cc:1403] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.257s	user 0.023s	sys 0.004s
W20260709 13:05:09.027241  9317 leader_election.cc:343] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.056454  9317 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:09.057622  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bf6d31f0484d90903e72e4e463f5a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:09.057950  9317 leader_election.cc:343] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.031301  9341 tablet_service.cc:1511] Processing CreateTablet for tablet eb3c57d630a44e97be12c1acca969da6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:09.059368  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3c57d630a44e97be12c1acca969da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.062755  9631 raft_consensus.cc:2749] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.035319  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 55f160c0257440b5aae393b6a1d76f90 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:09.065682  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f160c0257440b5aae393b6a1d76f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.066558  9621 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:09.048251  9391 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:09.054768  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2598613081aa46f793a217ccf880c19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.047956  9628 raft_consensus.cc:2804] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.078239  9628 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.084465  9658 raft_consensus.cc:2749] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.086398  9564 tablet_service.cc:1511] Processing CreateTablet for tablet 55f160c0257440b5aae393b6a1d76f90 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:09.087839  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f160c0257440b5aae393b6a1d76f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.084549  9628 raft_consensus.cc:3060] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.093865  9622 ts_tablet_manager.cc:1434] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.234s	user 0.031s	sys 0.022s
I20260709 13:05:09.094762  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 55f160c0257440b5aae393b6a1d76f90 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:09.095196  9622 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:09.098127  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f160c0257440b5aae393b6a1d76f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.098892  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:09.100265  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.104142  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191f9b27ce534ccba550f1ec90d42114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.106304  9622 tablet_bootstrap.cc:654] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.090552  9623 raft_consensus.cc:359] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.111164  9623 raft_consensus.cc:385] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.111496  9623 raft_consensus.cc:740] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.113191  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:09.116291  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:09.120453  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 107844us
I20260709 13:05:09.128820  9414 tablet_service.cc:1511] Processing CreateTablet for tablet eb3c57d630a44e97be12c1acca969da6 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:09.130247  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3c57d630a44e97be12c1acca969da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.131140  9629 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:09.128533  9661 raft_consensus.cc:2749] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.131991  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.132196  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:09.133560  9465 leader_election.cc:343] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.140199  9659 raft_consensus.cc:2749] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.115141  9620 ts_tablet_manager.cc:1434] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.218s	user 0.009s	sys 0.009s
I20260709 13:05:09.148411  9336 tablet_service.cc:1511] Processing CreateTablet for tablet 47b32e90e45f4c73a82822a137702764 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:09.149945  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b32e90e45f4c73a82822a137702764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.164161  9620 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:09.163511  9408 tablet_service.cc:1511] Processing CreateTablet for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:09.170928  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a09b02e9a184cb1bdbec1c0c7eb8ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.172766  9628 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.174683  9574 raft_consensus.cc:2393] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 1: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:09.177676  9411 tablet_service.cc:1511] Processing CreateTablet for tablet 47b32e90e45f4c73a82822a137702764 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:09.180312  9464 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:09.182337  9629 raft_consensus.cc:3060] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.188220  9630 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.189564  9426 raft_consensus.cc:2393] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:09.190382  9621 tablet_bootstrap.cc:654] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.192443  9630 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:09.195135  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:09.195927  9351 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.193966  9628 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:09.194182  9316 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:09.198846  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:09.181821  9623 consensus_queue.cc:260] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:09.200961  9539 leader_election.cc:343] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.209271  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
W20260709 13:05:09.210919  9392 leader_election.cc:343] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.212139  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:09.219477  9620 tablet_bootstrap.cc:654] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.213399  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b32e90e45f4c73a82822a137702764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.222708  9629 raft_consensus.cc:2749] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.224767  9623 ts_tablet_manager.cc:1434] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.147s	user 0.013s	sys 0.013s
I20260709 13:05:09.227733  9564 tablet_service.cc:1511] Processing CreateTablet for tablet bf68916785184cb081d3032e1da7db46 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:09.232733  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf68916785184cb081d3032e1da7db46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.232632  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 47b32e90e45f4c73a82822a137702764 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:09.233229  9501 raft_consensus.cc:2468] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:09.236363  9540 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:09.238958  9351 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:09.239216  9623 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:09.239666  9628 raft_consensus.cc:2804] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.239835  9336 tablet_service.cc:1511] Processing CreateTablet for tablet bf68916785184cb081d3032e1da7db46 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:09.241158  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b32e90e45f4c73a82822a137702764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.241874  9416 tablet_service.cc:1511] Processing CreateTablet for tablet bf68916785184cb081d3032e1da7db46 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:09.246143  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 676c09e0537147d886a1c9236674359a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:09.247884  9622 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:09.255165  9628 raft_consensus.cc:697] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:09.263805  9628 consensus_queue.cc:237] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.250484  9631 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.256912  9391 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:09.257336  9659 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.259086  9336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf68916785184cb081d3032e1da7db46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.266712  9630 raft_consensus.cc:2804] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.267318  9630 raft_consensus.cc:697] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:09.268183  9630 consensus_queue.cc:237] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.260571  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 676c09e0537147d886a1c9236674359a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:09.262955  9622 ts_tablet_manager.cc:1403] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.005s
I20260709 13:05:09.263967  9489 tablet_service.cc:1511] Processing CreateTablet for tablet 36b02f7bce11408e9641daf8a5ff79ed (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:09.272666  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676c09e0537147d886a1c9236674359a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.265806  9659 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.256119  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf68916785184cb081d3032e1da7db46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.274917  9659 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.275547  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676c09e0537147d886a1c9236674359a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.281149  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b02f7bce11408e9641daf8a5ff79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.281430  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.282202  9426 raft_consensus.cc:2468] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:09.282514  9562 tablet_service.cc:1511] Processing CreateTablet for tablet 36b02f7bce11408e9641daf8a5ff79ed (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:09.283478  9539 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:09.283782  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b02f7bce11408e9641daf8a5ff79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.284456  9659 raft_consensus.cc:2804] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.284879  9659 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.285249  9659 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.285622  9622 raft_consensus.cc:359] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.287528  9622 raft_consensus.cc:385] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.287916  9622 raft_consensus.cc:740] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.281455  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.280869  9411 tablet_service.cc:1511] Processing CreateTablet for tablet 36b02f7bce11408e9641daf8a5ff79ed (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:09.290753  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b02f7bce11408e9641daf8a5ff79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.283842  9620 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:09.292898  9620 ts_tablet_manager.cc:1403] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.136s	user 0.007s	sys 0.011s
I20260709 13:05:09.289292  9622 consensus_queue.cc:260] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:09.289683  9539 leader_election.cc:343] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.300747  9561 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6cf54da48346c28143eaad060b9ccb (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:09.301862  9485 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee539e5ae0140c097952f76679d785d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:09.302531  9561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6cf54da48346c28143eaad060b9ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.303486  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee539e5ae0140c097952f76679d785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.296922  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee539e5ae0140c097952f76679d785d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:09.304914  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee539e5ae0140c097952f76679d785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.304643  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 676c09e0537147d886a1c9236674359a (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:09.306170  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676c09e0537147d886a1c9236674359a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.306901  9333 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6cf54da48346c28143eaad060b9ccb (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:09.308874  9333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6cf54da48346c28143eaad060b9ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.287061  9621 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:09.312844  9621 ts_tablet_manager.cc:1403] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.264s	user 0.023s	sys 0.009s
I20260709 13:05:09.315402  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6cf54da48346c28143eaad060b9ccb (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:09.315567  9414 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee539e5ae0140c097952f76679d785d (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:09.317214  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6cf54da48346c28143eaad060b9ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.319108  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee539e5ae0140c097952f76679d785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.362929  9629 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.364452  9629 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.366236  9557 tablet_service.cc:1511] Processing CreateTablet for tablet 08ae14c90ac540308e971d9148ceb222 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:09.366859  9629 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.367292  9334 tablet_service.cc:1511] Processing CreateTablet for tablet 08ae14c90ac540308e971d9148ceb222 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:09.376504  9334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ae14c90ac540308e971d9148ceb222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.373484  9621 raft_consensus.cc:359] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.373665  9484 tablet_service.cc:1511] Processing CreateTablet for tablet 08ae14c90ac540308e971d9148ceb222 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:09.378783  9621 raft_consensus.cc:385] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.379153  9621 raft_consensus.cc:740] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.379503  9484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ae14c90ac540308e971d9148ceb222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.381959  9249 catalog_manager.cc:5697] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.386162  9623 tablet_bootstrap.cc:654] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.386373  9248 catalog_manager.cc:5697] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.379938  9621 consensus_queue.cc:260] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.390379  9621 ts_tablet_manager.cc:1434] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.004s
I20260709 13:05:09.387322  9659 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.398954  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:09.400547  9539 leader_election.cc:343] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.391433  9621 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:09.370947  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ae14c90ac540308e971d9148ceb222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.392634  9622 ts_tablet_manager.cc:1434] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.002s
I20260709 13:05:09.408318  9622 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:09.408595  9408 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:09.410079  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.431565  9659 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.437281  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:09.437927  9426 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.433738  9631 raft_consensus.cc:493] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.441587  9631 raft_consensus.cc:515] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.446638  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.447615  9631 leader_election.cc:290] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.449652  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.450263  9564 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:05:09.451297  9316 leader_election.cc:343] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.451589  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.455276  9620 raft_consensus.cc:359] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:09.456130  9620 raft_consensus.cc:385] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.456431  9620 raft_consensus.cc:740] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
W20260709 13:05:09.457603  9465 leader_election.cc:343] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.459854  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:09.464370  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba7c03f3c344aeab4dd32e9f4b13fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.467712  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:09.469532  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.486250  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:09.487679  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.490260  9426 raft_consensus.cc:2468] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:09.497727  9539 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:09.478653  9620 consensus_queue.cc:260] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:09.499049  9659 raft_consensus.cc:2804] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.501348  9486 tablet_service.cc:1511] Processing CreateTablet for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:09.502700  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c2dcc9c8b6476bb6dfdbcf0db7abb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.513417  9621 tablet_bootstrap.cc:654] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.517957  9620 ts_tablet_manager.cc:1434] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.225s	user 0.008s	sys 0.004s
I20260709 13:05:09.519359  9620 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:09.525418  9622 tablet_bootstrap.cc:654] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.537197  9623 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:09.537787  9623 ts_tablet_manager.cc:1403] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.299s	user 0.009s	sys 0.011s
I20260709 13:05:09.544778  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:09.545921  9562 tablet_service.cc:1511] Processing CreateTablet for tablet dd8f83a10da7493282e02784080114a7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:05:09.547226  9315 leader_election.cc:343] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.547510  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8f83a10da7493282e02784080114a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.547749  9315 leader_election.cc:304] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:09.551349  9631 raft_consensus.cc:2749] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.552242  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.558121  9623 raft_consensus.cc:359] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:09.558771  9465 leader_election.cc:343] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.558980  9623 raft_consensus.cc:385] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.559348  9623 raft_consensus.cc:740] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.559311  9465 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:09.561049  9629 raft_consensus.cc:2749] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.549239  9659 raft_consensus.cc:697] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:09.565827  9620 tablet_bootstrap.cc:654] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.578897  9623 consensus_queue.cc:260] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:09.582787  9623 ts_tablet_manager.cc:1434] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:05:09.588550  9410 tablet_service.cc:1511] Processing CreateTablet for tablet dd8f83a10da7493282e02784080114a7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:09.591230  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 867c2d023234405b9cf88b5b0812f09b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:09.592842  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 867c2d023234405b9cf88b5b0812f09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.591773  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8f83a10da7493282e02784080114a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.580339  9333 tablet_service.cc:1511] Processing CreateTablet for tablet dd8f83a10da7493282e02784080114a7 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:09.595817  9485 tablet_service.cc:1511] Processing CreateTablet for tablet 867c2d023234405b9cf88b5b0812f09b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:09.597193  9333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8f83a10da7493282e02784080114a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.597658  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 867c2d023234405b9cf88b5b0812f09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.600390  9623 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:09.588482  9659 consensus_queue.cc:237] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.611943  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 867c2d023234405b9cf88b5b0812f09b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:09.613673  9620 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:09.614296  9620 ts_tablet_manager.cc:1403] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.003s
I20260709 13:05:09.615685  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 867c2d023234405b9cf88b5b0812f09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.623994  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 405f4dfd2e604f208c69fcc85c065d0c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:09.625336  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405f4dfd2e604f208c69fcc85c065d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.626120  9621 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:09.626684  9621 ts_tablet_manager.cc:1403] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.235s	user 0.027s	sys 0.008s
I20260709 13:05:09.630211  9623 tablet_bootstrap.cc:654] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.631553  9629 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.632153  9629 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:09.634305  9629 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.634869  9630 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.635699  9630 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.636523  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.638135  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.638656  9621 raft_consensus.cc:359] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.639153  9351 raft_consensus.cc:2393] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:09.639433  9621 raft_consensus.cc:385] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.625505  9412 tablet_service.cc:1511] Processing CreateTablet for tablet 405f4dfd2e604f208c69fcc85c065d0c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:09.639734  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:09.651957  9564 tablet_service.cc:1511] Processing CreateTablet for tablet 405f4dfd2e604f208c69fcc85c065d0c (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:09.658402  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405f4dfd2e604f208c69fcc85c065d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.655985  9622 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
W20260709 13:05:09.655355  9392 leader_election.cc:343] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.640133  9630 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:09.660607  9622 ts_tablet_manager.cc:1403] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.035s
I20260709 13:05:09.641434  9465 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:09.662362  9501 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.639782  9621 raft_consensus.cc:740] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.663702  9621 consensus_queue.cc:260] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.641917  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.666023  9414 tablet_service.cc:1511] Processing CreateTablet for tablet e7b2ff13398e4613a307e29028dc5560 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:09.667362  9622 raft_consensus.cc:359] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.668733  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405f4dfd2e604f208c69fcc85c065d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.672509  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b2ff13398e4613a307e29028dc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.668541  9486 tablet_service.cc:1511] Processing CreateTablet for tablet e7b2ff13398e4613a307e29028dc5560 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:09.671978  9622 raft_consensus.cc:385] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.674091  9622 raft_consensus.cc:740] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.674695  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b2ff13398e4613a307e29028dc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.679586  9351 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:09.681295  9391 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:09.682291  9630 raft_consensus.cc:2804] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.684674  9557 tablet_service.cc:1511] Processing CreateTablet for tablet 776de67e897f4c53aab91cb04628fd1b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:05:09.685494  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:09.686276  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776de67e897f4c53aab91cb04628fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.658164  9620 raft_consensus.cc:359] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.688431  9620 raft_consensus.cc:385] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.688833  9620 raft_consensus.cc:740] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.690869  9338 tablet_service.cc:1511] Processing CreateTablet for tablet 776de67e897f4c53aab91cb04628fd1b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:09.692283  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776de67e897f4c53aab91cb04628fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.686295  9622 consensus_queue.cc:260] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.692958  9630 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.692986  9629 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.693847  9630 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.668844  9341 tablet_service.cc:1511] Processing CreateTablet for tablet e7b2ff13398e4613a307e29028dc5560 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:09.695366  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b2ff13398e4613a307e29028dc5560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.696874  9620 consensus_queue.cc:260] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.697979  9674 raft_consensus.cc:493] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.698509  9674 raft_consensus.cc:515] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.702867  9674 leader_election.cc:290] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.704181  9621 ts_tablet_manager.cc:1434] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 13:05:09.704536  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:09.705250  9426 raft_consensus.cc:2468] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:09.705839  9621 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:09.706492  9539 leader_election.cc:304] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:09.707295  9628 raft_consensus.cc:2804] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.707660  9628 raft_consensus.cc:493] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.707733  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.708118  9628 raft_consensus.cc:3060] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.708491  9351 raft_consensus.cc:2468] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:09.709214  9620 ts_tablet_manager.cc:1434] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.005s
I20260709 13:05:09.710482  9620 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:09.713438  9661 consensus_queue.cc:1048] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:09.715602  9628 raft_consensus.cc:515] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.720712  9408 tablet_service.cc:1511] Processing CreateTablet for tablet 776de67e897f4c53aab91cb04628fd1b (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:09.722299  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776de67e897f4c53aab91cb04628fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.720535  9248 catalog_manager.cc:5697] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:09.725587  9539 consensus_peers.cc:597] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:09.734474  9622 ts_tablet_manager.cc:1434] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:05:09.735709  9622 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:09.751965  9630 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.764972  9630 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:09.766919  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:09.767279  9620 tablet_bootstrap.cc:654] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.767632  9501 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.740326  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:09.773473  9659 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.776202  9659 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:09.781128  9628 leader_election.cc:290] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:09.785383  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:09.786098  9426 raft_consensus.cc:3060] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.787320  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 6a689cd004db4bbebd7fc4c6c5aecada (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:09.788743  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a689cd004db4bbebd7fc4c6c5aecada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.791381  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:09.792233  9562 tablet_service.cc:1511] Processing CreateTablet for tablet b3e8e061f8c943a98676c36322363053 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:09.793254  9426 raft_consensus.cc:2468] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:09.793382  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:09.793879  9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e8e061f8c943a98676c36322363053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.794560  9539 leader_election.cc:304] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:09.795634  9628 raft_consensus.cc:2804] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.796206  9628 raft_consensus.cc:697] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:09.797215  9628 consensus_queue.cc:237] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.792259  9352 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:09.780635  9351 raft_consensus.cc:3060] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.802580  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:09.804711  9486 tablet_service.cc:1511] Processing CreateTablet for tablet b3e8e061f8c943a98676c36322363053 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:09.805958  9486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e8e061f8c943a98676c36322363053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.811551  9630 consensus_queue.cc:1048] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.812649  9341 tablet_service.cc:1511] Processing CreateTablet for tablet b3e8e061f8c943a98676c36322363053 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:09.813885  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e8e061f8c943a98676c36322363053. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:09.814895  9540 leader_election.cc:343] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.816102  9350 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.805557  9410 tablet_service.cc:1511] Processing CreateTablet for tablet 6a689cd004db4bbebd7fc4c6c5aecada (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:09.817401  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a689cd004db4bbebd7fc4c6c5aecada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.781329  9659 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:09.822867  9539 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:09.824915  9621 tablet_bootstrap.cc:654] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.831408  9659 raft_consensus.cc:2804] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.825981  9501 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:09.831960  9659 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.832499  9659 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.833004  9392 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:09.828779  9623 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:09.831791  9563 tablet_service.cc:1511] Processing CreateTablet for tablet 6a689cd004db4bbebd7fc4c6c5aecada (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:09.833976  9630 raft_consensus.cc:2804] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.834266  9623 ts_tablet_manager.cc:1403] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.234s	user 0.020s	sys 0.030s
I20260709 13:05:09.835333  9630 raft_consensus.cc:697] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:09.836398  9563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a689cd004db4bbebd7fc4c6c5aecada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.836306  9630 consensus_queue.cc:237] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.842243  9623 raft_consensus.cc:359] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.854247  9338 tablet_service.cc:1511] Processing CreateTablet for tablet c2379b986cb64c07ad870420d59e3e93 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:09.856711  9338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2379b986cb64c07ad870420d59e3e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.854377  9674 consensus_queue.cc:1048] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.847075  9623 raft_consensus.cc:385] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.869750  9350 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:09.881712  9623 raft_consensus.cc:740] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.918267  9622 tablet_bootstrap.cc:654] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.928755  9621 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:09.929620  9621 ts_tablet_manager.cc:1403] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.026s
I20260709 13:05:09.923525  9623 consensus_queue.cc:260] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:09.931622  9485 tablet_service.cc:1511] Processing CreateTablet for tablet c2379b986cb64c07ad870420d59e3e93 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:09.933755  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2379b986cb64c07ad870420d59e3e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.958228  9659 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:09.961210  9557 tablet_service.cc:1511] Processing CreateTablet for tablet f812886de1104bf391487c26fbadfd1f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:09.961917  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:09.962734  9557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f812886de1104bf391487c26fbadfd1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:09.963662  9540 leader_election.cc:343] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.966152  9250 catalog_manager.cc:5697] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:09.952008  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 52663.5us
I20260709 13:05:09.970082  9408 tablet_service.cc:1511] Processing CreateTablet for tablet c2379b986cb64c07ad870420d59e3e93 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:09.970719  9341 tablet_service.cc:1511] Processing CreateTablet for tablet f812886de1104bf391487c26fbadfd1f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:09.971377  9408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2379b986cb64c07ad870420d59e3e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.972012  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f812886de1104bf391487c26fbadfd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.982613  9410 tablet_service.cc:1511] Processing CreateTablet for tablet f812886de1104bf391487c26fbadfd1f (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:09.983981  9410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f812886de1104bf391487c26fbadfd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.986557  9620 tablet_bootstrap.cc:492] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:09.987185  9620 ts_tablet_manager.cc:1403] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.277s	user 0.015s	sys 0.019s
I20260709 13:05:09.993059  9620 raft_consensus.cc:359] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.993816  9620 raft_consensus.cc:385] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.994095  9620 raft_consensus.cc:740] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.994822  9620 consensus_queue.cc:260] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.997859  9621 raft_consensus.cc:359] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:09.998642  9621 raft_consensus.cc:385] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.998924  9621 raft_consensus.cc:740] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.013197  9483 tablet_service.cc:1511] Processing CreateTablet for tablet 301c8e3a2e3c4e10bea6d3bee8752338 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:10.013695  9659 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.014662  9483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301c8e3a2e3c4e10bea6d3bee8752338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.972955  9248 catalog_manager.cc:5697] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.017709  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:10.018321  9351 raft_consensus.cc:2468] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.018479  9350 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.009769  9623 ts_tablet_manager.cc:1434] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.175s	user 0.013s	sys 0.003s
I20260709 13:05:10.021890  9623 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:09.999699  9621 consensus_queue.cc:260] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.029780  9659 raft_consensus.cc:493] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.030561  9659 raft_consensus.cc:515] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.032817  9659 leader_election.cc:290] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.034271  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.034986  9501 raft_consensus.cc:2468] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.036201  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.036893  9426 raft_consensus.cc:2468] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.037473  9621 ts_tablet_manager.cc:1434] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.002s
I20260709 13:05:10.038336  9540 leader_election.cc:304] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:10.038586  9621 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.040192  9349 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.043581  9659 raft_consensus.cc:2804] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.044836  9659 raft_consensus.cc:493] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.045300  9659 raft_consensus.cc:3060] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.079989  9620 ts_tablet_manager.cc:1434] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:05:10.081291  9620 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.091668  9621 tablet_bootstrap.cc:654] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.093712  9674 consensus_queue.cc:1048] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.092655  9564 tablet_service.cc:1511] Processing CreateTablet for tablet 301c8e3a2e3c4e10bea6d3bee8752338 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:10.095793  9659 raft_consensus.cc:515] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.096880  9564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301c8e3a2e3c4e10bea6d3bee8752338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.102929  9674 consensus_queue.cc:1048] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.105154  9620 tablet_bootstrap.cc:654] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.114192  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:10.114914  9427 raft_consensus.cc:3060] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.111698  9622 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.111949  9350 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.113355  9659 leader_election.cc:290] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.118506  9341 tablet_service.cc:1511] Processing CreateTablet for tablet 301c8e3a2e3c4e10bea6d3bee8752338 (DEFAULT_TABLE table=test-workload [id=691cef62c34f414eb3da903a6129729c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:10.121395  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 301c8e3a2e3c4e10bea6d3bee8752338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.116325  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.123981  9500 raft_consensus.cc:3060] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.130856  9623 tablet_bootstrap.cc:654] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.133492  9539 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:10.128937  9622 ts_tablet_manager.cc:1403] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.393s	user 0.011s	sys 0.039s
I20260709 13:05:10.135696  9659 raft_consensus.cc:2804] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.136345  9659 raft_consensus.cc:697] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:10.137369  9659 consensus_queue.cc:237] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.163975  9620 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.164744  9620 ts_tablet_manager.cc:1403] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.008s
I20260709 13:05:10.161232  9427 raft_consensus.cc:2468] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.168273  9620 raft_consensus.cc:359] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.169118  9620 raft_consensus.cc:385] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.170048  9539 leader_election.cc:304] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:10.167398  9622 raft_consensus.cc:359] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.169514  9620 raft_consensus.cc:740] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.175189  9249 catalog_manager.cc:5697] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.177008  9659 raft_consensus.cc:2804] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.179927  9659 raft_consensus.cc:697] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:10.174360  9622 raft_consensus.cc:385] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.185202  9622 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.188647  9621 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.189254  9621 ts_tablet_manager.cc:1403] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.000s
I20260709 13:05:10.189121  9622 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.196022  9622 ts_tablet_manager.cc:1434] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:05:10.197024  9500 raft_consensus.cc:2468] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.201076  9659 consensus_queue.cc:237] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.205919  9622 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.204144  9620 consensus_queue.cc:260] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.208928  9620 ts_tablet_manager.cc:1434] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:05:10.213053  9623 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.213732  9623 ts_tablet_manager.cc:1403] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.009s
I20260709 13:05:10.214095  9620 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.219884  9622 tablet_bootstrap.cc:654] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.223613  9620 tablet_bootstrap.cc:654] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.226037  9700 consensus_queue.cc:1048] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.207571  9621 raft_consensus.cc:359] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.228225  9621 raft_consensus.cc:385] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.228572  9621 raft_consensus.cc:740] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.235155  9623 raft_consensus.cc:359] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.236579  9623 raft_consensus.cc:385] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.237049  9623 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.238315  9623 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.229535  9621 consensus_queue.cc:260] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.241618  9623 ts_tablet_manager.cc:1434] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:05:10.243484  9248 catalog_manager.cc:5697] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.245436  9623 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.245558  9622 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.246219  9622 ts_tablet_manager.cc:1403] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.012s
I20260709 13:05:10.249572  9622 raft_consensus.cc:359] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.250303  9622 raft_consensus.cc:385] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.250648  9622 raft_consensus.cc:740] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.251719  9622 consensus_queue.cc:260] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.260242  9628 consensus_queue.cc:1048] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.268539  9622 ts_tablet_manager.cc:1434] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:05:10.269718  9622 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.272009  9621 ts_tablet_manager.cc:1434] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 13:05:10.273372  9621 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.282984  9630 consensus_queue.cc:1048] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.289237  9621 tablet_bootstrap.cc:654] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.293954  9622 tablet_bootstrap.cc:654] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.297034  9623 tablet_bootstrap.cc:654] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.298141  9620 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.298290  9631 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.301580  9620 ts_tablet_manager.cc:1403] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.009s
I20260709 13:05:10.301734  9631 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.305280  9620 raft_consensus.cc:359] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.306118  9622 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.306075  9620 raft_consensus.cc:385] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.306562  9620 raft_consensus.cc:740] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.306710  9622 ts_tablet_manager.cc:1403] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.012s
I20260709 13:05:10.307384  9620 consensus_queue.cc:260] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.308382  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.308827  9628 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.309156  9574 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.309386  9628 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.310765  9315 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.311626  9628 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:10.316660  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.319715  9661 consensus_queue.cc:1048] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.320181  9426 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.305541  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.321830  9539 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:10.322572  9501 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.322851  9628 raft_consensus.cc:2804] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.323726  9628 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.324189  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.325394  9631 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:10.325974  9631 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.326326  9631 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.326676  9631 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:10.327168  9539 leader_election.cc:343] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.329030  9623 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.329972  9623 ts_tablet_manager.cc:1403] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.002s
I20260709 13:05:10.330816  9620 ts_tablet_manager.cc:1434] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:05:10.324201  9628 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.332506  9621 tablet_bootstrap.cc:492] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.333096  9621 ts_tablet_manager.cc:1403] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.003s
I20260709 13:05:10.333775  9623 raft_consensus.cc:359] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.334740  9623 raft_consensus.cc:385] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.335098  9623 raft_consensus.cc:740] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.336597  9623 consensus_queue.cc:260] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.339610  9620 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.344060  9621 raft_consensus.cc:359] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.344897  9621 raft_consensus.cc:385] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.345222  9621 raft_consensus.cc:740] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.349685  9620 tablet_bootstrap.cc:654] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.349452  9628 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.350322  9623 ts_tablet_manager.cc:1434] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:05:10.351929  9623 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.318244  9622 raft_consensus.cc:359] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.352923  9622 raft_consensus.cc:385] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.353221  9622 raft_consensus.cc:740] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.355861  9628 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:10.357347  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:10.358103  9426 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.360252  9623 tablet_bootstrap.cc:654] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.360492  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:10.362110  9539 leader_election.cc:343] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:10.363734  9315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 53094.6us
I20260709 13:05:10.364756  9622 consensus_queue.cc:260] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.366051  9621 consensus_queue.cc:260] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.368875  9661 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.369504  9661 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.373637  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.375329  9426 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.375955  9661 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:10.374194  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.377772  9681 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.378053  9392 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:10.378629  9681 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.382880  9539 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.383440  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.384367  9426 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:10.384509  9628 raft_consensus.cc:2804] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.385277  9628 raft_consensus.cc:697] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:10.385512  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.385710  9465 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:10.388069  9464 leader_election.cc:343] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.386391  9628 consensus_queue.cc:237] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.388765  9661 raft_consensus.cc:2749] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.387466  9681 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:10.390848  9681 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.391402  9681 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.391906  9681 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.398661  9622 ts_tablet_manager.cc:1434] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.003s
I20260709 13:05:10.401116  9622 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.351717  9631 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.410010  9621 ts_tablet_manager.cc:1434] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:05:10.417122  9247 catalog_manager.cc:5697] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.419317  9681 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.421451  9621 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.432410  9717 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.431651  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:10.432497  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:10.434661  9426 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.435024  9620 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
W20260709 13:05:10.435312  9464 leader_election.cc:343] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.435631  9620 ts_tablet_manager.cc:1403] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.031s
I20260709 13:05:10.436157  9717 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.439165  9621 tablet_bootstrap.cc:654] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.438807  9620 raft_consensus.cc:359] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.439432  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.439726  9620 raft_consensus.cc:385] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.440064  9620 raft_consensus.cc:740] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
W20260709 13:05:10.440932  9465 leader_election.cc:343] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.440925  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.440757  9620 consensus_queue.cc:260] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.441795  9501 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.443236  9620 ts_tablet_manager.cc:1434] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:10.444242  9620 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.444298  9623 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.444886  9623 ts_tablet_manager.cc:1403] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.026s
I20260709 13:05:10.444733  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:10.446341  9465 leader_election.cc:343] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.446782  9465 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.447618  9623 raft_consensus.cc:359] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.448355  9623 raft_consensus.cc:385] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.448624  9623 raft_consensus.cc:740] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.431721  9681 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:10.449436  9622 tablet_bootstrap.cc:654] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.449365  9681 raft_consensus.cc:2749] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.452142  9620 tablet_bootstrap.cc:654] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.455474  9623 consensus_queue.cc:260] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.458354  9623 ts_tablet_manager.cc:1434] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:10.459774  9623 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.455142  9717 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:10.461115  9426 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:10.465719  9501 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:10.467141  9317 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.468394  9713 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.468988  9713 raft_consensus.cc:697] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:10.469192  9631 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:10.471561  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:10.472373  9574 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.476022  9713 consensus_queue.cc:237] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.478922  9623 tablet_bootstrap.cc:654] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.483915  9465 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:10.486712  9719 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.488706  9622 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.489244  9622 ts_tablet_manager.cc:1403] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.004s
I20260709 13:05:10.490516  9621 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.491255  9621 ts_tablet_manager.cc:1403] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.004s
I20260709 13:05:10.494845  9574 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:10.495677  9621 raft_consensus.cc:359] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.496702  9621 raft_consensus.cc:385] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.497058  9623 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.497121  9621 raft_consensus.cc:740] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.497691  9623 ts_tablet_manager.cc:1403] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.008s
I20260709 13:05:10.497810  9628 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.498366  9628 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.500560  9628 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.500844  9623 raft_consensus.cc:359] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.500620  9622 raft_consensus.cc:359] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.501565  9623 raft_consensus.cc:385] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.501765  9622 raft_consensus.cc:385] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.501885  9623 raft_consensus.cc:740] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.502336  9622 raft_consensus.cc:740] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.502909  9623 consensus_queue.cc:260] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.503310  9622 consensus_queue.cc:260] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.505304  9623 ts_tablet_manager.cc:1434] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:05:10.505273  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.506443  9623 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.506547  9622 ts_tablet_manager.cc:1434] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
W20260709 13:05:10.507611  9540 leader_election.cc:343] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.506664  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.508773  9719 raft_consensus.cc:697] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:10.508948  9349 raft_consensus.cc:2468] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.508471  9622 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.510908  9539 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:10.512956  9628 raft_consensus.cc:2804] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.513434  9628 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.513893  9628 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.513206  9250 catalog_manager.cc:5697] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.518488  9622 tablet_bootstrap.cc:654] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.520447  9620 tablet_bootstrap.cc:492] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.521006  9620 ts_tablet_manager.cc:1403] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.002s
I20260709 13:05:10.521126  9719 consensus_queue.cc:237] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.525019  9628 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.521584  9659 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.532135  9659 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.534329  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.521522  9621 consensus_queue.cc:260] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:10.536360  9540 leader_election.cc:343] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.539935  9659 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:10.540745  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.530861  9620 raft_consensus.cc:359] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.543535  9620 raft_consensus.cc:385] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.544077  9620 raft_consensus.cc:740] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.544284  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.544857  9620 consensus_queue.cc:260] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:10.543525  9539 leader_election.cc:343] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:10.546576  9539 leader_election.cc:343] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.547009  9539 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.548214  9700 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.550194  9620 ts_tablet_manager.cc:1434] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:05:10.551203  9620 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.553514  9621 ts_tablet_manager.cc:1434] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.004s
I20260709 13:05:10.556403  9623 tablet_bootstrap.cc:654] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.556738  9620 tablet_bootstrap.cc:654] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.563400  9621 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.565590  9659 consensus_queue.cc:1048] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.569515  9623 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.570242  9623 ts_tablet_manager.cc:1403] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.064s	user 0.001s	sys 0.018s
I20260709 13:05:10.574936  9623 raft_consensus.cc:359] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.575892  9623 raft_consensus.cc:385] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.576367  9623 raft_consensus.cc:740] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.577621  9623 consensus_queue.cc:260] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.580572  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:10.581459  9350 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.577370  9247 catalog_manager.cc:5697] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.588049  9628 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.592100  9350 raft_consensus.cc:2468] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:10.594172  9539 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:10.595763  9628 raft_consensus.cc:2804] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.598863  9628 raft_consensus.cc:697] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:10.599599  9623 ts_tablet_manager.cc:1434] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:05:10.599781  9628 consensus_queue.cc:237] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.600425  9621 tablet_bootstrap.cc:654] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.601073  9623 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.609153  9622 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.609805  9622 ts_tablet_manager.cc:1403] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.045s
I20260709 13:05:10.610657  9426 raft_consensus.cc:3060] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.613624  9622 raft_consensus.cc:359] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.614621  9622 raft_consensus.cc:385] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.614971  9622 raft_consensus.cc:740] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.615887  9622 consensus_queue.cc:260] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.618705  9622 ts_tablet_manager.cc:1434] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:05:10.624215  9501 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.630358  9622 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.638664  9622 tablet_bootstrap.cc:654] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.649402  9719 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.649250  9628 consensus_queue.cc:1048] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.650082  9719 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.656597  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.661917  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.664369  9465 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.662818  9719 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:10.696277  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:10.698835  9620 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.699429  9620 ts_tablet_manager.cc:1403] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.014s
I20260709 13:05:10.698284  9247 catalog_manager.cc:5697] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.702580  9620 raft_consensus.cc:359] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.703385  9620 raft_consensus.cc:385] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.703688  9620 raft_consensus.cc:740] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.706103  9623 tablet_bootstrap.cc:654] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.706323  9717 raft_consensus.cc:2749] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:10.719244  9620 consensus_queue.cc:260] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.724372  9620 ts_tablet_manager.cc:1434] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:05:10.725632  9620 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.731416  9622 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.732007  9622 ts_tablet_manager.cc:1403] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.050s
I20260709 13:05:10.732573  9620 tablet_bootstrap.cc:654] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.733333  9621 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.733878  9621 ts_tablet_manager.cc:1403] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.171s	user 0.029s	sys 0.060s
I20260709 13:05:10.734869  9622 raft_consensus.cc:359] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.735574  9622 raft_consensus.cc:385] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.735857  9622 raft_consensus.cc:740] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.736558  9622 consensus_queue.cc:260] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.737102  9621 raft_consensus.cc:359] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.737890  9621 raft_consensus.cc:385] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.738196  9621 raft_consensus.cc:740] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.738701  9622 ts_tablet_manager.cc:1434] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:10.738998  9621 consensus_queue.cc:260] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.739681  9622 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.741400  9621 ts_tablet_manager.cc:1434] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:05:10.742053  9623 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.742604  9623 ts_tablet_manager.cc:1403] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.001s
I20260709 13:05:10.743072  9621 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.745838  9623 raft_consensus.cc:359] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.746624  9623 raft_consensus.cc:385] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.746943  9623 raft_consensus.cc:740] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.747829  9623 consensus_queue.cc:260] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.750403  9622 tablet_bootstrap.cc:654] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.750403  9621 tablet_bootstrap.cc:654] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.759393  9623 ts_tablet_manager.cc:1434] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:10.762009  9622 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.762573  9622 ts_tablet_manager.cc:1403] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 13:05:10.764969  9623 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.765444  9622 raft_consensus.cc:359] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.766167  9622 raft_consensus.cc:385] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.766423  9622 raft_consensus.cc:740] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.767318  9622 consensus_queue.cc:260] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.769340  9622 ts_tablet_manager.cc:1434] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:10.770321  9622 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.774354  9620 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.775123  9620 ts_tablet_manager.cc:1403] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.009s
I20260709 13:05:10.776288  9622 tablet_bootstrap.cc:654] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.779585  9621 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.780337  9621 ts_tablet_manager.cc:1403] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 13:05:10.781333  9623 tablet_bootstrap.cc:654] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.784310  9621 raft_consensus.cc:359] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.784523  9620 raft_consensus.cc:359] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.788271  9621 raft_consensus.cc:385] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.788398  9620 raft_consensus.cc:385] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.788650  9621 raft_consensus.cc:740] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.788817  9620 raft_consensus.cc:740] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.789422  9621 consensus_queue.cc:260] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.789636  9620 consensus_queue.cc:260] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.791550  9621 ts_tablet_manager.cc:1434] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:05:10.791880  9620 ts_tablet_manager.cc:1434] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:05:10.787513  9622 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.792570  9621 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.792640  9622 ts_tablet_manager.cc:1403] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.012s
I20260709 13:05:10.792856  9659 consensus_queue.cc:1048] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.799628  9621 tablet_bootstrap.cc:654] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.799835  9620 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:10.806267  9628 consensus_queue.cc:1048] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.807447  9630 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.796018  9622 raft_consensus.cc:359] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.808284  9622 raft_consensus.cc:385] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.808640  9622 raft_consensus.cc:740] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.809412  9622 consensus_queue.cc:260] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.811825  9622 ts_tablet_manager.cc:1434] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:05:10.811503  9630 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.812932  9622 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.813115  9621 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:10.813670  9621 ts_tablet_manager.cc:1403] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.013s
I20260709 13:05:10.814584  9630 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.815201  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.816074  9623 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:10.816447  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:10.816813  9391 leader_election.cc:343] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.816560  9621 raft_consensus.cc:359] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.817245  9620 tablet_bootstrap.cc:654] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.817540  9621 raft_consensus.cc:385] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.817507  9574 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:10.818130  9621 raft_consensus.cc:740] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.819140  9390 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.819970  9630 raft_consensus.cc:2804] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.820443  9630 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.820873  9630 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.820638  9621 consensus_queue.cc:260] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.823153  9621 ts_tablet_manager.cc:1434] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:05:10.824208  9621 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:10.816627  9623 ts_tablet_manager.cc:1403] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 13:05:10.825155  9622 tablet_bootstrap.cc:654] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.836056  9621 tablet_bootstrap.cc:654] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.830904  9713 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.829573  9659 consensus_queue.cc:1048] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:10.836799  9713 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.840737  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.842743  9713 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:10.845842  9350 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.846465  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.848664  9315 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:10.835140  9623 raft_consensus.cc:359] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.851775  9623 raft_consensus.cc:385] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.852209  9623 raft_consensus.cc:740] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.854075  9713 raft_consensus.cc:2749] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.857837  9628 consensus_queue.cc:1048] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.858094  9674 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.860448  9674 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.863248  9630 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:10.866122  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:10.866745  9574 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.868352  9717 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.868896  9717 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.854126  9623 consensus_queue.cc:260] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.871006  9717 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.872267  9623 ts_tablet_manager.cc:1434] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:05:10.873719  9623 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:10.878458  9713 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.878885  9622 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:10.879379  9622 ts_tablet_manager.cc:1403] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.002s
I20260709 13:05:10.879040  9713 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.879630  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:10.881093  9391 leader_election.cc:343] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.882328  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.882965  9427 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.874922  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.875557  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:10.882988  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.884486  9499 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.884865  9350 raft_consensus.cc:2393] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 1: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:10.877336  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.885663  9500 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.877570  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:10.886353  9317 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.886650  9351 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:10.886767  9631 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.887393  9711 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.887329  9631 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.887828  9711 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.888223  9711 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.882555  9622 raft_consensus.cc:359] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.888933  9622 raft_consensus.cc:385] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.889469  9622 raft_consensus.cc:740] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.889652  9631 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.883117  9713 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.876590  9674 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.890404  9622 consensus_queue.cc:260] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.894523  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.895228  9500 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.896075  9622 ts_tablet_manager.cc:1434] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 13:05:10.897245  9622 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:10.900368  9539 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.901257  9674 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.901638  9674 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.901978  9674 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.902168  9317 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.903184  9713 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.903549  9713 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.903867  9713 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.904665  9464 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.905220  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:10.905676  9717 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.905891  9426 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:10.910275  9622 tablet_bootstrap.cc:654] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.914022  9713 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.916972  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:10.917613  9427 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.919016  9717 raft_consensus.cc:2749] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.919508  9674 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:10.924330  9711 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:10.925123  9674 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.927277  9711 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.874233  9574 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:10.927979  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:10.929351  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.943408  9426 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.943825  9499 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.945994  9631 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.930469  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.948458  9500 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.933917  9427 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:10.953159  9316 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.953684  9426 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:10.953159  9390 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:10.954926  9711 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.937038  9674 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.956180  9674 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:10.937525  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:10.957937  9316 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:10.958312  9498 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.958825  9631 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.934860  9713 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.969414  9674 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:10.971230  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:10.938194  9717 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.942238  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:10.974411  9349 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.955220  9688 raft_consensus.cc:2804] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.938625  9630 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:10.983227  9623 tablet_bootstrap.cc:654] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.963660  9499 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:10.983867  9711 raft_consensus.cc:697] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:10.995905  9620 tablet_bootstrap.cc:492] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:10.996757  9620 ts_tablet_manager.cc:1403] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.006s
I20260709 13:05:10.981617  9717 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.001745  9631 raft_consensus.cc:697] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:11.000808  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.002643  9631 consensus_queue.cc:237] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.003466  9427 raft_consensus.cc:2393] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:11.005827  9539 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:11.007467  9743 consensus_queue.cc:1048] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.008991  9743 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.967871  9498 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:11.020434  9622 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.021320  9622 ts_tablet_manager.cc:1403] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.038s
I20260709 13:05:10.984735  9688 raft_consensus.cc:697] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:10.988335  9500 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:11.040496  9622 raft_consensus.cc:359] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.041354  9717 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.041522  9622 raft_consensus.cc:385] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.041903  9622 raft_consensus.cc:740] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.042593  9622 consensus_queue.cc:260] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.043167  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:11.045030  9465 leader_election.cc:343] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.047163  9743 raft_consensus.cc:2749] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.048297  9620 raft_consensus.cc:359] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.049616  9620 raft_consensus.cc:385] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.040455  9719 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.052569  9540 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:11.053303  9719 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.054205  9674 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.054724  9674 raft_consensus.cc:697] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:11.055441  9719 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.055594  9674 consensus_queue.cc:237] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.057322  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.057793  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:11.059670  9465 leader_election.cc:343] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.060148  9688 consensus_queue.cc:237] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.035081  9711 consensus_queue.cc:237] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.050019  9620 raft_consensus.cc:740] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.062492  9620 consensus_queue.cc:260] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.063756  9351 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:11.065228  9621 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.065904  9621 ts_tablet_manager.cc:1403] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.242s	user 0.039s	sys 0.010s
I20260709 13:05:11.065330  9620 ts_tablet_manager.cc:1434] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 13:05:11.067548  9620 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.074316  9620 tablet_bootstrap.cc:654] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.074648  9621 raft_consensus.cc:359] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.075510  9621 raft_consensus.cc:385] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.065228  9465 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:11.077126  9621 raft_consensus.cc:740] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.077581  9349 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:11.082563  9621 consensus_queue.cc:260] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.089339  9622 ts_tablet_manager.cc:1434] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.020s
I20260709 13:05:11.090463  9622 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.090588  9623 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.091138  9623 ts_tablet_manager.cc:1403] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.218s	user 0.024s	sys 0.001s
I20260709 13:05:11.092563  9717 consensus_queue.cc:1048] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.094595  9623 raft_consensus.cc:359] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.095413  9623 raft_consensus.cc:385] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.095707  9623 raft_consensus.cc:740] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.096843  9623 consensus_queue.cc:260] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.106325  9622 tablet_bootstrap.cc:654] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.115720  9621 ts_tablet_manager.cc:1434] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:05:11.117372  9621 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.098709  9688 raft_consensus.cc:493] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.121537  9623 ts_tablet_manager.cc:1434] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:05:11.123162  9623 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.125448  9756 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.125547  9688 raft_consensus.cc:515] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.127708  9756 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.143424  9756 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.144733  9711 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.150357  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:11.151139  9501 raft_consensus.cc:2468] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.152607  9392 leader_election.cc:304] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:11.153676  9249 catalog_manager.cc:5697] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.156891  9630 raft_consensus.cc:2804] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.157390  9630 raft_consensus.cc:493] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.157730  9630 raft_consensus.cc:3060] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.160699  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.161000  9688 leader_election.cc:290] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.160712  9247 catalog_manager.cc:5697] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.165413  9621 tablet_bootstrap.cc:654] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.162091  9674 raft_consensus.cc:493] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.170554  9464 leader_election.cc:343] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.170375  9674 raft_consensus.cc:515] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.171031  9464 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:11.172204  9719 raft_consensus.cc:2749] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.173121  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.177999  9719 consensus_queue.cc:1048] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.179797  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.180517  9575 raft_consensus.cc:2468] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.180918  9630 raft_consensus.cc:515] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.182307  9426 raft_consensus.cc:2393] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:11.189699  9622 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.189366  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:11.190255  9622 ts_tablet_manager.cc:1403] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.100s	user 0.027s	sys 0.018s
I20260709 13:05:11.190564  9623 tablet_bootstrap.cc:654] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.190338  9500 raft_consensus.cc:3060] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.193336  9630 leader_election.cc:290] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.193928  9620 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.194458  9620 ts_tablet_manager.cc:1403] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.128s	user 0.020s	sys 0.009s
I20260709 13:05:11.195708  9622 raft_consensus.cc:359] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.196678  9622 raft_consensus.cc:385] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.197036  9622 raft_consensus.cc:740] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.199402  9622 consensus_queue.cc:260] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.154053  9246 catalog_manager.cc:5697] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:11.203986  9620 raft_consensus.cc:359] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.204680  9622 ts_tablet_manager.cc:1434] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:05:11.204866  9620 raft_consensus.cc:385] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.205719  9620 raft_consensus.cc:740] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.206380  9622 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.206471  9620 consensus_queue.cc:260] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.208503  9621 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.210044  9621 ts_tablet_manager.cc:1403] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.006s
I20260709 13:05:11.210891  9628 consensus_queue.cc:1048] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.211877  9620 ts_tablet_manager.cc:1434] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:05:11.212903  9620 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.213932  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.214392  9622 tablet_bootstrap.cc:654] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.214618  9573 raft_consensus.cc:3060] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.215445  9717 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.216002  9717 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.220247  9620 tablet_bootstrap.cc:654] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.220165  9717 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:11.220890  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.223749  9674 leader_election.cc:290] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:11.229744  9465 leader_election.cc:343] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.230723  9756 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.252602  9621 raft_consensus.cc:359] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.253391  9621 raft_consensus.cc:385] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.253697  9621 raft_consensus.cc:740] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
W20260709 13:05:11.255021  9760 log.cc:927] Time spent T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:11.257489  9628 raft_consensus.cc:493] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.255185  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:11.258059  9628 raft_consensus.cc:515] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.261040  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.262282  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:11.252766  9248 catalog_manager.cc:5697] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.262797  9628 leader_election.cc:290] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.264498  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.265211  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.266173  9573 raft_consensus.cc:2468] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
W20260709 13:05:11.267925  9539 leader_election.cc:343] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:11.268993  9539 leader_election.cc:343] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.269394  9539 leader_election.cc:304] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:11.269522  9621 consensus_queue.cc:260] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.270962  9674 raft_consensus.cc:2749] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.262908  9349 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.273794  9621 ts_tablet_manager.cc:1434] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:05:11.274959  9621 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.258616  9500 raft_consensus.cc:2468] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:11.277343  9392 leader_election.cc:304] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:11.277935  9464 leader_election.cc:343] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.278258  9630 raft_consensus.cc:2804] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.278442  9464 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:11.278810  9630 raft_consensus.cc:697] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:11.279943  9719 raft_consensus.cc:2749] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.279676  9630 consensus_queue.cc:237] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.282042  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:11.282776  9426 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.280963  9756 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.286316  9540 leader_election.cc:304] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:11.287710  9628 raft_consensus.cc:2749] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.291721  9623 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.292718  9623 ts_tablet_manager.cc:1403] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.012s
I20260709 13:05:11.299474  9711 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.298350  9349 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.300127  9711 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.303093  9622 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.303941  9622 ts_tablet_manager.cc:1403] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.016s
I20260709 13:05:11.305473  9465 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:11.308619  9756 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.309417  9756 raft_consensus.cc:697] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:11.310649  9622 raft_consensus.cc:359] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.310627  9756 consensus_queue.cc:237] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.311589  9622 raft_consensus.cc:385] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.312057  9622 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.313235  9621 tablet_bootstrap.cc:654] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.315286  9622 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.318867  9623 raft_consensus.cc:359] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.321991  9623 raft_consensus.cc:385] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.322422  9623 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.323366  9623 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.327006  9622 ts_tablet_manager.cc:1434] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:05:11.328296  9622 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.333506  9623 ts_tablet_manager.cc:1434] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:05:11.329465  9426 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.334844  9711 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.335798  9623 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.333724  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.337569  9575 raft_consensus.cc:2393] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:11.352334  9756 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.352932  9756 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.355721  9623 tablet_bootstrap.cc:654] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.357296  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.358033  9575 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:11.359421  9464 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:11.360318  9719 raft_consensus.cc:2804] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.360705  9719 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.360762  9756 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:11.361126  9719 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.361687  9620 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.362488  9620 ts_tablet_manager.cc:1403] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.150s	user 0.025s	sys 0.018s
I20260709 13:05:11.342535  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.366004  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.367185  9621 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.367720  9621 ts_tablet_manager.cc:1403] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.015s
W20260709 13:05:11.367972  9465 leader_election.cc:343] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.370642  9621 raft_consensus.cc:359] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.371361  9621 raft_consensus.cc:385] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.371644  9621 raft_consensus.cc:740] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.372400  9316 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:11.372483  9621 consensus_queue.cc:260] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.373833  9711 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.374637  9621 ts_tablet_manager.cc:1434] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:11.375676  9621 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.377161  9719 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.378229  9620 raft_consensus.cc:359] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.380796  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.381026  9756 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.381026  9719 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:11.381672  9575 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.381932  9623 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.381749  9756 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.382440  9623 ts_tablet_manager.cc:1403] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.010s
I20260709 13:05:11.383698  9756 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.384954  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.386008  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:11.386472  9464 leader_election.cc:343] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.386475  9623 raft_consensus.cc:359] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.387478  9623 raft_consensus.cc:385] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.387804  9623 raft_consensus.cc:740] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.386937  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.388428  9711 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.388674  9623 consensus_queue.cc:260] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:11.389550  9465 leader_election.cc:343] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.389626  9349 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.390166  9465 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:11.391260  9575 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.391377  9756 raft_consensus.cc:2749] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.386391  9620 raft_consensus.cc:385] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.391932  9620 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.392858  9620 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.395277  9620 ts_tablet_manager.cc:1434] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:05:11.396274  9620 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.397378  9349 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.399725  9621 tablet_bootstrap.cc:654] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.399802  9246 catalog_manager.cc:5697] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.404433  9622 tablet_bootstrap.cc:654] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.410048  9622 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.410540  9622 ts_tablet_manager.cc:1403] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:05:11.410666  9623 ts_tablet_manager.cc:1434] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:05:11.411607  9623 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.411856  9620 tablet_bootstrap.cc:654] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.413496  9622 raft_consensus.cc:359] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.414265  9622 raft_consensus.cc:385] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.414541  9622 raft_consensus.cc:740] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.415941  9464 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:11.417928  9623 tablet_bootstrap.cc:654] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.418642  9621 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.419178  9621 ts_tablet_manager.cc:1403] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:05:11.418762  9713 consensus_queue.cc:1048] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.422637  9621 raft_consensus.cc:359] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.423358  9621 raft_consensus.cc:385] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.423710  9621 raft_consensus.cc:740] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.424515  9719 raft_consensus.cc:2804] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.425029  9719 raft_consensus.cc:697] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:11.425859  9719 consensus_queue.cc:237] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.423399  9245 catalog_manager.cc:5697] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:11.428014  9622 consensus_queue.cc:260] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.432297  9717 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.432842  9717 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.432895  9621 consensus_queue.cc:260] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.435177  9621 ts_tablet_manager.cc:1434] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:11.436216  9621 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.435822  9717 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.448913  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.459064  9620 tablet_bootstrap.cc:492] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.459792  9620 ts_tablet_manager.cc:1403] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:05:11.462901  9623 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.462716  9620 raft_consensus.cc:359] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.463406  9623 ts_tablet_manager.cc:1403] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.009s
I20260709 13:05:11.463533  9620 raft_consensus.cc:385] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.463820  9620 raft_consensus.cc:740] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.464624  9620 consensus_queue.cc:260] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.466243  9623 raft_consensus.cc:359] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.466681  9620 ts_tablet_manager.cc:1434] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:11.466984  9623 raft_consensus.cc:385] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.467271  9623 raft_consensus.cc:740] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.467720  9620 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.467898  9623 consensus_queue.cc:260] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.470039  9623 ts_tablet_manager.cc:1434] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:05:11.471024  9623 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.472962  9621 tablet_bootstrap.cc:654] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.474502  9620 tablet_bootstrap.cc:654] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.477560  9622 ts_tablet_manager.cc:1434] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.067s	user 0.017s	sys 0.011s
I20260709 13:05:11.478693  9622 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.478557  9752 consensus_queue.cc:1048] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:11.482362  9465 leader_election.cc:343] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.479854  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:11.484488  9427 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:11.485802  9465 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:11.487061  9719 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.487536  9719 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.487928  9623 tablet_bootstrap.cc:654] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.487943  9719 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.489012  9622 tablet_bootstrap.cc:654] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.492482  9752 consensus_queue.cc:1048] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.496106  9719 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.500980  9621 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.501542  9621 ts_tablet_manager.cc:1403] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.001s
I20260709 13:05:11.506364  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:11.507378  9349 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.501030  9628 consensus_queue.cc:1048] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:05:11.514696  9621 raft_consensus.cc:359] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.516333  9719 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.521040  9621 raft_consensus.cc:385] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.527271  9621 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.524379  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:11.536149  9349 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.536550  9621 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.536212  9427 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.542289  9621 ts_tablet_manager.cc:1434] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:05:11.543447  9621 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.544813  9465 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:11.545930  9719 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.546458  9719 raft_consensus.cc:697] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:11.549189  9719 consensus_queue.cc:237] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.551185  9752 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.552243  9621 tablet_bootstrap.cc:654] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.551796  9752 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.555672  9752 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.557559  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:11.559252  9316 leader_election.cc:343] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.560601  9623 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.561173  9623 ts_tablet_manager.cc:1403] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.011s
I20260709 13:05:11.561285  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.562115  9575 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:11.563066  9620 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.563561  9620 ts_tablet_manager.cc:1403] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.008s
I20260709 13:05:11.565582  9623 raft_consensus.cc:359] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.566820  9623 raft_consensus.cc:385] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.566646  9620 raft_consensus.cc:359] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.567131  9623 raft_consensus.cc:740] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.567371  9620 raft_consensus.cc:385] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.567670  9620 raft_consensus.cc:740] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.568348  9620 consensus_queue.cc:260] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.568647  9315 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:11.570042  9623 consensus_queue.cc:260] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.570505  9620 ts_tablet_manager.cc:1434] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:05:11.571488  9620 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.571566  9711 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.572155  9623 ts_tablet_manager.cc:1434] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:11.574743  9711 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.575198  9711 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.576486  9622 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.577042  9622 ts_tablet_manager.cc:1403] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.004s
I20260709 13:05:11.580541  9622 raft_consensus.cc:359] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.581357  9622 raft_consensus.cc:385] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.581599  9622 raft_consensus.cc:740] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.581797  9628 consensus_queue.cc:1048] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.582329  9622 consensus_queue.cc:260] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.583284  9620 tablet_bootstrap.cc:654] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.584510  9622 ts_tablet_manager.cc:1434] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:05:11.585649  9622 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.601559  9623 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.608736  9622 tablet_bootstrap.cc:654] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.593858  9630 consensus_queue.cc:1048] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:05:11.612928  9630 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.613582  9630 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.616688  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:11.617133  9688 consensus_queue.cc:1048] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.617363  9501 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.621690  9392 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:11.624466  9688 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.627985  9688 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.630927  9688 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.624606  9427 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:11.640842  9621 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.627993  9630 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.642613  9621 ts_tablet_manager.cc:1403] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.022s
I20260709 13:05:11.644217  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.644984  9574 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.646790  9621 raft_consensus.cc:359] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.647529  9621 raft_consensus.cc:385] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.647810  9621 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.629650  9711 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.652180  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.652829  9574 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.656476  9623 tablet_bootstrap.cc:654] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.662542  9621 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.680683  9711 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:11.684844  9622 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.685712  9622 ts_tablet_manager.cc:1403] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.021s
I20260709 13:05:11.688016  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:11.692862  9427 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.699240  9631 consensus_queue.cc:1048] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.689081  9622 raft_consensus.cc:359] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.706110  9622 raft_consensus.cc:385] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.714821  9621 ts_tablet_manager.cc:1434] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:05:11.706416  9622 raft_consensus.cc:740] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.712502  9574 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:11.719511  9621 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.717859  9622 consensus_queue.cc:260] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:11.724834  9786 log.cc:927] Time spent T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:05:11.715396  9631 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.735401  9623 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.735982  9623 ts_tablet_manager.cc:1403] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.036s
I20260709 13:05:11.732724  9631 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.739158  9631 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:11.740831  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:11.741379  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.742210  9620 tablet_bootstrap.cc:492] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.742277  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:11.742873  9620 ts_tablet_manager.cc:1403] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.172s	user 0.026s	sys 0.035s
I20260709 13:05:11.743083  9501 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:11.744892  9623 raft_consensus.cc:359] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.745667  9623 raft_consensus.cc:385] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.746032  9623 raft_consensus.cc:740] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.745747  9620 raft_consensus.cc:359] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.746541  9620 raft_consensus.cc:385] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.746838  9620 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.747496  9620 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.749668  9620 ts_tablet_manager.cc:1434] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:11.750638  9620 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.750710  9317 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:11.742115  9575 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:11.752202  9713 raft_consensus.cc:2804] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.752566  9713 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.752873  9713 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.746855  9623 consensus_queue.cc:260] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.756973  9623 ts_tablet_manager.cc:1434] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:05:11.757644  9621 tablet_bootstrap.cc:654] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.758029  9623 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.760360  9622 ts_tablet_manager.cc:1434] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:05:11.761384  9622 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.764940  9688 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.767253  9688 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.766489  9246 catalog_manager.cc:5697] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.779130  9623 tablet_bootstrap.cc:654] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.779194  9246 catalog_manager.cc:5697] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:11.768744  9622 tablet_bootstrap.cc:654] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.770673  9713 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.787595  9315 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:11.773375  9620 tablet_bootstrap.cc:654] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.788976  9711 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.789675  9711 raft_consensus.cc:697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:11.790598  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:11.791342  9501 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.790835  9711 consensus_queue.cc:237] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.813084  9427 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:11.811451  9713 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:11.806928  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 57394.9us
I20260709 13:05:11.816138  9798 raft_consensus.cc:493] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.816576  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:11.816665  9798 raft_consensus.cc:515] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.817328  9498 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.819056  9798 leader_election.cc:290] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:11.820420  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.821121  9575 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.824198  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:11.825863  9620 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:11.826414  9620 ts_tablet_manager.cc:1403] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.003s
I20260709 13:05:11.828437  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.829069  9574 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.829793  9798 consensus_queue.cc:1048] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.829958  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.831063  9573 raft_consensus.cc:2468] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.839139  9390 leader_election.cc:304] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:11.839519  9630 consensus_queue.cc:1048] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.843075  9780 consensus_queue.cc:1048] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.847963  9630 raft_consensus.cc:2804] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.848433  9630 raft_consensus.cc:493] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.848748  9630 raft_consensus.cc:3060] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.849808  9621 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:11.850428  9621 ts_tablet_manager.cc:1403] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.030s
I20260709 13:05:11.856487  9622 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:11.863590  9622 ts_tablet_manager.cc:1403] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.000s
W20260709 13:05:11.875702  9391 leader_election.cc:343] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.877640  9620 raft_consensus.cc:359] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.878365  9620 raft_consensus.cc:385] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.879072  9620 raft_consensus.cc:740] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.883885  9621 raft_consensus.cc:359] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.884687  9574 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:11.886107  9390 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:11.886642  9623 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:11.884908  9621 raft_consensus.cc:385] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.887296  9501 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:11.887331  9688 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.888110  9688 raft_consensus.cc:697] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:11.888975  9688 consensus_queue.cc:237] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.887355  9621 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.887143  9623 ts_tablet_manager.cc:1403] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.012s
I20260709 13:05:11.895344  9317 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:11.896341  9622 raft_consensus.cc:359] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.897084  9622 raft_consensus.cc:385] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.894428  9621 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:11.897353  9622 raft_consensus.cc:740] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.899467  9622 consensus_queue.cc:260] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.900286  9631 raft_consensus.cc:2804] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.900911  9631 raft_consensus.cc:697] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:11.901465  9621 ts_tablet_manager.cc:1434] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:05:11.902505  9621 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:11.911960  9622 ts_tablet_manager.cc:1434] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:05:11.923918  9622 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:11.904191  9620 consensus_queue.cc:260] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.920962  9623 raft_consensus.cc:359] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.926649  9623 raft_consensus.cc:385] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.927006  9623 raft_consensus.cc:740] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.901763  9631 consensus_queue.cc:237] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:11.945441  9623 consensus_queue.cc:260] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.946431  9620 ts_tablet_manager.cc:1434] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.002s
I20260709 13:05:11.947175  9620 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:11.940659  9630 raft_consensus.cc:515] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:11.956398  9621 tablet_bootstrap.cc:654] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.960562  9796 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.961184  9498 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:11.965075  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:11.967088  9623 ts_tablet_manager.cc:1434] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:05:11.967996  9623 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:11.966192  9630 leader_election.cc:290] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:11.972177  9780 consensus_queue.cc:1048] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.974596  9575 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:11.978941  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:11.979604  9352 raft_consensus.cc:3060] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.961189  9796 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:11.985118  9796 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:11.987303  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:11.987998  9501 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.978044  9572 raft_consensus.cc:3060] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.989439  9392 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:11.990075  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:11.990319  9630 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:11.990849  9630 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.991329  9630 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.996137  9575 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:11.998407  9752 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.998941  9752 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.000527  9620 tablet_bootstrap.cc:654] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.001735  9752 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:12.003929  9622 tablet_bootstrap.cc:654] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.010303  9572 raft_consensus.cc:2468] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.004537  9352 raft_consensus.cc:2468] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.011942  9390 leader_election.cc:304] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.013695  9799 raft_consensus.cc:2804] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.014310  9799 raft_consensus.cc:697] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:12.015030  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.015147  9799 consensus_queue.cc:237] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.015918  9501 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:12.016398  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:12.020733  9316 leader_election.cc:343] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.021487  9317 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:12.022666  9752 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.023059  9752 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.023439  9752 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.022876  9630 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.046039  9623 tablet_bootstrap.cc:654] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.047049  9719 consensus_queue.cc:1048] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.041795  9630 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:12.054158  9621 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:12.055224  9621 ts_tablet_manager.cc:1403] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.014s
I20260709 13:05:12.055613  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:12.054455  9717 raft_consensus.cc:493] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.056339  9572 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.056422  9717 raft_consensus.cc:515] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.057854  9752 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.058748  9717 leader_election.cc:290] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.058629  9621 raft_consensus.cc:359] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.061903  9621 raft_consensus.cc:385] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.062273  9621 raft_consensus.cc:740] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.063047  9621 consensus_queue.cc:260] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.064512  9620 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:12.065013  9620 ts_tablet_manager.cc:1403] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.118s	user 0.008s	sys 0.016s
I20260709 13:05:12.065125  9621 ts_tablet_manager.cc:1434] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:05:12.065249  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:12.066107  9621 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:12.089733  9245 catalog_manager.cc:5697] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.094926  9620 raft_consensus.cc:359] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.095988  9620 raft_consensus.cc:385] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:12.092483  9316 leader_election.cc:343] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.096383  9620 raft_consensus.cc:740] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.097105  9620 consensus_queue.cc:260] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.098752  9620 ts_tablet_manager.cc:1434] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:05:12.099843  9620 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:12.101045  9245 catalog_manager.cc:5697] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.102803  9621 tablet_bootstrap.cc:654] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.103571  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.104415  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.105005  9501 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.105057  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:12.106775  9464 leader_election.cc:343] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.107070  9752 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:12.107344  9572 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.109270  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.109877  9498 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.111217  9390 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.112304  9630 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.112816  9630 raft_consensus.cc:697] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
W20260709 13:05:12.113704  9465 leader_election.cc:343] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.114255  9465 leader_election.cc:304] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.116520  9780 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.117055  9780 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.118391  9622 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:12.118934  9622 ts_tablet_manager.cc:1403] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.195s	user 0.024s	sys 0.017s
I20260709 13:05:12.119396  9780 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.122321  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.126820  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:12.128439  9464 leader_election.cc:343] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.113746  9630 consensus_queue.cc:237] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.138196  9780 raft_consensus.cc:2749] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:12.140233  9465 leader_election.cc:343] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.141008  9465 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.142493  9717 raft_consensus.cc:2749] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.142936  9756 consensus_queue.cc:1048] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.143761  9780 consensus_queue.cc:1048] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.147331  9498 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:12.149466  9501 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.156719  9623 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:12.157444  9623 ts_tablet_manager.cc:1403] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.190s	user 0.005s	sys 0.009s
I20260709 13:05:12.157785  9780 consensus_queue.cc:1048] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.160437  9623 raft_consensus.cc:359] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.161223  9623 raft_consensus.cc:385] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.161509  9623 raft_consensus.cc:740] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.162690  9623 consensus_queue.cc:260] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.165223  9317 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:12.166294  9713 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.166939  9713 raft_consensus.cc:697] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:12.168109  9713 consensus_queue.cc:237] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.184211  9623 ts_tablet_manager.cc:1434] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:05:12.152619  9620 tablet_bootstrap.cc:654] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.186442  9623 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:12.199666  9621 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:12.200325  9621 ts_tablet_manager.cc:1403] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.134s	user 0.035s	sys 0.033s
I20260709 13:05:12.207525  9622 raft_consensus.cc:359] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.207306  9246 catalog_manager.cc:5697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.208285  9622 raft_consensus.cc:385] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.208771  9622 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.210404  9246 catalog_manager.cc:5697] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.210356  9622 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.218148  9622 ts_tablet_manager.cc:1434] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.000s
I20260709 13:05:12.219218  9622 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:12.222647  9621 raft_consensus.cc:359] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.223374  9621 raft_consensus.cc:385] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.223649  9621 raft_consensus.cc:740] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.224344  9621 consensus_queue.cc:260] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.226732  9621 ts_tablet_manager.cc:1434] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:05:12.227792  9621 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:12.230749  9674 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.231422  9674 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.233721  9674 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:12.233933  9621 tablet_bootstrap.cc:654] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.236832  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.236828  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:12.242075  9622 tablet_bootstrap.cc:654] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.245056  9623 tablet_bootstrap.cc:654] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.248056  9539 leader_election.cc:343] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.253328  9621 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
W20260709 13:05:12.253567  9539 leader_election.cc:343] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.253904  9621 ts_tablet_manager.cc:1403] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 13:05:12.254456  9539 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.265962  9621 raft_consensus.cc:359] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.266495  9717 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.266808  9621 raft_consensus.cc:385] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.267143  9621 raft_consensus.cc:740] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.267017  9717 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.267845  9621 consensus_queue.cc:260] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.269976  9621 ts_tablet_manager.cc:1434] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:12.270905  9621 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:12.273221  9630 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.275024  9630 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.278290  9621 tablet_bootstrap.cc:654] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.306739  9630 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:12.308568  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.309810  9501 raft_consensus.cc:2393] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 1: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:12.308589  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.314323  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.315922  9799 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.316603  9799 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.321794  9688 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.323325  9717 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:12.325007  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 71496.1us
I20260709 13:05:12.326344  9743 raft_consensus.cc:2749] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.334517  9688 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.346091  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.350562  9246 catalog_manager.cc:5697] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.352707  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.353425  9501 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.353744  9631 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.319659  9799 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:12.354686  9392 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:12.355357  9799 raft_consensus.cc:493] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.356101  9798 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.355862  9799 raft_consensus.cc:515] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.356577  9798 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.356969  9798 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.357898  9713 consensus_queue.cc:1048] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.358421  9799 leader_election.cc:290] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:12.361881  9391 leader_election.cc:343] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.361784  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.362885  9575 raft_consensus.cc:2468] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.364861  9713 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.365198  9390 leader_election.cc:304] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.366724  9630 raft_consensus.cc:2804] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.367095  9630 raft_consensus.cc:493] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.367458  9630 raft_consensus.cc:3060] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.367766  9623 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:12.368314  9623 ts_tablet_manager.cc:1403] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.182s	user 0.051s	sys 0.053s
I20260709 13:05:12.368587  9620 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:12.369082  9620 ts_tablet_manager.cc:1403] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.270s	user 0.010s	sys 0.004s
I20260709 13:05:12.369686  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:12.371307  9623 raft_consensus.cc:359] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.371737  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.372171  9623 raft_consensus.cc:385] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.372613  9623 raft_consensus.cc:740] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.371762  9620 raft_consensus.cc:359] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.377988  9620 raft_consensus.cc:385] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.378296  9620 raft_consensus.cc:740] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.378998  9620 consensus_queue.cc:260] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.382232  9622 tablet_bootstrap.cc:492] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:12.382756  9622 ts_tablet_manager.cc:1403] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.164s	user 0.040s	sys 0.041s
I20260709 13:05:12.383162  9620 ts_tablet_manager.cc:1434] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
W20260709 13:05:12.384603  9465 leader_election.cc:343] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.384836  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.386200  9622 raft_consensus.cc:359] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.384227  9620 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:12.388725  9622 raft_consensus.cc:385] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.389215  9622 raft_consensus.cc:740] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.390025  9622 consensus_queue.cc:260] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.391091  9501 raft_consensus.cc:2468] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.393049  9622 ts_tablet_manager.cc:1434] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:12.394178  9622 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:12.383965  9798 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.396668  9425 raft_consensus.cc:2393] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:12.398952  9465 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.399778  9717 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.404927  9799 consensus_queue.cc:1048] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.408596  9620 tablet_bootstrap.cc:654] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.409037  9798 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:12.410176  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.374794  9623 consensus_queue.cc:260] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.416014  9623 ts_tablet_manager.cc:1434] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:05:12.417049  9623 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:12.418980  9674 raft_consensus.cc:493] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.419557  9674 raft_consensus.cc:515] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.421104  9630 raft_consensus.cc:515] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.422956  9621 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:12.425096  9621 ts_tablet_manager.cc:1403] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.014s
I20260709 13:05:12.425184  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:12.426026  9574 raft_consensus.cc:3060] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.424302  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.428956  9623 tablet_bootstrap.cc:654] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.429067  9499 raft_consensus.cc:3060] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.423836  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.430068  9500 raft_consensus.cc:2468] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:12.431636  9540 leader_election.cc:304] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.432888  9628 raft_consensus.cc:2804] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.433458  9628 raft_consensus.cc:493] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.434000  9628 raft_consensus.cc:3060] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.438653  9499 raft_consensus.cc:2468] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.423550  9630 leader_election.cc:290] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:12.442260  9392 leader_election.cc:304] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:12.444355  9799 raft_consensus.cc:2804] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.450894  9249 catalog_manager.cc:5697] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.452534  9674 leader_election.cc:290] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.429176  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.457162  9352 raft_consensus.cc:2468] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:12.460470  9799 raft_consensus.cc:697] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:12.461573  9799 consensus_queue.cc:237] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.462186  9752 consensus_queue.cc:1048] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.463035  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:12.464376  9391 leader_election.cc:343] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.467620  9717 raft_consensus.cc:2749] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.468546  9621 raft_consensus.cc:359] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.474285  9621 raft_consensus.cc:385] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.474671  9621 raft_consensus.cc:740] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.475510  9621 consensus_queue.cc:260] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.477942  9621 ts_tablet_manager.cc:1434] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:05:12.471815  9620 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:12.478914  9620 ts_tablet_manager.cc:1403] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.000s
I20260709 13:05:12.488288  9688 consensus_queue.cc:1048] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.489792  9620 raft_consensus.cc:359] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.490523  9620 raft_consensus.cc:385] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.490783  9620 raft_consensus.cc:740] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.491078  9688 consensus_queue.cc:1048] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.494076  9621 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:12.501505  9688 raft_consensus.cc:493] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.502519  9688 raft_consensus.cc:515] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.507357  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.508114  9501 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.514683  9392 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.517478  9796 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.518234  9796 raft_consensus.cc:697] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:12.519181  9796 consensus_queue.cc:237] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.491449  9620 consensus_queue.cc:260] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.523392  9570 raft_consensus.cc:2468] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.524715  9620 ts_tablet_manager.cc:1434] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:05:12.525696  9390 leader_election.cc:304] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.525736  9620 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:12.529500  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.531035  9621 tablet_bootstrap.cc:654] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.531399  9391 leader_election.cc:343] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.526064  9622 tablet_bootstrap.cc:654] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.536013  9798 raft_consensus.cc:2804] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.536578  9798 raft_consensus.cc:493] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.536988  9798 raft_consensus.cc:3060] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.515865  9688 leader_election.cc:290] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.546139  9620 tablet_bootstrap.cc:654] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.531438  9574 raft_consensus.cc:2468] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.550307  9630 consensus_queue.cc:1048] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.572707  9622 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:12.573459  9622 ts_tablet_manager.cc:1403] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.004s
I20260709 13:05:12.608213  9630 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.617766  9630 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.606518  9752 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.618886  9752 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.620062  9630 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.617055  9622 raft_consensus.cc:359] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.622521  9622 raft_consensus.cc:385] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.622815  9622 raft_consensus.cc:740] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.636507  9628 raft_consensus.cc:515] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.631129  9798 raft_consensus.cc:515] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.644822  9631 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.645188  9628 leader_election.cc:290] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.645821  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:12.646487  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.646894  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.646998  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:12.647548  9501 raft_consensus.cc:3060] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.647121  9573 raft_consensus.cc:2468] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.642485  9798 leader_election.cc:290] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.647768  9572 raft_consensus.cc:3060] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.648782  9390 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.649641  9798 raft_consensus.cc:2804] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.650012  9798 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.650323  9798 raft_consensus.cc:3060] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.632864  9752 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:12.636507  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.652686  9350 raft_consensus.cc:2468] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:12.654362  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.655081  9571 raft_consensus.cc:2468] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:12.656932  9315 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:12.657712  9798 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.658350  9711 raft_consensus.cc:2804] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.658756  9711 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.659085  9711 raft_consensus.cc:3060] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.659950  9798 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:12.660202  9391 leader_election.cc:343] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.664625  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:12.665342  9574 raft_consensus.cc:3060] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.665050  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:12.676589  9841 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:12.678063  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:12.678730  9350 raft_consensus.cc:3060] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.682956  9623 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:12.664652  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:12.685181  9427 raft_consensus.cc:2393] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:12.672644  9622 consensus_queue.cc:260] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.690730  9711 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.687114  9572 raft_consensus.cc:2468] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.692678  9501 raft_consensus.cc:2468] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:12.691476  9623 ts_tablet_manager.cc:1403] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.275s	user 0.033s	sys 0.028s
I20260709 13:05:12.699386  9621 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:12.699841  9621 ts_tablet_manager.cc:1403] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.037s
I20260709 13:05:12.702281  9349 raft_consensus.cc:2393] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 1: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:12.705789  9713 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.708127  9621 raft_consensus.cc:359] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.708984  9621 raft_consensus.cc:385] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.709312  9621 raft_consensus.cc:740] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.710153  9621 consensus_queue.cc:260] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.711488  9711 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:12.712599  9390 leader_election.cc:304] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.714651  9630 raft_consensus.cc:2804] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.715159  9630 raft_consensus.cc:697] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:12.716007  9630 consensus_queue.cc:237] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.719954  9688 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.720494  9688 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.722597  9688 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:12.722800  9621 ts_tablet_manager.cc:1434] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:05:12.719301  9796 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.726286  9621 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:12.724234  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.724632  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:12.733472  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:12.734514  9427 raft_consensus.cc:2393] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
W20260709 13:05:12.735069  9390 leader_election.cc:343] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:12.740723  9392 leader_election.cc:343] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.741232  9392 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:12.743234  9350 raft_consensus.cc:2468] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:12.746591  9622 ts_tablet_manager.cc:1434] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.000s
I20260709 13:05:12.691308  9574 raft_consensus.cc:2468] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:12.751405  9620 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:12.749732  9622 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:12.752020  9620 ts_tablet_manager.cc:1403] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.226s	user 0.031s	sys 0.030s
I20260709 13:05:12.761731  9540 leader_election.cc:304] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.762049  9622 tablet_bootstrap.cc:654] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.762755  9836 raft_consensus.cc:2804] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.763427  9836 raft_consensus.cc:697] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:12.764593  9836 consensus_queue.cc:237] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.766280  9620 raft_consensus.cc:359] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.767005  9620 raft_consensus.cc:385] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.767277  9620 raft_consensus.cc:740] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.755038  9798 raft_consensus.cc:2749] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.772701  9390 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:12.774190  9796 raft_consensus.cc:2804] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.775094  9620 consensus_queue.cc:260] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.776010  9628 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.776588  9628 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.767292  9623 raft_consensus.cc:359] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.780377  9623 raft_consensus.cc:385] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.786803  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:12.788264  9572 raft_consensus.cc:2393] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:12.784803  9796 raft_consensus.cc:697] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:12.790972  9315 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:12.792423  9711 raft_consensus.cc:2749] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.780745  9623 raft_consensus.cc:740] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.797509  9623 consensus_queue.cc:260] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.791426  9796 consensus_queue.cc:237] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.810058  9623 ts_tablet_manager.cc:1434] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 13:05:12.812090  9623 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:12.823772  9620 ts_tablet_manager.cc:1434] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:05:12.825479  9620 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:12.837968  9628 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.839988  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:12.845755  9623 tablet_bootstrap.cc:654] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.847733  9622 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:12.848434  9622 ts_tablet_manager.cc:1403] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.016s
I20260709 13:05:12.858431  9620 tablet_bootstrap.cc:654] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.858340  9849 log.cc:927] Time spent T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: Append to log took a long time: real 0.127s	user 0.005s	sys 0.000s
I20260709 13:05:12.861658  9621 tablet_bootstrap.cc:654] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.866046  9622 raft_consensus.cc:359] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.867146  9622 raft_consensus.cc:385] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.867569  9622 raft_consensus.cc:740] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.868494  9622 consensus_queue.cc:260] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:12.871455  9622 ts_tablet_manager.cc:1434] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:05:12.872622  9622 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:12.863430  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:12.875281  9501 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:12.879962  9622 tablet_bootstrap.cc:654] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.879804  9540 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.883914  9836 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.884424  9836 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.884774  9836 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:12.889940  9539 leader_election.cc:343] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.893252  9245 catalog_manager.cc:5697] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.895900  9836 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.899632  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:12.900349  9498 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.908365  9498 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:12.909758  9540 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:12.909929  9836 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:12.910692  9836 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.911252  9836 raft_consensus.cc:697] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:12.944653  9836 consensus_queue.cc:237] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:12.949520  9623 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:12.950088  9623 ts_tablet_manager.cc:1403] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.138s	user 0.029s	sys 0.011s
I20260709 13:05:12.952270  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:12.956333  9539 leader_election.cc:343] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.956907  9622 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:12.957413  9622 ts_tablet_manager.cc:1403] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.020s
I20260709 13:05:12.961030  9623 raft_consensus.cc:359] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.962262  9623 raft_consensus.cc:385] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.962587  9623 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.963485  9623 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.965812  9623 ts_tablet_manager.cc:1434] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:12.966821  9623 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:12.967811  9620 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:12.968420  9620 ts_tablet_manager.cc:1403] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.004s
I20260709 13:05:12.971335  9620 raft_consensus.cc:359] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.972712  9620 raft_consensus.cc:385] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.972960  9623 tablet_bootstrap.cc:654] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.973973  9622 raft_consensus.cc:359] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.974749  9622 raft_consensus.cc:385] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.975046  9622 raft_consensus.cc:740] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.976426  9622 consensus_queue.cc:260] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.973026  9620 raft_consensus.cc:740] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.978695  9620 consensus_queue.cc:260] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:12.979489  9622 ts_tablet_manager.cc:1434] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:05:12.979732  9621 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:12.980306  9621 ts_tablet_manager.cc:1403] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.254s	user 0.029s	sys 0.017s
I20260709 13:05:12.983425  9621 raft_consensus.cc:359] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:12.984329  9621 raft_consensus.cc:385] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.984604  9621 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.987550  9622 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:12.990298  9799 consensus_queue.cc:1048] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.999267  9620 ts_tablet_manager.cc:1434] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
W20260709 13:05:13.002231  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:13.004318  9246 catalog_manager.cc:5697] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.009606  9620 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:13.013461  9622 tablet_bootstrap.cc:654] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.018303  9621 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.023315  9621 ts_tablet_manager.cc:1434] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:05:13.024597  9621 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.031853  9621 tablet_bootstrap.cc:654] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.034191  9622 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:13.021034  9620 tablet_bootstrap.cc:654] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.034705  9622 ts_tablet_manager.cc:1403] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.002s
I20260709 13:05:13.038679  9622 raft_consensus.cc:359] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.039428  9622 raft_consensus.cc:385] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.039705  9622 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.040354  9622 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.041510  9623 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:13.042064  9623 ts_tablet_manager.cc:1403] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.037s
I20260709 13:05:13.042922  9622 ts_tablet_manager.cc:1434] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:05:13.043959  9622 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:13.045400  9352 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.048894  9798 consensus_queue.cc:1048] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.050029  9622 tablet_bootstrap.cc:654] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.060329  9841 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.062680  9623 raft_consensus.cc:359] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.063730  9623 raft_consensus.cc:385] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.064143  9623 raft_consensus.cc:740] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.066741  9623 consensus_queue.cc:260] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.067785  9621 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.069600  9621 ts_tablet_manager.cc:1403] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.010s
I20260709 13:05:13.074221  9621 raft_consensus.cc:359] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.075016  9621 raft_consensus.cc:385] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.075290  9621 raft_consensus.cc:740] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.076016  9621 consensus_queue.cc:260] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.076821  9623 ts_tablet_manager.cc:1434] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:05:13.079676  9623 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:13.080525  9756 raft_consensus.cc:493] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.081264  9756 raft_consensus.cc:515] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.085125  9621 ts_tablet_manager.cc:1434] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:13.085371  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.086298  9621 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.086225  9756 leader_election.cc:290] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:13.087013  9465 leader_election.cc:343] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.087949  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.088568  9245 catalog_manager.cc:5697] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.090901  9245 catalog_manager.cc:5697] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:13.101331  9464 leader_election.cc:343] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.101927  9464 leader_election.cc:304] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.106101  9717 raft_consensus.cc:2749] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.108489  9621 tablet_bootstrap.cc:654] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.110301  9622 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:13.110863  9622 ts_tablet_manager.cc:1403] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.019s
I20260709 13:05:13.139592  9623 tablet_bootstrap.cc:654] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.146660  9622 raft_consensus.cc:359] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.147559  9622 raft_consensus.cc:385] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.147826  9622 raft_consensus.cc:740] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.148284  9350 raft_consensus.cc:3060] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.148515  9622 consensus_queue.cc:260] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.150821  9622 ts_tablet_manager.cc:1434] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:05:13.156929  9622 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:13.156262  9245 catalog_manager.cc:5697] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.160614  9717 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.161216  9717 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.163369  9717 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:13.164484  9622 tablet_bootstrap.cc:654] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.166316  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.167078  9425 raft_consensus.cc:2468] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:13.168669  9465 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:13.166617  9620 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:13.173184  9620 ts_tablet_manager.cc:1403] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.164s	user 0.035s	sys 0.029s
I20260709 13:05:13.174995  9621 tablet_bootstrap.cc:492] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.177346  9711 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.177619  9620 raft_consensus.cc:359] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.178164  9711 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.180094  9719 raft_consensus.cc:2804] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.180586  9719 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.180996  9719 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.182286  9621 ts_tablet_manager.cc:1403] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.009s
I20260709 13:05:13.183526  9711 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:13.185539  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.185143  9248 catalog_manager.cc:5697] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.185994  9621 raft_consensus.cc:359] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.186720  9621 raft_consensus.cc:385] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.187037  9621 raft_consensus.cc:740] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
W20260709 13:05:13.187958  9316 leader_election.cc:343] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.189482  9623 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:13.190042  9623 ts_tablet_manager.cc:1403] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.003s
I20260709 13:05:13.187760  9621 consensus_queue.cc:260] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.194195  9621 ts_tablet_manager.cc:1434] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:13.195163  9621 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.178725  9620 raft_consensus.cc:385] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.197100  9620 raft_consensus.cc:740] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.198601  9620 consensus_queue.cc:260] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.203182  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.204305  9620 ts_tablet_manager.cc:1434] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:05:13.205394  9620 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:13.195750  9623 raft_consensus.cc:359] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.207006  9623 raft_consensus.cc:385] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.206881  9841 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.207352  9623 raft_consensus.cc:740] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.201745  9713 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.207929  9713 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.208230  9623 consensus_queue.cc:260] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.211582  9713 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.211727  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.215528  9621 tablet_bootstrap.cc:654] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.223662  9623 ts_tablet_manager.cc:1434] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 13:05:13.224951  9623 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:13.227180  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.229310  9621 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.230396  9836 consensus_queue.cc:1048] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:13.231575  9315 leader_election.cc:343] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.232275  9315 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:13.232707  9621 ts_tablet_manager.cc:1403] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.006s
I20260709 13:05:13.234952  9713 raft_consensus.cc:2749] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.236157  9756 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.236552  9621 raft_consensus.cc:359] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.236712  9756 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.237306  9796 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.237525  9621 raft_consensus.cc:385] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.237924  9796 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.238343  9841 consensus_queue.cc:1048] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.239187  9756 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:13.240116  9796 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.240700  9623 tablet_bootstrap.cc:654] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.241489  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.241828  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.242185  9498 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:13.236214  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.242921  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.243700  9392 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:13.244691  9391 leader_election.cc:343] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.245034  9796 raft_consensus.cc:2804] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.237912  9621 raft_consensus.cc:740] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.245436  9796 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.245945  9796 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.245846  9316 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:13.247037  9621 consensus_queue.cc:260] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.242475  9427 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:13.248687  9465 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:13.249145  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.249758  9756 raft_consensus.cc:2804] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.250228  9756 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.250622  9756 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.237418  9620 tablet_bootstrap.cc:654] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:13.250696  9465 leader_election.cc:343] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.256430  9621 ts_tablet_manager.cc:1434] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:05:13.257658  9621 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.261802  9756 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.265082  9719 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.271438  9688 consensus_queue.cc:1048] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:13.272365  9464 leader_election.cc:343] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.273221  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:13.274051  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
W20260709 13:05:13.274715  9465 leader_election.cc:343] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.275467  9719 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:13.274685  9427 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.285948  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:13.276831  9620 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:13.279336  9621 tablet_bootstrap.cc:654] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.289647  9425 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.289958  9620 ts_tablet_manager.cc:1403] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.005s
I20260709 13:05:13.293107  9620 raft_consensus.cc:359] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.293859  9620 raft_consensus.cc:385] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.294142  9620 raft_consensus.cc:740] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.294842  9620 consensus_queue.cc:260] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.286972  9798 consensus_queue.cc:1048] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:13.304489  9621 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.305068  9621 ts_tablet_manager.cc:1403] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.006s
I20260709 13:05:13.276639  9756 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:13.311067  9621 raft_consensus.cc:359] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.338770  9621 raft_consensus.cc:385] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.339082  9621 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.339811  9621 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.312242  9425 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:13.341634  9465 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.342069  9621 ts_tablet_manager.cc:1434] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:05:13.342811  9756 raft_consensus.cc:2804] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.343042  9621 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.343344  9756 raft_consensus.cc:697] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:13.316697  9798 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.344265  9756 consensus_queue.cc:237] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.344937  9798 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.345484  9623 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:13.346097  9623 ts_tablet_manager.cc:1403] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.008s
I20260709 13:05:13.325254  9622 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:13.347585  9622 ts_tablet_manager.cc:1403] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.191s	user 0.023s	sys 0.055s
I20260709 13:05:13.321405  9620 ts_tablet_manager.cc:1434] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:05:13.316535  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:13.313181  9427 raft_consensus.cc:2468] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:13.350695  9622 raft_consensus.cc:359] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.357391  9841 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.377852  9465 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:13.377821  9841 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.379014  9717 raft_consensus.cc:2804] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.379551  9717 raft_consensus.cc:697] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:13.360839  9798 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.365306  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.367456  9623 raft_consensus.cc:359] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.380537  9623 raft_consensus.cc:385] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.380614  9350 raft_consensus.cc:2468] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:13.380419  9717 consensus_queue.cc:237] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.381011  9623 raft_consensus.cc:740] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.381789  9623 consensus_queue.cc:260] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.383294  9622 raft_consensus.cc:385] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.383742  9622 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.385859  9841 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:13.384783  9622 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.386464  9623 ts_tablet_manager.cc:1434] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:05:13.387199  9620 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:13.387302  9623 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:13.392165  9841 consensus_queue.cc:1048] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:13.401186  9836 consensus_queue.cc:1048] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:13.408601  9743 raft_consensus.cc:493] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.409214  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:13.409739  9464 leader_election.cc:343] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.409314  9743 raft_consensus.cc:515] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.404824  9620 tablet_bootstrap.cc:654] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.308374  9796 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.414740  9621 tablet_bootstrap.cc:654] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.411963  9743 leader_election.cc:290] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:13.416349  9622 ts_tablet_manager.cc:1434] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 13:05:13.417582  9622 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:13.420356  9623 tablet_bootstrap.cc:654] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.424242  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.424990  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.425099  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.414640  9836 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.427696  9539 leader_election.cc:343] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.427568  9836 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:13.428479  9539 leader_election.cc:343] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.428651  9571 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:13.428925  9539 leader_election.cc:304] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.429795  9836 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.429888  9855 raft_consensus.cc:2749] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.432053  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.399910  9391 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:13.432783  9427 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:13.433090  9841 raft_consensus.cc:2804] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.432224  9796 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.433550  9841 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.434037  9841 raft_consensus.cc:3060] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:13.434540  9390 leader_election.cc:343] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.436195  9719 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.435694  9248 catalog_manager.cc:5697] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.436697  9719 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.438970  9719 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.416291  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.439896  9498 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:13.442075  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.442939  9499 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:13.453583  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.443220  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:13.454439  9500 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.451946  9711 raft_consensus.cc:2749] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.457176  9392 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:13.458587  9465 leader_election.cc:343] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.458742  9796 raft_consensus.cc:2804] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.459136  9796 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.459479  9796 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.468914  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:13.472733  9391 leader_election.cc:343] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.460207  9539 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:13.481344  9836 raft_consensus.cc:2804] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.481933  9836 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.482378  9836 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.488607  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.493345  9841 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:13.494737  9464 leader_election.cc:343] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.495489  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.497359  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:13.497670  9719 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.498118  9352 raft_consensus.cc:3060] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.499569  9743 consensus_queue.cc:1048] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.501039  9500 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:13.501932  9622 tablet_bootstrap.cc:654] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.502548  9392 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.503804  9798 raft_consensus.cc:2804] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.504371  9798 raft_consensus.cc:697] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:13.505245  9798 consensus_queue.cc:237] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.508872  9349 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.479748  9796 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.520962  9836 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.523039  9836 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.523794  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:13.495734  9841 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.524703  9248 catalog_manager.cc:5697] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.536579  9621 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.537204  9621 ts_tablet_manager.cc:1403] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.194s	user 0.011s	sys 0.006s
I20260709 13:05:13.523836  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:13.545804  9427 raft_consensus.cc:2393] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:13.549386  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:13.572669  9623 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
W20260709 13:05:13.565310  9390 leader_election.cc:343] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.568408  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:13.618352  9836 consensus_queue.cc:1048] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.591953  9621 raft_consensus.cc:359] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.619783  9621 raft_consensus.cc:385] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.620132  9621 raft_consensus.cc:740] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.567509  9796 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:13.620581  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 55736.9us
I20260709 13:05:13.621338  9621 consensus_queue.cc:260] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.622259  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:13.623081  9571 raft_consensus.cc:2393] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 1: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:13.623585  9621 ts_tablet_manager.cc:1434] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:05:13.581609  9620 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:13.624393  9620 ts_tablet_manager.cc:1403] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.016s
I20260709 13:05:13.566642  9501 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.578003  9352 raft_consensus.cc:2468] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:13.616575  9623 ts_tablet_manager.cc:1403] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.229s	user 0.024s	sys 0.008s
I20260709 13:05:13.611824  9711 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.633001  9711 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.624644  9621 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:13.630909  9620 raft_consensus.cc:359] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.635560  9620 raft_consensus.cc:385] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.635896  9620 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.637566  9623 raft_consensus.cc:359] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.636639  9620 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.640172  9623 raft_consensus.cc:385] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.641860  9711 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:13.626493  9390 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:13.641558  9623 raft_consensus.cc:740] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.643729  9796 raft_consensus.cc:2749] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.643034  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:13.645977  9623 consensus_queue.cc:260] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.631711  9248 catalog_manager.cc:5697] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.651676  9391 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:13.652999  9796 raft_consensus.cc:2804] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.653497  9796 raft_consensus.cc:697] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:13.654268  9796 consensus_queue.cc:237] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.657137  9501 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:13.658768  9620 ts_tablet_manager.cc:1434] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:05:13.660008  9620 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:13.660631  9540 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:13.662909  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.663971  9836 raft_consensus.cc:2804] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.664791  9836 raft_consensus.cc:697] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:13.665963  9836 consensus_queue.cc:237] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.683077  9620 tablet_bootstrap.cc:654] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.685901  9623 ts_tablet_manager.cc:1434] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:05:13.686780  9623 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:13.665984  9317 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:13.699050  9711 raft_consensus.cc:2749] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.703081  9622 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:13.703727  9622 ts_tablet_manager.cc:1403] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.286s	user 0.012s	sys 0.006s
I20260709 13:05:13.706727  9884 raft_consensus.cc:493] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.707295  9884 raft_consensus.cc:515] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:13.710445  9317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 44563.1us
I20260709 13:05:13.710852  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.711544  9501 raft_consensus.cc:2468] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:13.715818  9540 leader_election.cc:304] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:13.716779  9855 raft_consensus.cc:2804] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.717191  9855 raft_consensus.cc:493] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.717523  9855 raft_consensus.cc:3060] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.725247  9621 tablet_bootstrap.cc:654] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.746063  9799 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.754912  9623 tablet_bootstrap.cc:654] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.755242  9799 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.728613  9622 raft_consensus.cc:359] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.757071  9622 raft_consensus.cc:385] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.757426  9622 raft_consensus.cc:740] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.737241  9248 catalog_manager.cc:5697] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.758339  9622 consensus_queue.cc:260] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.731673  9884 leader_election.cc:290] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.766278  9620 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:13.767037  9620 ts_tablet_manager.cc:1403] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.009s
I20260709 13:05:13.769793  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.771806  9622 ts_tablet_manager.cc:1434] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.068s	user 0.013s	sys 0.000s
W20260709 13:05:13.773721  9392 leader_election.cc:343] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.773797  9713 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.774582  9622 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:13.761195  9799 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.779968  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.776142  9713 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:13.782660  9391 leader_election.cc:343] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.783150  9391 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:13.784785  9756 consensus_queue.cc:1048] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.785200  9713 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.788776  9798 raft_consensus.cc:2749] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.788797  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.741108  9855 raft_consensus.cc:515] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.789994  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.790658  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:13.795996  9317 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:13.796355  9349 raft_consensus.cc:2468] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:13.791955  9855 leader_election.cc:290] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.797761  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:13.798621  9501 raft_consensus.cc:3060] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.799768  9620 raft_consensus.cc:359] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.800717  9620 raft_consensus.cc:385] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.801255  9620 raft_consensus.cc:740] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.802098  9620 consensus_queue.cc:260] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:13.803119  9713 raft_consensus.cc:2749] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.811055  9620 ts_tablet_manager.cc:1434] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:05:13.812384  9620 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:13.812965  9621 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:13.813488  9621 ts_tablet_manager.cc:1403] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.005s
I20260709 13:05:13.818660  9501 raft_consensus.cc:2468] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:13.820508  9540 leader_election.cc:304] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:13.821887  9896 raft_consensus.cc:2804] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.821894  9620 tablet_bootstrap.cc:654] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.822435  9896 raft_consensus.cc:697] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:13.823974  9896 consensus_queue.cc:237] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.817051  9622 tablet_bootstrap.cc:654] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.833086  9621 raft_consensus.cc:359] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.833900  9621 raft_consensus.cc:385] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.834173  9621 raft_consensus.cc:740] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.834867  9621 consensus_queue.cc:260] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:13.837386  9621 ts_tablet_manager.cc:1434] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:13.838881  9621 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
W20260709 13:05:13.842481  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 68512.5us
I20260709 13:05:13.845149  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:13.846341  9349 raft_consensus.cc:3060] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.859609  9621 tablet_bootstrap.cc:654] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.861128  9623 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:13.865474  9623 ts_tablet_manager.cc:1403] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.022s
I20260709 13:05:13.882401  9623 raft_consensus.cc:359] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.883392  9623 raft_consensus.cc:385] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.883733  9623 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.884970  9623 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.891921  9248 catalog_manager.cc:5697] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.897818  9620 tablet_bootstrap.cc:492] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:13.898993  9620 ts_tablet_manager.cc:1403] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.008s
I20260709 13:05:13.908540  9623 ts_tablet_manager.cc:1434] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:05:13.910094  9623 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:13.918550  9900 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.918841  9623 tablet_bootstrap.cc:654] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.919217  9900 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:13.928359  9711 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.928968  9711 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:13.931182  9711 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:13.934391  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.935212  9501 raft_consensus.cc:2393] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:13.936755  9900 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:13.939689  9352 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.940469  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:13.953869  9316 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:13.955616  9711 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.958071  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:13.959046  9498 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:13.960825  9540 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:13.963326  9836 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.963930  9836 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.964452  9836 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.966509  9711 raft_consensus.cc:2749] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.970175  9717 consensus_queue.cc:1048] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.980969  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:14.008277  9464 consensus_peers.cc:597] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 -> Peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Couldn't send request to peer e3b7aa42b8924e21bbeb620671e29bd0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.018142  9897 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.019079  9897 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.022011  9897 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:14.023247  9841 raft_consensus.cc:493] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.024044  9841 raft_consensus.cc:515] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.030028  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:14.031353  9350 raft_consensus.cc:2393] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 1: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
W20260709 13:05:14.033946  9539 leader_election.cc:343] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.038090  9688 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.070022  9572 raft_consensus.cc:3060] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.070128  9688 consensus_queue.cc:1048] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.078454  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:14.086702  9620 raft_consensus.cc:359] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.087430  9841 leader_election.cc:290] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.089062  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.091388  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.092022  9501 raft_consensus.cc:2468] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:14.095865  9622 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.096751  9623 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:14.097002  9622 ts_tablet_manager.cc:1403] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.324s	user 0.010s	sys 0.008s
I20260709 13:05:14.097254  9623 ts_tablet_manager.cc:1403] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.000s
I20260709 13:05:14.099614  9349 raft_consensus.cc:2468] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:14.099814  9622 raft_consensus.cc:359] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.102380  9623 raft_consensus.cc:359] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.104688  9392 leader_election.cc:304] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:14.105367  9622 raft_consensus.cc:385] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.105722  9622 raft_consensus.cc:740] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.106336  9841 raft_consensus.cc:2804] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.106647  9623 raft_consensus.cc:385] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.106931  9841 raft_consensus.cc:493] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.107492  9841 raft_consensus.cc:3060] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.106976  9623 raft_consensus.cc:740] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.108747  9623 consensus_queue.cc:260] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.107802  9622 consensus_queue.cc:260] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.112000  9622 ts_tablet_manager.cc:1434] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:14.117151  9622 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
W20260709 13:05:14.112489  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 78624.1us
I20260709 13:05:14.087440  9620 raft_consensus.cc:385] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.120568  9620 raft_consensus.cc:740] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.121037  9798 raft_consensus.cc:493] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.121201  9620 consensus_queue.cc:260] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.114342  9623 ts_tablet_manager.cc:1434] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:14.142604  9575 raft_consensus.cc:2468] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:14.143604  9623 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:14.146327  9796 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:14.142555  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 172936us
I20260709 13:05:14.149318  9620 ts_tablet_manager.cc:1434] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.250s	user 0.005s	sys 0.001s
I20260709 13:05:14.126313  9836 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.156488  9836 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.157131  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:14.157907  9501 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.164811  9501 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:14.133424  9798 raft_consensus.cc:515] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.137809  9621 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:14.178315  9621 ts_tablet_manager.cc:1403] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.340s	user 0.101s	sys 0.096s
I20260709 13:05:14.181165  9621 raft_consensus.cc:359] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.181872  9621 raft_consensus.cc:385] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.182142  9621 raft_consensus.cc:740] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.182930  9621 consensus_queue.cc:260] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.140491  9539 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.162022  9841 raft_consensus.cc:515] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.166981  9630 consensus_queue.cc:1048] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.150414  9620 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
W20260709 13:05:14.184863  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 54186.3us
I20260709 13:05:14.131976  9622 tablet_bootstrap.cc:654] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.188442  9245 catalog_manager.cc:5697] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.189466  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:14.190780  9896 raft_consensus.cc:2749] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.192481  9841 leader_election.cc:290] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.195781  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:14.196712  9500 raft_consensus.cc:3060] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.171435  9623 tablet_bootstrap.cc:654] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:14.201120  9539 leader_election.cc:343] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.204514  9798 leader_election.cc:290] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.206652  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:14.217015  9349 raft_consensus.cc:2468] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:14.208817  9620 tablet_bootstrap.cc:654] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.220479  9391 leader_election.cc:304] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:14.221923  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.222674  9571 raft_consensus.cc:2468] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:14.212301  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:14.225484  9575 raft_consensus.cc:3060] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.171149  9717 consensus_queue.cc:1048] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.248219  9630 raft_consensus.cc:2804] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.248823  9630 raft_consensus.cc:493] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.249198  9630 raft_consensus.cc:3060] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.250180  9500 raft_consensus.cc:2468] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:14.252590  9392 leader_election.cc:304] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:14.253492  9796 raft_consensus.cc:2804] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.254050  9796 raft_consensus.cc:697] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:14.255173  9796 consensus_queue.cc:237] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.256142  9621 ts_tablet_manager.cc:1434] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:05:14.260957  9621 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:14.272951  9575 raft_consensus.cc:2468] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
W20260709 13:05:14.273283  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:14.286612  9623 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:14.287428  9623 ts_tablet_manager.cc:1403] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.000s
I20260709 13:05:14.299321  9540 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.299754  9630 raft_consensus.cc:515] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.307436  9900 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.330941  9630 leader_election.cc:290] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.335971  9622 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.336583  9622 ts_tablet_manager.cc:1403] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.220s	user 0.015s	sys 0.006s
I20260709 13:05:14.338263  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:14.339115  9349 raft_consensus.cc:3060] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.331483  9900 raft_consensus.cc:697] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:14.346896  9900 consensus_queue.cc:237] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.339437  9622 raft_consensus.cc:359] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.358503  9622 raft_consensus.cc:385] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.358807  9622 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.361141  9622 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.362990  9620 tablet_bootstrap.cc:492] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:14.363695  9620 ts_tablet_manager.cc:1403] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.016s
I20260709 13:05:14.364054  9622 ts_tablet_manager.cc:1434] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:05:14.365057  9622 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:14.376116  9623 raft_consensus.cc:359] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.382081  9623 raft_consensus.cc:385] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.382472  9623 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.387486  9245 catalog_manager.cc:5697] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.390399  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:14.391120  9575 raft_consensus.cc:3060] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.394672  9799 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.404943  9756 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.410220  9756 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.410785  9622 tablet_bootstrap.cc:654] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.412350  9756 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.414095  9900 consensus_queue.cc:1048] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:14.426004  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:14.404832  9799 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.437477  9427 raft_consensus.cc:2468] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:14.429328  9349 raft_consensus.cc:2468] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:14.439978  9465 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:14.440317  9391 leader_election.cc:304] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:14.442344  9756 raft_consensus.cc:2804] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.444157  9756 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.445595  9756 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.445691  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.446182  9799 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.450117  9836 consensus_queue.cc:1048] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.451763  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.452527  9575 raft_consensus.cc:2468] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:14.444062  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.443336  9798 raft_consensus.cc:2804] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.461243  9798 raft_consensus.cc:697] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:14.462281  9798 consensus_queue.cc:237] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.466336  9836 consensus_queue.cc:1048] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.468504  9719 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.469205  9719 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.469401  9623 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.471431  9719 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:14.475906  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:14.477603  9465 leader_election.cc:343] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.478704  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:14.479404  9425 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:14.434619  9620 raft_consensus.cc:359] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:14.456946  9390 leader_election.cc:343] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.481642  9620 raft_consensus.cc:385] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.481966  9620 raft_consensus.cc:740] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.482829  9623 ts_tablet_manager.cc:1434] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.194s	user 0.005s	sys 0.005s
I20260709 13:05:14.482650  9620 consensus_queue.cc:260] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.483433  9465 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.438930  9621 tablet_bootstrap.cc:654] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.491389  9719 raft_consensus.cc:2804] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.491886  9719 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.492488  9719 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.491907  9248 catalog_manager.cc:5697] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.485329  9620 ts_tablet_manager.cc:1434] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.000s
I20260709 13:05:14.496774  9620 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
W20260709 13:05:14.458999  9464 leader_election.cc:343] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.485500  9623 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:14.505791  9572 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.508960  9719 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.510407  9621 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:14.511003  9621 ts_tablet_manager.cc:1403] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.250s	user 0.006s	sys 0.009s
I20260709 13:05:14.511818  9719 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:14.514705  9623 tablet_bootstrap.cc:654] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.515216  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:14.515868  9427 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.487321  9622 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.513425  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:14.513877  9836 consensus_queue.cc:1048] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:14.519501  9465 leader_election.cc:343] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.520675  9622 ts_tablet_manager.cc:1403] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.004s
I20260709 13:05:14.523480  9622 raft_consensus.cc:359] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.524226  9622 raft_consensus.cc:385] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.524509  9622 raft_consensus.cc:740] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.525128  9622 consensus_queue.cc:260] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.527123  9622 ts_tablet_manager.cc:1434] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:14.475154  9756 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.536499  9500 raft_consensus.cc:2393] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:14.536617  9622 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:14.539525  9392 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:14.542562  9799 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.545073  9855 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:14.545264  9620 tablet_bootstrap.cc:654] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.545687  9855 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.548357  9621 raft_consensus.cc:359] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.549397  9621 raft_consensus.cc:385] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.549824  9621 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.550814  9621 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.552680  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:14.553694  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.553870  9621 ts_tablet_manager.cc:1434] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.004s
I20260709 13:05:14.558252  9621 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:14.559585  9855 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:14.574260  9756 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.579874  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:14.585493  9796 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.591037  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:14.590678  9713 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.592341  9713 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.595445  9713 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:14.594719  9464 leader_election.cc:343] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.598371  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.602214  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.603277  9500 raft_consensus.cc:2393] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:14.604785  9317 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:14.591626  9796 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.609787  9713 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.612963  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:14.614313  9390 leader_election.cc:343] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.613693  9248 catalog_manager.cc:5697] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.616312  9623 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:14.616914  9623 ts_tablet_manager.cc:1403] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.003s
I20260709 13:05:14.619556  9622 tablet_bootstrap.cc:654] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.621831  9623 raft_consensus.cc:359] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.622705  9623 raft_consensus.cc:385] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.622997  9623 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.610100  9539 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:14.625348  9621 tablet_bootstrap.cc:654] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.623936  9623 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.628106  9623 ts_tablet_manager.cc:1434] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:14.631089  9623 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:14.633538  9427 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:14.634963  9465 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.634955  9855 raft_consensus.cc:2749] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.636247  9756 raft_consensus.cc:2804] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.636879  9756 raft_consensus.cc:697] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:14.637909  9756 consensus_queue.cc:237] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.638713  9799 raft_consensus.cc:2749] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.636858  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:14.646353  9391 leader_election.cc:343] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.646903  9391 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.649344  9796 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.650229  9796 raft_consensus.cc:2749] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.659614  9425 raft_consensus.cc:2468] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:14.662815  9623 tablet_bootstrap.cc:654] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.666616  9465 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:14.667927  9908 raft_consensus.cc:2804] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.668567  9908 raft_consensus.cc:697] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:14.669631  9908 consensus_queue.cc:237] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.706833  9713 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.711161  9621 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:14.711778  9621 ts_tablet_manager.cc:1403] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.001s
I20260709 13:05:14.713732  9623 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:14.714267  9623 ts_tablet_manager.cc:1403] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.003s
I20260709 13:05:14.714591  9621 raft_consensus.cc:359] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.715339  9621 raft_consensus.cc:385] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.715593  9621 raft_consensus.cc:740] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.715969  9620 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:14.716531  9620 ts_tablet_manager.cc:1403] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.220s	user 0.025s	sys 0.024s
I20260709 13:05:14.716295  9621 consensus_queue.cc:260] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.718427  9621 ts_tablet_manager.cc:1434] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:14.717089  9623 raft_consensus.cc:359] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.719338  9620 raft_consensus.cc:359] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.720069  9620 raft_consensus.cc:385] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.720131  9621 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:14.720395  9620 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.721132  9620 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.724107  9622 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.724687  9622 ts_tablet_manager.cc:1403] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.197s	user 0.030s	sys 0.015s
I20260709 13:05:14.725436  9245 catalog_manager.cc:5697] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.719390  9623 raft_consensus.cc:385] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.727223  9623 raft_consensus.cc:740] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.727746  9245 catalog_manager.cc:5697] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.728157  9623 consensus_queue.cc:260] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.731873  9623 ts_tablet_manager.cc:1434] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:05:14.732914  9623 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:14.737414  9622 raft_consensus.cc:359] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.738142  9622 raft_consensus.cc:385] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.738425  9622 raft_consensus.cc:740] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.739045  9622 consensus_queue.cc:260] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.740931  9621 tablet_bootstrap.cc:654] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.740352  9623 tablet_bootstrap.cc:654] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.748562  9620 ts_tablet_manager.cc:1434] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260709 13:05:14.750139  9622 ts_tablet_manager.cc:1434] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:14.751150  9622 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:14.761132  9620 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:14.761516  9900 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.767797  9620 tablet_bootstrap.cc:654] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.772007  9622 tablet_bootstrap.cc:654] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.779385  9688 consensus_queue.cc:1048] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.781342  9621 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:14.781570  9622 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.781916  9621 ts_tablet_manager.cc:1403] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.012s
I20260709 13:05:14.781916  9620 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:14.782506  9622 ts_tablet_manager.cc:1403] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.001s
I20260709 13:05:14.782593  9620 ts_tablet_manager.cc:1403] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.009s
I20260709 13:05:14.785007  9621 raft_consensus.cc:359] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.785722  9621 raft_consensus.cc:385] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.785976  9621 raft_consensus.cc:740] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.786705  9621 consensus_queue.cc:260] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.788249  9620 raft_consensus.cc:359] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.791872  9622 raft_consensus.cc:359] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.796829  9622 raft_consensus.cc:385] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.797221  9622 raft_consensus.cc:740] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.805050  9620 raft_consensus.cc:385] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.805651  9620 raft_consensus.cc:740] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.807246  9620 consensus_queue.cc:260] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.804123  9622 consensus_queue.cc:260] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.814767  9620 ts_tablet_manager.cc:1434] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:05:14.789064  9621 ts_tablet_manager.cc:1434] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:14.807765  9916 consensus_queue.cc:1048] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.821834  9621 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:14.826947  9855 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.834041  9621 tablet_bootstrap.cc:654] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.819412  9713 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.836834  9713 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.838948  9713 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:14.836261  9620 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:14.820206  9622 ts_tablet_manager.cc:1434] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:05:14.843920  9622 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:14.847834  9908 raft_consensus.cc:493] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.848505  9908 raft_consensus.cc:515] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.852542  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:14.853318  9352 raft_consensus.cc:2468] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:14.854591  9719 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.855271  9719 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.857810  9465 leader_election.cc:304] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:14.859246  9622 tablet_bootstrap.cc:654] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.861722  9756 raft_consensus.cc:2804] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.862278  9756 raft_consensus.cc:493] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.862596  9756 raft_consensus.cc:3060] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.863642  9620 tablet_bootstrap.cc:654] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.865576  9719 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.868539  9951 raft_consensus.cc:493] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.869223  9951 raft_consensus.cc:515] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.870303  9719 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.870869  9719 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.871423  9951 leader_election.cc:290] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:14.874130  9623 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:14.874651  9623 ts_tablet_manager.cc:1403] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.142s	user 0.040s	sys 0.055s
I20260709 13:05:14.877329  9621 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:14.877915  9621 ts_tablet_manager.cc:1403] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.008s
I20260709 13:05:14.878165  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:14.879990  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:14.880813  9427 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:14.880875  9621 raft_consensus.cc:359] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.891602  9621 raft_consensus.cc:385] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.892052  9621 raft_consensus.cc:740] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.893177  9620 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:14.893031  9621 consensus_queue.cc:260] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.894454  9799 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.895272  9621 ts_tablet_manager.cc:1434] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:14.895452  9799 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:14.897710  9621 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:14.899636  9756 raft_consensus.cc:515] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.900225  9799 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:14.901203  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.902431  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.904567  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.904991  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:14.906399  9392 leader_election.cc:343] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.907049  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.886372  9622 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:14.908217  9622 ts_tablet_manager.cc:1403] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.001s
I20260709 13:05:14.909674  9916 consensus_queue.cc:1048] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.911175  9622 raft_consensus.cc:359] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:14.912920  9315 leader_election.cc:343] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.889521  9465 leader_election.cc:343] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.914157  9465 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:14.915158  9717 raft_consensus.cc:2804] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.873085  9719 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:14.890327  9317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 64204.3us
I20260709 13:05:14.915601  9717 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.893874  9620 ts_tablet_manager.cc:1403] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.000s
I20260709 13:05:14.881482  9623 raft_consensus.cc:359] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:14.916085  9464 leader_election.cc:343] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.916532  9717 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:14.917428  9464 leader_election.cc:343] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.918385  9464 leader_election.cc:343] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.918810  9464 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.916687  9623 raft_consensus.cc:385] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.920187  9623 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.920897  9623 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.923372  9623 ts_tablet_manager.cc:1434] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 13:05:14.924467  9623 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:14.925000  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.928151  9908 leader_election.cc:290] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.919905  9620 raft_consensus.cc:359] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.928803  9620 raft_consensus.cc:385] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.929107  9620 raft_consensus.cc:740] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.929169  9908 raft_consensus.cc:2749] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.929251  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:14.930255  9499 raft_consensus.cc:2393] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:14.931739  9620 consensus_queue.cc:260] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:14.935642  9621 tablet_bootstrap.cc:654] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.936657  9317 leader_election.cc:304] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:14.937597  9711 raft_consensus.cc:3060] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.940436  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:14.943341  9391 leader_election.cc:343] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.943997  9391 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:14.945554  9630 raft_consensus.cc:2749] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.949728  9717 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:14.951643  9952 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.952245  9952 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:14.954373  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:14.954460  9952 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:14.954975  9623 tablet_bootstrap.cc:654] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.955101  9427 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.955498  9711 raft_consensus.cc:2749] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.958032  9916 consensus_queue.cc:1048] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:14.965157  9316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 138547us
I20260709 13:05:14.934770  9620 ts_tablet_manager.cc:1434] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:05:14.966427  9756 leader_election.cc:290] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:14.969350  9620 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:14.971405  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:14.972164  9574 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:14.911916  9622 raft_consensus.cc:385] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.975399  9622 raft_consensus.cc:740] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.986457  9622 consensus_queue.cc:260] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.001710  9622 ts_tablet_manager.cc:1434] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:05:15.017793  9315 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:15.018844  9950 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.019333  9950 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.019717  9950 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.019141  9348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:15.024905  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:15.026000  9423 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 0.
I20260709 13:05:15.027582  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:15.029436  9425 raft_consensus.cc:2393] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:15.003822  9717 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:15.040342  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:15.047281  9348 raft_consensus.cc:2468] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:15.048527  9427 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:15.054940  9316 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:15.068526  9621 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
W20260709 13:05:15.070361  9464 leader_election.cc:343] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.073025  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:15.100675  9711 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.092087  9623 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:15.101465  9623 ts_tablet_manager.cc:1403] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.000s
I20260709 13:05:15.109614  9897 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.110206  9897 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.113073  9897 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:15.114135  9348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:15.095093  9950 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:15.100090  9316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 45301us
I20260709 13:05:15.100244  9621 ts_tablet_manager.cc:1403] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.203s	user 0.058s	sys 0.061s
I20260709 13:05:15.115581  9711 raft_consensus.cc:2749] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.094602  9620 tablet_bootstrap.cc:654] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.103706  9465 leader_election.cc:304] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:15.117794  9717 raft_consensus.cc:2804] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.118256  9717 raft_consensus.cc:697] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:15.118376  9621 raft_consensus.cc:359] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.119102  9621 raft_consensus.cc:385] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.119426  9621 raft_consensus.cc:740] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.119905  9465 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:15.120262  9621 consensus_queue.cc:260] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.119143  9717 consensus_queue.cc:237] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.122520  9621 ts_tablet_manager.cc:1434] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:15.123459  9621 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:15.124166  9719 raft_consensus.cc:2804] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.124738  9719 raft_consensus.cc:697] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:15.125552  9719 consensus_queue.cc:237] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.103049  9622 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
W20260709 13:05:15.133978  9464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 63671.1us
I20260709 13:05:15.135159  9622 tablet_bootstrap.cc:654] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:15.135160  9464 leader_election.cc:343] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.109691  9623 raft_consensus.cc:359] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.156996  9623 raft_consensus.cc:385] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.157323  9623 raft_consensus.cc:740] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.158458  9623 consensus_queue.cc:260] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.160334  9621 tablet_bootstrap.cc:654] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.160933  9623 ts_tablet_manager.cc:1434] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:05:15.161991  9623 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:15.206032  9717 consensus_queue.cc:1048] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.197948  9622 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:15.207590  9621 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:15.208101  9621 ts_tablet_manager.cc:1403] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.009s
I20260709 13:05:15.209802  9622 ts_tablet_manager.cc:1403] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.012s
I20260709 13:05:15.170064  9348 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:15.171352  9756 consensus_queue.cc:1048] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.172837  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:15.197934  9248 catalog_manager.cc:5697] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.215737  9248 catalog_manager.cc:5697] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.218652  9621 raft_consensus.cc:359] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.218601  9500 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:15.220006  9621 raft_consensus.cc:385] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.211325  9836 raft_consensus.cc:493] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.226560  9621 raft_consensus.cc:740] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.228772  9621 consensus_queue.cc:260] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.237495  9621 ts_tablet_manager.cc:1434] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.007s
I20260709 13:05:15.238749  9621 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:15.237879  9836 raft_consensus.cc:515] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.251770  9630 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.252344  9630 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.257454  9836 leader_election.cc:290] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:15.258886  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:15.259253  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:15.259603  9425 raft_consensus.cc:2468] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:15.259845  9571 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.260407  9630 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:15.260869  9539 leader_election.cc:304] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:15.262426  9897 raft_consensus.cc:2804] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.262303  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:15.262844  9897 raft_consensus.cc:493] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.263196  9897 raft_consensus.cc:3060] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:15.263943  9391 leader_election.cc:343] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.271224  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:15.278828  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:15.279587  9501 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:15.285121  9621 tablet_bootstrap.cc:654] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.286006  9539 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
W20260709 13:05:15.286957  9539 leader_election.cc:343] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.287866  9900 raft_consensus.cc:2804] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.288339  9900 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.288712  9900 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.290045  9622 raft_consensus.cc:359] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.290481  9620 tablet_bootstrap.cc:492] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:15.290830  9622 raft_consensus.cc:385] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.291160  9622 raft_consensus.cc:740] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.291800  9620 ts_tablet_manager.cc:1403] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.324s	user 0.039s	sys 0.043s
I20260709 13:05:15.291884  9622 consensus_queue.cc:260] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.300453  9392 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:15.301978  9950 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:15.303619  9799 raft_consensus.cc:2804] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.311058  9622 ts_tablet_manager.cc:1434] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.004s
I20260709 13:05:15.312654  9622 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:15.314389  9620 raft_consensus.cc:359] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.317231  9620 raft_consensus.cc:385] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.317564  9620 raft_consensus.cc:740] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.308660  9799 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.326139  9799 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.327044  9897 raft_consensus.cc:515] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.333112  9620 consensus_queue.cc:260] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.335901  9620 ts_tablet_manager.cc:1434] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:05:15.320873  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:15.341670  9620 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:15.346199  9423 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:15.354470  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:15.360563  9623 tablet_bootstrap.cc:654] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.366564  9574 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.370114  9571 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:15.383845  9622 tablet_bootstrap.cc:654] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.383845  9620 tablet_bootstrap.cc:654] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.430123  9315 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:15.431900  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:15.438148  9897 leader_election.cc:290] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:15.440824  9539 leader_election.cc:343] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.445919  9621 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:15.446465  9621 ts_tablet_manager.cc:1403] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.208s	user 0.040s	sys 0.015s
I20260709 13:05:15.444927  9950 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.491894  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:15.492872  9427 raft_consensus.cc:3060] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.502290  9621 raft_consensus.cc:359] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.503032  9621 raft_consensus.cc:385] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.503309  9621 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.509012  9621 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.486454  9950 raft_consensus.cc:697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
W20260709 13:05:15.528338  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 75881.3us
I20260709 13:05:15.538504  9621 ts_tablet_manager.cc:1434] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 13:05:15.539991  9621 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:15.547966  9623 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:15.549364  9623 ts_tablet_manager.cc:1403] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.388s	user 0.026s	sys 0.019s
I20260709 13:05:15.557852  9427 raft_consensus.cc:2468] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:15.524838  9717 consensus_queue.cc:1048] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:05:15.548604  9799 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.564782  9620 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:15.565610  9620 ts_tablet_manager.cc:1403] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.228s	user 0.010s	sys 0.013s
I20260709 13:05:15.536271  9900 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.575333  9620 raft_consensus.cc:359] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.581833  9620 raft_consensus.cc:385] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.582363  9620 raft_consensus.cc:740] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.583300  9620 consensus_queue.cc:260] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.593317  9620 ts_tablet_manager.cc:1434] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 13:05:15.585820  9756 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.601707  9623 raft_consensus.cc:359] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.602754  9623 raft_consensus.cc:385] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.603154  9623 raft_consensus.cc:740] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.607272  9623 consensus_queue.cc:260] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.608269  9973 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.616580  9623 ts_tablet_manager.cc:1434] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:05:15.590929  9950 consensus_queue.cc:237] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.620023  9622 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:15.620553  9622 ts_tablet_manager.cc:1403] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.308s	user 0.025s	sys 0.006s
I20260709 13:05:15.605831  9756 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.618091  9623 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:15.619907  9973 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.625157  9973 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:15.621279  9575 raft_consensus.cc:3060] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.627905  9717 consensus_queue.cc:1048] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.630956  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:15.633150  9348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:15.633500  9900 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:15.633778  9348 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.635900  9621 tablet_bootstrap.cc:654] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.637140  9799 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:15.638437  9756 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:15.621287  9423 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:15.650344  9630 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.650854  9630 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.652752  9630 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:15.662736  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:15.663612  9352 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.665509  9622 raft_consensus.cc:359] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.666299  9622 raft_consensus.cc:385] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.666567  9622 raft_consensus.cc:740] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.667212  9622 consensus_queue.cc:260] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.671198  9756 consensus_queue.cc:1048] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.671490  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:15.672200  9500 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:15.674093  9622 ts_tablet_manager.cc:1434] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:05:15.673959  9348 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:15.675671  9622 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:15.677238  9688 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.677845  9688 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.678136  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:15.681102  9391 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:15.682686  9688 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:15.683295  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:15.684402  9799 raft_consensus.cc:2804] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.683946  9427 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:15.685285  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:15.691298  9391 leader_election.cc:343] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.692018  9621 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:15.692152  9799 raft_consensus.cc:697] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:15.692922  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:15.693552  9501 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.693734  9621 ts_tablet_manager.cc:1403] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.005s
I20260709 13:05:15.686658  9539 leader_election.cc:304] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:15.696846  9539 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:15.699371  9501 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:15.715476  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:15.706073  9855 raft_consensus.cc:2804] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.719259  9855 raft_consensus.cc:697] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:15.693315  9799 consensus_queue.cc:237] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.720346  9855 consensus_queue.cc:237] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:15.726086  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:15.727532  9392 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:15.729135  9630 raft_consensus.cc:2804] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.729509  9630 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.729818  9630 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.738169  9620 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:15.741066  9346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:15.719705  9621 raft_consensus.cc:359] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.742512  9621 raft_consensus.cc:385] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.742818  9621 raft_consensus.cc:740] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.743474  9621 consensus_queue.cc:260] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.745904  9621 ts_tablet_manager.cc:1434] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:05:15.746184  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:15.746825  9498 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.749207  9621 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
W20260709 13:05:15.753567  9465 leader_election.cc:343] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:15.755585  9390 leader_election.cc:343] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:15.756718  9390 leader_election.cc:343] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.757159  9390 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:15.757993  9688 raft_consensus.cc:2749] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.770954  9246 catalog_manager.cc:5697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.775118  9465 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:15.778288  9630 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.791252  9623 tablet_bootstrap.cc:654] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.778856  9756 raft_consensus.cc:2804] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.797415  9756 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.807548  9630 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:15.827345  9620 tablet_bootstrap.cc:654] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.827960  9498 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:15.813194  9756 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.834720  9621 tablet_bootstrap.cc:654] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.834939  9719 consensus_queue.cc:1048] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.814742  9979 consensus_queue.cc:1048] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:05:15.835805  9622 tablet_bootstrap.cc:654] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.836598  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:15.837282  9500 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.813541  9352 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:15.846643  9974 raft_consensus.cc:2749] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.850406  9539 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:15.839396  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:15.855804  9500 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
W20260709 13:05:15.843379  9464 consensus_peers.cc:597] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 -> Peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Couldn't send request to peer e3b7aa42b8924e21bbeb620671e29bd0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:15.873190  9976 raft_consensus.cc:2804] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.873814  9976 raft_consensus.cc:697] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:15.874691  9976 consensus_queue.cc:237] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:15.878098  9392 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:15.879140  9799 raft_consensus.cc:2804] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.879635  9799 raft_consensus.cc:697] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:15.880508  9799 consensus_queue.cc:237] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:15.890028  9983 log.cc:927] Time spent T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:05:15.899281  9249 catalog_manager.cc:5697] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.910108  9622 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:15.910831  9622 ts_tablet_manager.cc:1403] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.235s	user 0.015s	sys 0.000s
W20260709 13:05:15.920689  9985 log.cc:927] Time spent T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:05:15.939391  9621 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:15.939929  9621 ts_tablet_manager.cc:1403] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.000s
I20260709 13:05:15.961217  9620 tablet_bootstrap.cc:492] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:15.961818  9620 ts_tablet_manager.cc:1403] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.224s	user 0.016s	sys 0.021s
I20260709 13:05:15.967654  9756 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.966502  9620 raft_consensus.cc:359] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.980701  9620 raft_consensus.cc:385] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.981158  9620 raft_consensus.cc:740] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.982120  9620 consensus_queue.cc:260] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:15.991029  9622 raft_consensus.cc:359] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.992120  9622 raft_consensus.cc:385] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.992524  9622 raft_consensus.cc:740] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.993546  9622 consensus_queue.cc:260] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:15.990084  9621 raft_consensus.cc:359] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.003058  9621 raft_consensus.cc:385] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.003472  9621 raft_consensus.cc:740] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.007575  9622 ts_tablet_manager.cc:1434] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 13:05:16.009328  9621 consensus_queue.cc:260] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.012085  9620 ts_tablet_manager.cc:1434] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:05:16.013200  9620 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:16.023028  9622 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:16.025378  9621 ts_tablet_manager.cc:1434] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 13:05:16.027047  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:16.029284  9621 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:16.036301  9756 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:16.036551  9621 tablet_bootstrap.cc:654] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:16.038884  9465 leader_election.cc:343] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.055985  9622 tablet_bootstrap.cc:654] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.066143  9249 catalog_manager.cc:5697] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.069279  9249 catalog_manager.cc:5697] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:16.024145  9390 leader_election.cc:343] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.077585  9630 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.078179  9630 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.078749  9623 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:16.079276  9623 ts_tablet_manager.cc:1403] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.461s	user 0.015s	sys 0.013s
I20260709 13:05:16.084064  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:16.086187  9623 raft_consensus.cc:359] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.086911  9623 raft_consensus.cc:385] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.088011  9623 raft_consensus.cc:740] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.088721  9623 consensus_queue.cc:260] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:16.088853  9391 leader_election.cc:343] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.092837  9630 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:16.094014  9623 ts_tablet_manager.cc:1434] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:16.101020  9622 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:16.101590  9622 ts_tablet_manager.cc:1403] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.005s
W20260709 13:05:16.083179  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 62719.6us
I20260709 13:05:16.103336  9950 raft_consensus.cc:493] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.104306  9950 raft_consensus.cc:515] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.109483  9622 raft_consensus.cc:359] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:16.110353  9622 raft_consensus.cc:385] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.110687  9622 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.111426  9622 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:16.104403  9620 tablet_bootstrap.cc:654] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.116425  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:16.117182  9425 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.119788  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:16.120239  9622 ts_tablet_manager.cc:1434] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:16.120749  9500 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:16.121657  9622 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:16.125082  9246 catalog_manager.cc:5697] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.128567  9392 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:16.130448  9622 tablet_bootstrap.cc:654] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.130292  9973 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.131006  9973 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.131939  9996 raft_consensus.cc:2804] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.132401  9996 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.132732  9996 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.134181  9973 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:16.135700  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:16.140611  9711 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.145738  9916 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.134151  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:16.146556  9916 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.148710  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:16.149580  9426 raft_consensus.cc:2393] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:16.153644  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:16.154500  9950 leader_election.cc:290] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:16.163292  9916 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:16.165042  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:16.166496  9425 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:16.192198  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:16.192785  9392 leader_election.cc:343] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.193398  9465 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:16.194746  9979 raft_consensus.cc:2804] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.195040  9315 leader_election.cc:304] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:16.195448  9979 raft_consensus.cc:697] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:16.196188  9950 raft_consensus.cc:3060] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.186812  9540 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:16.202889  9623 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:16.196441  9979 consensus_queue.cc:237] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.216356  9973 raft_consensus.cc:2749] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.231930  9622 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:16.232807  9622 ts_tablet_manager.cc:1403] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.112s	user 0.026s	sys 0.007s
I20260709 13:05:16.233253  9996 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.234997  9622 raft_consensus.cc:359] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.235574  9622 raft_consensus.cc:385] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.235845  9622 raft_consensus.cc:740] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.235857  9996 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:16.236624  9622 consensus_queue.cc:260] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:16.237017  9950 raft_consensus.cc:2749] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.237140  9623 tablet_bootstrap.cc:654] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.294072  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:16.296999  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 73256.5us
I20260709 13:05:16.300297  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:16.328665  9621 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:16.332280  9621 ts_tablet_manager.cc:1403] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.303s	user 0.013s	sys 0.012s
I20260709 13:05:16.362056  9717 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.362895  9500 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.363324  9717 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:16.371503  9352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:16.372962  9717 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:16.374380  9465 leader_election.cc:343] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.377800  9620 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:16.378855  9620 ts_tablet_manager.cc:1403] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.366s	user 0.015s	sys 0.041s
I20260709 13:05:16.382293  9622 ts_tablet_manager.cc:1434] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.145s	user 0.006s	sys 0.000s
I20260709 13:05:16.385105  9622 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
W20260709 13:05:16.415177  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 45002.2us
I20260709 13:05:16.422858  9572 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.471387  9500 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:16.472339  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:16.477994  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 54984.5us
W20260709 13:05:16.479524  9390 leader_election.cc:343] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.480108  9390 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
W20260709 13:05:16.490312  9391 leader_election.cc:343] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:16.491781  9464 leader_election.cc:343] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.492357  9464 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:16.494781  9717 raft_consensus.cc:2749] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.496675  9620 raft_consensus.cc:359] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.491504  9976 consensus_queue.cc:1048] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.499280  9973 consensus_queue.cc:1048] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.499135  9688 raft_consensus.cc:2749] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.505468 10007 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:16.537887  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 46767us
I20260709 13:05:16.515991  9622 tablet_bootstrap.cc:654] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.535027  9621 raft_consensus.cc:359] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.561877  9621 raft_consensus.cc:385] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.562471  9621 raft_consensus.cc:740] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.563246  9621 consensus_queue.cc:260] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.522557  9973 consensus_queue.cc:1048] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:05:16.565987  9621 ts_tablet_manager.cc:1434] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.178s	user 0.002s	sys 0.007s
I20260709 13:05:16.518913  9620 raft_consensus.cc:385] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.566500  9620 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.567647  9620 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:16.569540  9620 ts_tablet_manager.cc:1434] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.190s	user 0.000s	sys 0.011s
I20260709 13:05:16.570458  9974 consensus_queue.cc:1048] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.571201  9620 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:16.573239  9621 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:16.541579  9392 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:16.630546 10012 raft_consensus.cc:2804] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:16.630892  9392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 89753.4us
I20260709 13:05:16.631203 10012 raft_consensus.cc:697] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:16.632764 10012 consensus_queue.cc:237] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.642475  9620 tablet_bootstrap.cc:654] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.685997  9623 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:16.686782  9623 ts_tablet_manager.cc:1403] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.484s	user 0.016s	sys 0.028s
I20260709 13:05:16.666043  9250 catalog_manager.cc:5697] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.727753  9799 consensus_queue.cc:1048] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.728358 10013 consensus_queue.cc:1048] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.735144  9621 tablet_bootstrap.cc:654] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.801573  9623 raft_consensus.cc:359] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.802659  9623 raft_consensus.cc:385] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.807413  9622 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:16.808182  9622 ts_tablet_manager.cc:1403] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.424s	user 0.024s	sys 0.023s
I20260709 13:05:16.812091  9980 consensus_queue.cc:1048] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.803014  9623 raft_consensus.cc:740] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
W20260709 13:05:16.817713  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 69759.6us
I20260709 13:05:16.846959  9623 consensus_queue.cc:260] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:16.868081  9630 consensus_queue.cc:1048] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 13:05:16.863940  9622 raft_consensus.cc:359] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:16.899147  9622 raft_consensus.cc:385] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.899997  9622 raft_consensus.cc:740] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.868171  9719 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.934893  9622 consensus_queue.cc:260] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:16.947237  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 102922us
I20260709 13:05:16.945151  9719 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:16.994951  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:17.013296 10030 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.042339 10030 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.042786  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:17.045787 10030 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:17.023277 10018 log.cc:927] Time spent T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:05:17.058789  9620 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:17.059461  9620 ts_tablet_manager.cc:1403] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.489s	user 0.030s	sys 0.029s
W20260709 13:05:17.068291 10016 log.cc:927] Time spent T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.300s	user 0.004s	sys 0.000s
I20260709 13:05:17.071453 10013 raft_consensus.cc:493] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.072176 10013 raft_consensus.cc:515] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.074797 10013 leader_election.cc:290] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:17.076138  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:17.076934  9421 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:17.078349  9539 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:17.079157 10030 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.079573 10030 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.079972 10030 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.082053  9248 catalog_manager.cc:5697] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.076499  9620 raft_consensus.cc:359] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.084666  9620 raft_consensus.cc:385] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.084969  9620 raft_consensus.cc:740] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.086831  9620 consensus_queue.cc:260] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.090766  9622 ts_tablet_manager.cc:1434] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.282s	user 0.013s	sys 0.012s
I20260709 13:05:17.092186  9622 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:17.095870  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:17.098235 10017 log.cc:927] Time spent T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: Append to log took a long time: real 0.367s	user 0.005s	sys 0.000s
I20260709 13:05:17.107251  9349 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.040372  9719 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:17.121191  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 168656us
W20260709 13:05:17.123507  9464 leader_election.cc:343] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.127336 10033 raft_consensus.cc:493] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.107174  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:17.041760  9623 ts_tablet_manager.cc:1434] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.355s	user 0.012s	sys 0.002s
I20260709 13:05:17.148053  9620 ts_tablet_manager.cc:1434] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:05:17.164940  9622 tablet_bootstrap.cc:654] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.149111 10033 raft_consensus.cc:515] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.179231  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:17.180071  9423 raft_consensus.cc:2468] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
W20260709 13:05:17.181862  9539 leader_election.cc:343] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:17.184195  9391 leader_election.cc:343] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:17.228472  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 80059.3us
I20260709 13:05:17.184983  9717 consensus_queue.cc:1048] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:05:17.230950  9465 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:17.258639  9623 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
W20260709 13:05:17.258810  9390 consensus_peers.cc:597] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 -> Peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Couldn't send request to peer e3b7aa42b8924e21bbeb620671e29bd0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:17.294445  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 128144us
I20260709 13:05:17.299773 10036 raft_consensus.cc:2804] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.300341 10036 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.300652 10036 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:17.307210 10045 log.cc:927] Time spent T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:05:17.312635  9621 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:17.313311  9621 ts_tablet_manager.cc:1403] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.740s	user 0.009s	sys 0.013s
I20260709 13:05:17.326596 10033 leader_election.cc:290] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:17.323336 10007 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.344674 10007 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.347931 10007 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:17.351975  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:17.361037 10030 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.361848  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:17.374068  9317 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
W20260709 13:05:17.374563  9391 consensus_peers.cc:597] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.375193 10007 raft_consensus.cc:2749] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:17.378090  9349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:17.390123  9623 tablet_bootstrap.cc:654] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.392987  9620 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:17.397732  9621 raft_consensus.cc:359] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.398546  9621 raft_consensus.cc:385] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.398814  9621 raft_consensus.cc:740] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.408789 10030 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:17.410552  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:17.411445  9427 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.412755  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:17.399575  9621 consensus_queue.cc:260] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:17.415050  9539 leader_election.cc:343] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.419801  9621 ts_tablet_manager.cc:1434] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.002s
W20260709 13:05:17.426545  9465 leader_election.cc:343] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.428179  9621 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: Bootstrap starting.
I20260709 13:05:17.435258  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:17.443617  9620 tablet_bootstrap.cc:654] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.449600  9427 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:17.452062  9539 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.458138  9976 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.476395  9622 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:17.476923  9622 ts_tablet_manager.cc:1403] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.385s	user 0.027s	sys 0.037s
I20260709 13:05:17.470328  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:17.474810  9976 raft_consensus.cc:697] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:17.480362  9574 raft_consensus.cc:2468] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 0.
I20260709 13:05:17.481029  9976 consensus_queue.cc:237] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.490095 10036 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.501168  9621 tablet_bootstrap.cc:654] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.503683  9390 leader_election.cc:343] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.505788  9390 leader_election.cc:304] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.507272  9688 raft_consensus.cc:2749] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.507606  9796 consensus_queue.cc:1048] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.511165  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:17.511853  9427 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.523910  9620 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:17.524607  9620 ts_tablet_manager.cc:1403] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.302s	user 0.020s	sys 0.001s
I20260709 13:05:17.527535  9620 raft_consensus.cc:359] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.528458  9620 raft_consensus.cc:385] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.528800  9620 raft_consensus.cc:740] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.531698  9622 raft_consensus.cc:359] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.535146  9622 raft_consensus.cc:385] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.535495  9622 raft_consensus.cc:740] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.536273  9622 consensus_queue.cc:260] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.537778  9464 leader_election.cc:304] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.538661  9622 ts_tablet_manager.cc:1434] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
I20260709 13:05:17.539062 10053 raft_consensus.cc:2804] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.539506 10053 raft_consensus.cc:493] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.539887 10053 raft_consensus.cc:3060] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.540118  9622 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: Bootstrap starting.
I20260709 13:05:17.542080 10036 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:17.531724  9427 raft_consensus.cc:2468] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:17.547674  9465 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:17.554131 10036 raft_consensus.cc:2804] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.554937 10036 raft_consensus.cc:697] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:17.555876 10036 consensus_queue.cc:237] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.558611 10053 raft_consensus.cc:515] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:17.564323 10058 log.cc:927] Time spent T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:05:17.574716  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:17.576437  9620 consensus_queue.cc:260] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.578799  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:17.580061  9622 tablet_bootstrap.cc:654] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.581607  9465 leader_election.cc:343] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.584304  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:17.585058  9575 raft_consensus.cc:3060] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.594058  9575 raft_consensus.cc:2468] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:17.596627  9623 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:17.597290  9623 ts_tablet_manager.cc:1403] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.339s	user 0.025s	sys 0.006s
I20260709 13:05:17.603128  9248 catalog_manager.cc:5697] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.606699  9623 raft_consensus.cc:359] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.609014  9623 raft_consensus.cc:385] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.609333  9623 raft_consensus.cc:740] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.578280 10053 leader_election.cc:290] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:17.623526  9623 consensus_queue.cc:260] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.639753  9620 ts_tablet_manager.cc:1434] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 13:05:17.645089  9620 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:17.645419  9621 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: No bootstrap required, opened a new log
I20260709 13:05:17.656530  9621 ts_tablet_manager.cc:1403] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.001s
I20260709 13:05:17.659519  9621 raft_consensus.cc:359] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.662945  9621 raft_consensus.cc:385] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.663273  9621 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.647323  9623 ts_tablet_manager.cc:1434] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
W20260709 13:05:17.650050  9464 leader_election.cc:343] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.666414  9464 leader_election.cc:304] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.668846  9980 raft_consensus.cc:2804] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.669529  9980 raft_consensus.cc:697] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:17.670521  9980 consensus_queue.cc:237] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.687297  9623 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:17.692166  9621 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.698212  9622 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: No bootstrap required, opened a new log
I20260709 13:05:17.698788  9622 ts_tablet_manager.cc:1403] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.000s
I20260709 13:05:17.715587  9622 raft_consensus.cc:359] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.716688  9622 raft_consensus.cc:385] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.716988  9622 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.717797  9622 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.718524  9623 tablet_bootstrap.cc:654] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.721369  9621 ts_tablet_manager.cc:1434] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:05:17.722368 10008 raft_consensus.cc:493] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.722921 10008 raft_consensus.cc:515] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.726008  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:17.729393 10008 leader_election.cc:290] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:17.731496  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:17.732442  9575 raft_consensus.cc:2393] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:17.732499  9622 ts_tablet_manager.cc:1434] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:05:17.733675  9315 leader_election.cc:304] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:17.734844 10008 raft_consensus.cc:3060] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.739593  9620 tablet_bootstrap.cc:654] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.744503 10008 raft_consensus.cc:2749] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.750298  9620 tablet_bootstrap.cc:492] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:17.750908  9620 ts_tablet_manager.cc:1403] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.000s
I20260709 13:05:17.756067  9623 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:17.756651  9623 ts_tablet_manager.cc:1403] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.001s
I20260709 13:05:17.758592  9620 raft_consensus.cc:359] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.759537  9620 raft_consensus.cc:385] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.759629  9623 raft_consensus.cc:359] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.759939  9620 raft_consensus.cc:740] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.760417  9623 raft_consensus.cc:385] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.761015  9620 consensus_queue.cc:260] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.761173  9250 catalog_manager.cc:5697] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.760756  9623 raft_consensus.cc:740] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.762941  9623 consensus_queue.cc:260] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.763453  9250 catalog_manager.cc:5697] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.770759  9620 ts_tablet_manager.cc:1434] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:17.772331  9620 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:17.775120 10013 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.775689 10013 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.777865 10013 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:17.779035  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:17.779874  9497 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 0.
I20260709 13:05:17.781518  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:17.783450  9392 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:17.784315  9391 leader_election.cc:343] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.784819  9620 tablet_bootstrap.cc:654] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.785269  9630 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.785660  9630 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.785959  9630 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.791162  9623 ts_tablet_manager.cc:1434] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:17.794364  9630 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.799314  9623 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:17.801818  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:17.803233  9391 leader_election.cc:343] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.804221  9630 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:17.808234  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:17.808938  9497 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.808976  9620 tablet_bootstrap.cc:492] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:17.809677  9620 ts_tablet_manager.cc:1403] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:05:17.812814  9620 raft_consensus.cc:359] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.813593  9620 raft_consensus.cc:385] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.813877  9620 raft_consensus.cc:740] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.814795  9620 consensus_queue.cc:260] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.817296  9620 ts_tablet_manager.cc:1434] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:17.818475  9620 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:17.820050  9623 tablet_bootstrap.cc:654] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.825207  9620 tablet_bootstrap.cc:654] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.824851  9497 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:17.830922  9392 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.832819  9630 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.834441  9630 raft_consensus.cc:697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:17.840379  9630 consensus_queue.cc:237] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.849462 10012 raft_consensus.cc:493] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.856003 10012 raft_consensus.cc:515] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:17.857931 10035 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.858373 10012 leader_election.cc:290] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:17.858520 10035 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.860980  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:17.863626  9390 leader_election.cc:343] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.878423 10035 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:17.881433  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:17.888458  9391 leader_election.cc:343] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.888967  9391 leader_election.cc:304] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:17.890414 10009 raft_consensus.cc:2749] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.890990  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:17.891937  9422 raft_consensus.cc:2393] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 1: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:17.895360  9567 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.900938  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:17.902694  9540 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:17.903537 10035 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.915506 10035 raft_consensus.cc:2749] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.929117  9620 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:17.929802  9620 ts_tablet_manager.cc:1403] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.038s
I20260709 13:05:17.933691  9620 raft_consensus.cc:359] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.934495  9620 raft_consensus.cc:385] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.934872  9620 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.937270  9623 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:17.937836  9623 ts_tablet_manager.cc:1403] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.139s	user 0.033s	sys 0.037s
I20260709 13:05:17.940858  9623 raft_consensus.cc:359] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.941560  9623 raft_consensus.cc:385] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.941833  9623 raft_consensus.cc:740] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.942492  9623 consensus_queue.cc:260] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:17.944842  9250 catalog_manager.cc:5697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.946128  9620 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.951208  9620 ts_tablet_manager.cc:1434] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:05:17.955583  9620 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:17.960727 10033 consensus_queue.cc:1048] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.972329  9620 tablet_bootstrap.cc:654] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.972873  9743 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:17.980738  9743 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:17.984897  9743 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:17.988193  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:17.989559  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:17.990823 10035 consensus_queue.cc:1048] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.973392 10042 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.993882 10042 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:17.996238  9980 consensus_queue.cc:1048] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.997656  9539 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:17.998651 10035 raft_consensus.cc:2749] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:18.002600  9623 ts_tablet_manager.cc:1434] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:05:18.008987  9623 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:18.017275  9623 tablet_bootstrap.cc:654] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.021561 10008 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.022166 10008 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:18.026688 10008 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:18.027904  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:18.031354  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:18.034245  9317 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:18.035163 10007 raft_consensus.cc:2749] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.037432 10042 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:18.038865  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:18.040370  9465 leader_election.cc:343] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.042388  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:18.045248  9743 raft_consensus.cc:493] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.045905  9743 raft_consensus.cc:515] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.049103  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:18.049837  9345 raft_consensus.cc:2468] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:18.051108  9539 leader_election.cc:304] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:18.051963 10041 raft_consensus.cc:2804] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.052341 10041 raft_consensus.cc:493] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.052654 10041 raft_consensus.cc:3060] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.056610 10030 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.057353 10030 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.059846 10030 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:18.066355  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:18.067351  9539 consensus_peers.cc:597] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.068090  9539 leader_election.cc:343] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.045929  9464 leader_election.cc:343] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.068677  9464 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:18.070160  9623 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:18.070209  9980 raft_consensus.cc:2749] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.070945  9623 ts_tablet_manager.cc:1403] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.037s
I20260709 13:05:18.074193  9623 raft_consensus.cc:359] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.075037  9623 raft_consensus.cc:385] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.075368  9623 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.076169  9623 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.084611  9623 ts_tablet_manager.cc:1434] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 13:05:18.091990  9623 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:18.100490  9623 tablet_bootstrap.cc:654] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:18.103240  9297 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:18.107730  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:18.108592  9495 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:18.111136  9540 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:18.111963 10030 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.112464 10030 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.112948 10030 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.115413  9623 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:18.115949  9623 ts_tablet_manager.cc:1403] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 13:05:18.119652  9623 raft_consensus.cc:359] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.120364  9623 raft_consensus.cc:385] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.120609  9623 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.122617  9623 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.125272  9623 ts_tablet_manager.cc:1434] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:05:18.126542  9623 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:18.132493 10030 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.134733  9623 tablet_bootstrap.cc:654] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.140198  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:18.141269  9422 raft_consensus.cc:2468] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:18.146219 10030 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:18.147907  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:18.149147  9350 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.164626  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:18.165789  9495 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.188337  9620 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:18.189307  9620 ts_tablet_manager.cc:1403] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.234s	user 0.009s	sys 0.009s
I20260709 13:05:18.192651 10008 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.106658 10041 raft_consensus.cc:515] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.193370 10008 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.138372  9743 leader_election.cc:290] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:18.198434  9980 consensus_queue.cc:1048] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.204288  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:18.218091  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:18.220058  9316 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:18.220480  9350 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.221051 10007 raft_consensus.cc:2749] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.235380 10008 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:18.237741  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 52674.2us
I20260709 13:05:18.240425  9539 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:18.241201 10030 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.241729 10030 raft_consensus.cc:697] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:18.242703 10033 consensus_queue.cc:1048] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.244704  9623 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:18.245242  9623 ts_tablet_manager.cc:1403] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.119s	user 0.060s	sys 0.026s
I20260709 13:05:18.242691 10030 consensus_queue.cc:237] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.252666 10041 leader_election.cc:290] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:18.255300  9623 raft_consensus.cc:359] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:18.256289  9623 raft_consensus.cc:385] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.256587  9623 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.252871  9620 raft_consensus.cc:359] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.259414  9620 raft_consensus.cc:385] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.259737  9620 raft_consensus.cc:740] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.260464  9351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:18.261126  9351 raft_consensus.cc:3060] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.273882  9351 raft_consensus.cc:2468] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.257452  9623 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:18.275470  9620 consensus_queue.cc:260] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.276546  9623 ts_tablet_manager.cc:1434] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:05:18.278677  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:18.278946  9620 ts_tablet_manager.cc:1434] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:05:18.279320  9422 raft_consensus.cc:3060] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.280393  9620 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: Bootstrap starting.
I20260709 13:05:18.286743  9495 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.294821  9350 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.295923  9620 tablet_bootstrap.cc:654] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.296505  9623 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:18.296929  9422 raft_consensus.cc:2468] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.303560 10030 raft_consensus.cc:493] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.304911 10030 raft_consensus.cc:515] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.305490  9539 leader_election.cc:304] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:18.306327 10041 raft_consensus.cc:2804] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.306293  9688 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.307170 10041 raft_consensus.cc:697] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:18.311497 10041 consensus_queue.cc:237] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.317067  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:18.319660  9539 leader_election.cc:343] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.320016  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:18.321319  9424 raft_consensus.cc:2468] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
I20260709 13:05:18.309767  9247 catalog_manager.cc:5697] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.326938  9623 tablet_bootstrap.cc:654] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.307119 10030 leader_election.cc:290] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:18.330906  9539 leader_election.cc:304] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:18.332365 10030 raft_consensus.cc:2804] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.332954 10030 raft_consensus.cc:493] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.333448 10030 raft_consensus.cc:3060] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.344612  9620 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: No bootstrap required, opened a new log
I20260709 13:05:18.345181  9620 ts_tablet_manager.cc:1403] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.006s
I20260709 13:05:18.358899  9630 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.371773  9620 raft_consensus.cc:359] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.373642  9620 raft_consensus.cc:385] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.374042  9620 raft_consensus.cc:740] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.374775  9620 consensus_queue.cc:260] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.379369  9620 ts_tablet_manager.cc:1434] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:18.379359  9623 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:18.393167  9623 ts_tablet_manager.cc:1403] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.028s
I20260709 13:05:18.395737  9345 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.396107  9623 raft_consensus.cc:359] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.396854  9623 raft_consensus.cc:385] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.397142  9623 raft_consensus.cc:740] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.397830  9623 consensus_queue.cc:260] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.399456  9623 ts_tablet_manager.cc:1434] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:18.401736 10030 raft_consensus.cc:515] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.408712 10030 leader_election.cc:290] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:18.410180  9623 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:18.414501  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:18.415117  9350 raft_consensus.cc:3060] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.418171  9623 tablet_bootstrap.cc:654] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.424543  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:18.425227  9422 raft_consensus.cc:3060] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.432210  9422 raft_consensus.cc:2468] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.432387  9350 raft_consensus.cc:2468] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.433288  9539 leader_election.cc:304] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:18.434072 10030 raft_consensus.cc:2804] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.434554 10030 raft_consensus.cc:697] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:18.435408 10030 consensus_queue.cc:237] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:18.435351  9248 catalog_manager.cc:5697] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.441205  9973 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.442943  9973 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.445240  9973 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:18.446012  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:18.448972  9350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:18.451532  9495 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 0.
W20260709 13:05:18.450966  9539 leader_election.cc:343] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.453517  9623 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: No bootstrap required, opened a new log
I20260709 13:05:18.454094  9623 ts_tablet_manager.cc:1403] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.022s
I20260709 13:05:18.454885  9540 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:18.455574  9973 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.455940  9973 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.456302  9973 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.457672  9623 raft_consensus.cc:359] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.458384  9623 raft_consensus.cc:385] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.458634  9623 raft_consensus.cc:740] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.461236  9623 consensus_queue.cc:260] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.463573  9623 ts_tablet_manager.cc:1434] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:18.466511  9973 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.468761  9973 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:18.469929  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:18.470218  9345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:18.470562  9495 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.470872  9345 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.476743  9495 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.476111  9247 catalog_manager.cc:5697] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.477891  9345 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:18.479876  9539 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:18.481319  9973 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.481859  9973 raft_consensus.cc:697] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:18.482714  9973 consensus_queue.cc:237] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:18.499203  9247 catalog_manager.cc:5697] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.524581  9350 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.644639 10030 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.658979 10030 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.835824 10041 consensus_queue.cc:1048] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.866431 10030 consensus_queue.cc:1048] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.999152 10030 consensus_queue.cc:1048] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.016494 10041 consensus_queue.cc:1048] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.034132 10030 consensus_queue.cc:1048] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.050812  9743 consensus_queue.cc:1048] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.873152   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:19.889267  9539 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:19.893915  9539 consensus_peers.cc:597] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.898289  9539 consensus_peers.cc:597] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.913627  9465 consensus_peers.cc:597] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.925598  9391 consensus_peers.cc:597] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.926311  9391 consensus_peers.cc:597] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.931833   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:19.932924   431 tablet_replica.cc:333] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.933969   431 raft_consensus.cc:2243] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.934588   431 raft_consensus.cc:2272] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.936782   431 tablet_replica.cc:333] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.937531   431 raft_consensus.cc:2243] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.938014   431 raft_consensus.cc:2272] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:19.940222  9465 consensus_peers.cc:597] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.940423   431 tablet_replica.cc:333] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.941149   431 raft_consensus.cc:2243] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.941684   431 raft_consensus.cc:2272] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.944253   431 tablet_replica.cc:333] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.945025   431 raft_consensus.cc:2243] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.945591   431 raft_consensus.cc:2272] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.947671   431 tablet_replica.cc:333] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.948398   431 raft_consensus.cc:2243] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.948868   431 raft_consensus.cc:2272] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.950737   431 tablet_replica.cc:333] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.951282   431 raft_consensus.cc:2243] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.951661   431 raft_consensus.cc:2272] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.954604   431 tablet_replica.cc:333] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.955533   431 raft_consensus.cc:2243] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.956449   431 raft_consensus.cc:2272] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:19.956770  9539 consensus_peers.cc:597] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.959553   431 tablet_replica.cc:333] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.960636   431 raft_consensus.cc:2243] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.961211   431 raft_consensus.cc:2272] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:19.961809  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.963814   431 tablet_replica.cc:333] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.964761   431 raft_consensus.cc:2243] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.965292   431 raft_consensus.cc:2272] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.968556   431 tablet_replica.cc:333] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.969419   431 raft_consensus.cc:2243] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.969930   431 raft_consensus.cc:2272] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.972224   431 tablet_replica.cc:333] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.972841   431 raft_consensus.cc:2243] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.973237   431 raft_consensus.cc:2272] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.975586   431 tablet_replica.cc:333] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.976353   431 raft_consensus.cc:2243] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.976876   431 raft_consensus.cc:2272] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.978989   431 tablet_replica.cc:333] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.979575   431 raft_consensus.cc:2243] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.980090   431 raft_consensus.cc:2272] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.982501   431 tablet_replica.cc:333] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.983307   431 raft_consensus.cc:2243] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.983768   431 raft_consensus.cc:2272] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.986625   431 tablet_replica.cc:333] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.987407   431 raft_consensus.cc:2243] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.987948   431 raft_consensus.cc:2272] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.991719   431 tablet_replica.cc:333] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.992491   431 raft_consensus.cc:2243] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.992914   431 raft_consensus.cc:2272] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.994859   431 tablet_replica.cc:333] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.995378   431 raft_consensus.cc:2243] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.995817   431 raft_consensus.cc:2272] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.997933   431 tablet_replica.cc:333] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:19.998499   431 raft_consensus.cc:2243] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.998930   431 raft_consensus.cc:2272] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.000979   431 tablet_replica.cc:333] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.001570   431 raft_consensus.cc:2243] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.002408   431 raft_consensus.cc:2272] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.004743   431 tablet_replica.cc:333] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.005402   431 raft_consensus.cc:2243] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.005875   431 raft_consensus.cc:2272] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.009495   431 tablet_replica.cc:333] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.010262   431 raft_consensus.cc:2243] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.010771   431 raft_consensus.cc:2272] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.013253   431 tablet_replica.cc:333] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.014146   431 raft_consensus.cc:2243] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:20.015004  9539 consensus_peers.cc:597] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.015781   431 raft_consensus.cc:2272] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.018721   431 tablet_replica.cc:333] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.019321   431 raft_consensus.cc:2243] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.020175   431 raft_consensus.cc:2272] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.022424   431 tablet_replica.cc:333] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.023172   431 raft_consensus.cc:2243] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.023710   431 raft_consensus.cc:2272] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.026306   431 tablet_replica.cc:333] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.026878   431 raft_consensus.cc:2243] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.027346   431 raft_consensus.cc:2272] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.029551   431 tablet_replica.cc:333] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.030165   431 raft_consensus.cc:2243] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.030706   431 raft_consensus.cc:2272] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.032819   431 tablet_replica.cc:333] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.033509   431 raft_consensus.cc:2243] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.034047   431 raft_consensus.cc:2272] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.036530   431 tablet_replica.cc:333] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.037289   431 raft_consensus.cc:2243] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:20.037940  9539 consensus_peers.cc:597] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.038426   431 raft_consensus.cc:2272] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.040768   431 tablet_replica.cc:333] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.041363   431 raft_consensus.cc:2243] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.041815   431 raft_consensus.cc:2272] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.044646   431 tablet_replica.cc:333] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.045368   431 raft_consensus.cc:2243] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.045881   431 raft_consensus.cc:2272] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.048470   431 tablet_replica.cc:333] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.049225   431 raft_consensus.cc:2243] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.049785   431 raft_consensus.cc:2272] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:20.051942  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.052920   431 tablet_replica.cc:333] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.053925   431 raft_consensus.cc:2243] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.054848   431 raft_consensus.cc:2272] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.057024   431 tablet_replica.cc:333] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.057622   431 raft_consensus.cc:2243] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.058382   431 raft_consensus.cc:2272] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.060559   431 tablet_replica.cc:333] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.061177   431 raft_consensus.cc:2243] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.061635   431 raft_consensus.cc:2272] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.063683   431 tablet_replica.cc:333] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.064307   431 raft_consensus.cc:2243] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.064735   431 raft_consensus.cc:2272] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.066452   431 tablet_replica.cc:333] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.067013   431 raft_consensus.cc:2243] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.067420   431 raft_consensus.cc:2272] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.069368   431 tablet_replica.cc:333] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.070030   431 raft_consensus.cc:2243] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.070495   431 raft_consensus.cc:2272] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.072839   431 tablet_replica.cc:333] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
W20260709 13:05:20.073077  9539 consensus_peers.cc:597] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.073486   431 raft_consensus.cc:2243] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.074148   431 raft_consensus.cc:2272] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.076591   431 tablet_replica.cc:333] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.077349   431 raft_consensus.cc:2243] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.077862   431 raft_consensus.cc:2272] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:20.079275  9539 consensus_peers.cc:597] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.080699   431 tablet_replica.cc:333] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.081367   431 raft_consensus.cc:2243] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.081786   431 raft_consensus.cc:2272] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.083667   431 tablet_replica.cc:333] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.084265   431 raft_consensus.cc:2243] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.084714   431 raft_consensus.cc:2272] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.088225   431 tablet_replica.cc:333] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
W20260709 13:05:20.089335  9391 consensus_peers.cc:597] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.090135   431 raft_consensus.cc:2243] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.090674   431 raft_consensus.cc:2272] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.092978   431 tablet_replica.cc:333] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.093524   431 raft_consensus.cc:2243] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.094058   431 raft_consensus.cc:2272] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.096450   431 tablet_replica.cc:333] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.097061   431 raft_consensus.cc:2243] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.097550   431 raft_consensus.cc:2272] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.100278   431 tablet_replica.cc:333] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: stopping tablet replica
I20260709 13:05:20.100883   431 raft_consensus.cc:2243] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.101902   431 raft_consensus.cc:2272] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:20.105492  9391 consensus_peers.cc:597] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.105850  9539 consensus_peers.cc:597] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.108446  9539 consensus_peers.cc:597] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.112234  9391 consensus_peers.cc:597] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.116235  9465 consensus_peers.cc:597] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.119016  9391 consensus_peers.cc:597] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.134565  9391 consensus_peers.cc:597] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.155740  9465 consensus_peers.cc:597] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.156512  9465 consensus_peers.cc:597] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.185158  9391 consensus_peers.cc:597] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.187371   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:20.202521  9539 consensus_peers.cc:597] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.203296  9391 consensus_peers.cc:597] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.203347  9539 consensus_peers.cc:597] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.206276  9391 consensus_peers.cc:597] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.238683  9539 consensus_peers.cc:597] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.244638  9391 consensus_peers.cc:597] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.253225  9539 consensus_peers.cc:597] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.253901  9539 consensus_peers.cc:597] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.255424  9465 consensus_peers.cc:597] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.286324   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:20.294783 10118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.295167 10117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.298475  9539 consensus_peers.cc:597] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.307966 10120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.313575   431 server_base.cc:1061] running on GCE node
W20260709 13:05:20.316241  9465 consensus_peers.cc:597] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.316289   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:20.316773   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:20.317013   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602320316997 us; error 0 us; skew 500 ppm
I20260709 13:05:20.317683   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:20.320758   431 webserver.cc:533] Webserver started at http://127.0.107.193:43623/ using document root <none> and password file <none>
I20260709 13:05:20.321288   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:20.321503   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:20.325326   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:05:20.335834 10126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.339583   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:20.339993   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "eae0fc1c2353497a889fdda2eda53679"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-rrf3"
I20260709 13:05:20.340484   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:20.360275   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:20.362123   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:20.364120   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:20.369434 10133 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:05:20.412542  9391 consensus_peers.cc:597] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.413162  9391 consensus_peers.cc:597] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.427064  9465 consensus_peers.cc:597] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.667128   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:05:20.667557   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.299s	user 0.008s	sys 0.000s
I20260709 13:05:20.667936   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:05:20.680505 10133 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.728607 10133 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.730348 10133 tablet_bootstrap.cc:492] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.731197 10133 ts_tablet_manager.cc:1403] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.009s
I20260709 13:05:20.734439 10133 raft_consensus.cc:359] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.735241 10133 raft_consensus.cc:740] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.742367 10133 consensus_queue.cc:260] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.745798 10133 ts_tablet_manager.cc:1434] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:20.746731 10133 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.765214 10133 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.765980 10133 tablet_bootstrap.cc:492] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.766602 10133 ts_tablet_manager.cc:1403] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:05:20.768885 10133 raft_consensus.cc:359] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:20.769622 10133 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.770296 10133 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:20.772230 10133 ts_tablet_manager.cc:1434] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:05:20.772940 10133 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.819669 10133 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.821143 10133 tablet_bootstrap.cc:492] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.821913 10133 ts_tablet_manager.cc:1403] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.012s
I20260709 13:05:20.829512 10133 raft_consensus.cc:359] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.830235 10133 raft_consensus.cc:740] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.830961 10133 consensus_queue.cc:260] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.832670 10133 ts_tablet_manager.cc:1434] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:20.833361 10133 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.854120 10133 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.854913 10133 tablet_bootstrap.cc:492] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.855445 10133 ts_tablet_manager.cc:1403] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:05:20.857545 10133 raft_consensus.cc:359] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.858249 10133 raft_consensus.cc:740] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.859046 10133 consensus_queue.cc:260] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.860843 10133 ts_tablet_manager.cc:1434] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:05:20.861600 10133 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.876276 10133 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.877238 10133 tablet_bootstrap.cc:492] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.877969 10133 ts_tablet_manager.cc:1403] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:20.880250 10133 raft_consensus.cc:359] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:20.880929 10133 raft_consensus.cc:740] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.881872 10133 consensus_queue.cc:260] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:20.883708 10133 ts_tablet_manager.cc:1434] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:20.884485 10133 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.901669 10133 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.902628 10133 tablet_bootstrap.cc:492] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.903280 10133 ts_tablet_manager.cc:1403] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:05:20.905822 10133 raft_consensus.cc:359] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.906478 10133 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.907179 10133 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.909103 10133 ts_tablet_manager.cc:1434] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:20.909839 10133 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.925055 10133 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.926137 10133 tablet_bootstrap.cc:492] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.927381 10133 ts_tablet_manager.cc:1403] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:05:20.929505 10133 raft_consensus.cc:359] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.930080 10133 raft_consensus.cc:740] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.930732 10133 consensus_queue.cc:260] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.932341 10133 ts_tablet_manager.cc:1434] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:20.933007 10133 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.949180 10133 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.950219 10133 tablet_bootstrap.cc:492] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:20.951077 10133 ts_tablet_manager.cc:1403] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:05:20.953612 10133 raft_consensus.cc:359] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.954262 10133 raft_consensus.cc:740] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.954952 10133 consensus_queue.cc:260] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:20.956171  9688 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:20.956913 10133 ts_tablet_manager.cc:1434] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:05:20.956694  9688 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:20.957839 10133 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:20.958602  9688 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:20.960068  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:20.964548  9391 leader_election.cc:336] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:20.965124  9391 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:20.966390  9688 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:20.998363 10133 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:20.999467 10133 tablet_bootstrap.cc:492] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.000253 10133 ts_tablet_manager.cc:1403] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.024s
I20260709 13:05:21.002812 10133 raft_consensus.cc:359] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.003582 10133 raft_consensus.cc:740] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.004284 10133 consensus_queue.cc:260] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.006254 10133 ts_tablet_manager.cc:1434] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:21.007077 10133 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.010185   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:05:21.010619   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.343s	user 0.269s	sys 0.000s
I20260709 13:05:21.030531 10133 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.031726 10133 tablet_bootstrap.cc:492] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.032557 10133 ts_tablet_manager.cc:1403] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.000s
I20260709 13:05:21.035774 10133 raft_consensus.cc:359] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.036506 10037 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.037068 10133 raft_consensus.cc:740] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.037415 10037 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.038480 10133 consensus_queue.cc:260] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.041687  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:21.042083 10133 ts_tablet_manager.cc:1434] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:05:21.043475 10133 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.052745 10037 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:21.054098  9465 leader_election.cc:336] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:21.054620  9465 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.056900 10037 raft_consensus.cc:2749] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.069705 10133 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.071396 10133 tablet_bootstrap.cc:492] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.072446 10133 ts_tablet_manager.cc:1403] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 13:05:21.077417 10133 raft_consensus.cc:359] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.078475 10133 raft_consensus.cc:740] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.079412 10133 consensus_queue.cc:260] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.081887 10133 ts_tablet_manager.cc:1434] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:21.082692 10133 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.100368 10133 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.101171 10133 tablet_bootstrap.cc:492] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.101718 10133 ts_tablet_manager.cc:1403] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:05:21.104429 10133 raft_consensus.cc:359] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.105212 10133 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.105975 10133 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.108263 10133 ts_tablet_manager.cc:1434] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:21.109170 10133 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.112754   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33181
I20260709 13:05:21.112947 10208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33181 every 8 connection(s)
I20260709 13:05:21.120338 10125 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.121235 10125 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.139174 10134 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.140475  9688 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.141251  9688 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.139863 10134 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.154978 10134 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.162932 10125 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:21.167095  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:21.176678  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:21.184782  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:21.185781  9497 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:21.197192  9688 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.198040  9688 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.200440  9688 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.232880  9540 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.257289 10037 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.258378 10037 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.269515  9688 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:21.271400 10134 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.272500 10134 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.273186 10134 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.284164 10030 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.292933 10030 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.296871 10030 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.308413 10138 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.309508 10138 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.317160  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:21.318058  9427 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
W20260709 13:05:21.325129  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 89434.1us
I20260709 13:05:21.334000 10136 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.335012 10136 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.338287 10136 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.345582  9539 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.355782 10136 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.356284 10136 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.356693 10136 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.387909  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:21.379776  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:21.393795 10037 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.415446 10133 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.419302 10218 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.404222  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:21.407648  9496 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:21.421061  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:21.426497 10133 tablet_bootstrap.cc:492] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.437857 10133 ts_tablet_manager.cc:1403] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.329s	user 0.016s	sys 0.016s
I20260709 13:05:21.440368  9567 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:21.444504 10133 raft_consensus.cc:359] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.445271 10133 raft_consensus.cc:740] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.438236 10138 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.450616 10133 consensus_queue.cc:260] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.454216 10133 ts_tablet_manager.cc:1434] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:21.455091 10133 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.419844 10218 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:21.464525  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 72380.6us
I20260709 13:05:21.471397  9743 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.471983  9743 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.474135 10216 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.474833  9743 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.474749 10216 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.481464 10136 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.482631 10134 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.485267 10218 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.485255 10134 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.495028 10216 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:21.495042  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:21.496111  9422 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:21.498478  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:21.498838  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.502871  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:21.503562  9501 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:21.499152  9427 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:21.513783 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.514065 10135 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.514540 10135 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.510872 10136 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.515955  9540 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.515378  9465 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:21.518684  9464 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.520242  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:21.520874  9422 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.521006 10037 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.521067 10224 raft_consensus.cc:2804] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.514900 10135 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.521641 10224 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.522146 10224 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.520895 10035 raft_consensus.cc:2804] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.523545 10035 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.523936 10035 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.521556 10037 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.533259 10218 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.535845 10037 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.536226 10218 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.538455 10218 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.539278 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.540016 10183 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:21.543206 10035 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.531195  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:21.557626 10135 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.558630  9495 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.561614 10224 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.547812  9422 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:21.548194 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:21.551600  9391 leader_election.cc:343] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.565933  9391 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.553437  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:21.535496  9392 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:21.552896 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.566854  9427 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
I20260709 13:05:21.567948  9391 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:21.569092  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:21.569708  9427 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.571080  9465 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:21.574723 10226 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.575227 10226 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.575608 10226 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.577730 10224 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.572427 10178 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:21.581066  9539 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.566166 10135 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.571506 10109 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:21.586266  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 54225.2us
I20260709 13:05:21.592547 10035 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.583683 10134 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.596002 10134 raft_consensus.cc:697] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:21.601089  9427 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:21.600659  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:21.603597  9573 raft_consensus.cc:2393] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:21.602067  9688 raft_consensus.cc:2764] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:21.604175 10134 consensus_queue.cc:237] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.586694 10109 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.608922 10133 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.609234  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.610169 10037 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.611572 10222 raft_consensus.cc:2749] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.596421  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:21.624440  9498 raft_consensus.cc:2393] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:21.621187 10109 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.626976 10133 tablet_bootstrap.cc:492] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.645469 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.648913 10133 ts_tablet_manager.cc:1403] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.004s
I20260709 13:05:21.648965 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.651098 10182 raft_consensus.cc:3060] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.652209 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.652868 10180 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.653488 10133 raft_consensus.cc:359] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.654263 10133 raft_consensus.cc:740] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.655175 10133 consensus_queue.cc:260] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.657517 10133 ts_tablet_manager.cc:1434] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:21.642149  9248 catalog_manager.cc:5697] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.643692 10037 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.626978 10228 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.660449 10228 raft_consensus.cc:697] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:21.661280 10180 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:21.661368 10228 consensus_queue.cc:237] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.648941 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.632534 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.630738 10226 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.663555 10177 raft_consensus.cc:2376] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2. Re-sending same reply.
W20260709 13:05:21.664620  9391 leader_election.cc:343] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.665045 10226 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:21.666118 10182 raft_consensus.cc:2468] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:21.666656  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:21.668299 10125 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.647957  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:21.668701 10125 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:21.669075  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:21.669836  9424 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.670663 10109 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.669150 10125 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.646404 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.673759 10181 raft_consensus.cc:2376] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2. Re-sending same reply.
I20260709 13:05:21.674254  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:21.674952  9498 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.638679  9495 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:21.676432  9540 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:21.678314 10109 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:21.678936 10035 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.679461 10035 raft_consensus.cc:697] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
W20260709 13:05:21.679767  9465 leader_election.cc:343] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.681209  9465 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.683568 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.680416 10035 consensus_queue.cc:237] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.684974 10209 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46283
I20260709 13:05:21.685438 10209 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:21.686439 10209 heartbeater.cc:507] Master 127.0.107.254:46283 requested a full tablet report, sending...
I20260709 13:05:21.692678  9498 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:21.691597 10125 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.693293 10224 raft_consensus.cc:2749] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.693904  9427 raft_consensus.cc:2393] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:21.684084  9465 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
W20260709 13:05:21.694808  9465 leader_election.cc:343] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.694832 10224 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.695583 10224 raft_consensus.cc:697] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:21.696472  9465 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:21.697314 10224 consensus_queue.cc:237] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.700368 10037 raft_consensus.cc:2804] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.700946 10037 raft_consensus.cc:697] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:21.701874 10037 consensus_queue.cc:237] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:21.706588  9391 leader_election.cc:343] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.708484 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.698081  9424 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:21.699043 10133 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.698822  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:21.699316 10125 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:21.721057  9465 leader_election.cc:343] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.722100  9465 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.723711 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.728255  9392 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.730278 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.730100  9250 catalog_manager.cc:5697] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.730877 10125 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.738101 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.739153 10181 raft_consensus.cc:2393] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:21.738300 10218 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.740446 10125 raft_consensus.cc:697] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:21.741469 10125 consensus_queue.cc:237] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.740123 10218 raft_consensus.cc:697] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:21.753201 10218 consensus_queue.cc:237] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.764729 10133 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.767987 10133 tablet_bootstrap.cc:492] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.768085 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:21.769256 10133 ts_tablet_manager.cc:1403] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.000s
I20260709 13:05:21.769140 10177 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:21.770643 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.772017 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.772630 10133 raft_consensus.cc:359] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.773484 10133 raft_consensus.cc:740] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.774438 10133 consensus_queue.cc:260] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.777177 10133 ts_tablet_manager.cc:1434] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:21.778065 10133 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.779098 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.780120 10183 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:21.783367  9539 leader_election.cc:343] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.784706 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:21.785645 10182 raft_consensus.cc:2393] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 2: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:21.786687 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:21.787655  9539 leader_election.cc:343] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.791690  9247 catalog_manager.cc:5697] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.787587 10179 raft_consensus.cc:2393] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
W20260709 13:05:21.796893  9539 leader_election.cc:343] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.798410  9539 leader_election.cc:343] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.809286 10183 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:21.812800  9249 ts_manager.cc:194] Re-registered known tserver with Master: eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:21.816872  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.817705 10133 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.818457 10125 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.820269 10133 tablet_bootstrap.cc:492] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.821003 10133 ts_tablet_manager.cc:1403] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.005s
I20260709 13:05:21.822921  9539 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:21.824654 10035 raft_consensus.cc:2749] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.824213 10133 raft_consensus.cc:359] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.825994 10133 raft_consensus.cc:740] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.826705 10133 consensus_queue.cc:260] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:21.828845 10133 ts_tablet_manager.cc:1434] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:21.829650 10133 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.852315 10133 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.853380 10133 tablet_bootstrap.cc:492] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.854105 10133 ts_tablet_manager.cc:1403] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:05:21.856830 10133 raft_consensus.cc:359] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.858028 10133 raft_consensus.cc:740] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.859004 10133 consensus_queue.cc:260] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.861182 10133 ts_tablet_manager.cc:1434] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:21.862080 10133 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.869494  9250 catalog_manager.cc:5697] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.869997  9248 catalog_manager.cc:5697] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.871531  9250 catalog_manager.cc:5697] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.871501  9248 catalog_manager.cc:5697] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.878593 10133 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.880714 10133 tablet_bootstrap.cc:492] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.881414 10133 ts_tablet_manager.cc:1403] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:05:21.884868 10133 raft_consensus.cc:359] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.885648 10133 raft_consensus.cc:740] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.886389 10133 consensus_queue.cc:260] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.889987 10133 ts_tablet_manager.cc:1434] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:21.890826 10133 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.902132  9249 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39074
I20260709 13:05:21.907260 10209 heartbeater.cc:499] Master 127.0.107.254:46283 was elected leader, sending a full tablet report...
I20260709 13:05:21.907985 10133 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.908993 10133 tablet_bootstrap.cc:492] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.909636 10133 ts_tablet_manager.cc:1403] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:05:21.912012 10133 raft_consensus.cc:359] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.912729 10133 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.913408 10133 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.915431 10133 ts_tablet_manager.cc:1434] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:21.916232 10133 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.940822 10133 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.941857 10133 tablet_bootstrap.cc:492] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.942593 10133 ts_tablet_manager.cc:1403] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:05:21.945214 10133 raft_consensus.cc:359] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.946026 10133 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.946761 10133 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:21.949087 10133 ts_tablet_manager.cc:1434] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:21.949934 10133 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:21.965837 10133 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:21.966804 10133 tablet_bootstrap.cc:492] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:21.967442 10133 ts_tablet_manager.cc:1403] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:05:21.969946 10133 raft_consensus.cc:359] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.970703 10133 raft_consensus.cc:740] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.971416 10133 consensus_queue.cc:260] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:21.973658 10133 ts_tablet_manager.cc:1434] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:21.974510 10133 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.003638 10133 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.004807 10133 tablet_bootstrap.cc:492] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.005641 10133 ts_tablet_manager.cc:1403] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:05:22.008275 10133 raft_consensus.cc:359] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.008948 10133 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.009635 10133 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.011711 10133 ts_tablet_manager.cc:1434] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:05:22.012756 10133 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.028216 10133 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.029165 10133 tablet_bootstrap.cc:492] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.029745 10133 ts_tablet_manager.cc:1403] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:05:22.031780 10133 raft_consensus.cc:359] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.032464 10133 raft_consensus.cc:740] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.033088 10133 consensus_queue.cc:260] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.035132 10133 ts_tablet_manager.cc:1434] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:22.036329 10133 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.059664 10133 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.060535 10133 tablet_bootstrap.cc:492] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.061201 10133 ts_tablet_manager.cc:1403] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:05:22.063541 10133 raft_consensus.cc:359] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.064239 10133 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.064942 10133 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.066964 10133 ts_tablet_manager.cc:1434] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:22.067780 10133 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.080269 10183 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.082654 10035 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.084522 10133 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.085120  9424 raft_consensus.cc:1275] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.085565 10133 tablet_bootstrap.cc:492] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.086285 10133 ts_tablet_manager.cc:1403] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:05:22.087108 10037 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.089470 10133 raft_consensus.cc:359] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.090219 10133 raft_consensus.cc:740] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.091079 10133 consensus_queue.cc:260] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.093789 10133 ts_tablet_manager.cc:1434] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:22.094590 10133 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
W20260709 13:05:22.096611  9539 consensus_peers.cc:597] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.097735 10179 raft_consensus.cc:1275] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.101359 10226 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.130481 10133 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.130565  9424 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.131475 10133 tablet_bootstrap.cc:492] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.132167 10133 ts_tablet_manager.cc:1403] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.007s
I20260709 13:05:22.134696 10133 raft_consensus.cc:359] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.135396 10133 raft_consensus.cc:740] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.136055 10133 consensus_queue.cc:260] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.137023 10134 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.138137 10133 ts_tablet_manager.cc:1434] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:22.139029 10133 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.140879  9573 raft_consensus.cc:1275] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.151401 10037 consensus_queue.cc:1048] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.151814  9495 raft_consensus.cc:1275] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.153672  9688 consensus_queue.cc:1048] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.171013 10179 raft_consensus.cc:1275] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.169302  9422 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.184353 10134 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:22.201004 10133 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.226708 10133 tablet_bootstrap.cc:492] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.234570 10133 ts_tablet_manager.cc:1403] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.003s
W20260709 13:05:22.230669  9391 consensus_peers.cc:597] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.231434 10218 consensus_queue.cc:1048] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.238013 10133 raft_consensus.cc:359] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.251497 10133 raft_consensus.cc:740] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.253428 10133 consensus_queue.cc:260] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.258036 10133 ts_tablet_manager.cc:1434] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:05:22.260623 10133 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.274537  9422 raft_consensus.cc:1275] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.277292 10224 consensus_queue.cc:1048] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.301275  9498 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:22.305737  9465 consensus_peers.cc:597] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.323390 10133 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.324311 10035 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.335525 10133 tablet_bootstrap.cc:492] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.336467 10133 ts_tablet_manager.cc:1403] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.000s
I20260709 13:05:22.339630 10133 raft_consensus.cc:359] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.340462 10133 raft_consensus.cc:740] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.341269 10133 consensus_queue.cc:260] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.343772 10133 ts_tablet_manager.cc:1434] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:22.351202 10133 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.359864 10177 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.378176 10133 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.379735 10133 tablet_bootstrap.cc:492] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.382481 10133 ts_tablet_manager.cc:1403] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:05:22.388000 10133 raft_consensus.cc:359] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.388828 10133 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.390116 10133 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.392983 10133 ts_tablet_manager.cc:1434] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:05:22.394199 10133 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.381137 10177 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.399497 10267 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.435063 10133 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.436124 10133 tablet_bootstrap.cc:492] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.437337 10133 ts_tablet_manager.cc:1403] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.043s	user 0.032s	sys 0.004s
I20260709 13:05:22.440168 10133 raft_consensus.cc:359] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.440902 10133 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.446275 10133 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.451345 10133 ts_tablet_manager.cc:1434] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:22.452315 10133 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.470165 10133 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.471515 10133 tablet_bootstrap.cc:492] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.472222 10133 ts_tablet_manager.cc:1403] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:05:22.474118 10133 raft_consensus.cc:359] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.474678 10133 raft_consensus.cc:740] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.475210 10133 consensus_queue.cc:260] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.476918 10133 ts_tablet_manager.cc:1434] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:22.477815 10133 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.493182 10133 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.494239 10133 tablet_bootstrap.cc:492] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.494939 10133 ts_tablet_manager.cc:1403] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:05:22.497493 10133 raft_consensus.cc:359] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.498238 10133 raft_consensus.cc:740] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.498905 10133 consensus_queue.cc:260] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.501091 10133 ts_tablet_manager.cc:1434] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:22.502832 10133 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
W20260709 13:05:22.512871  9391 consensus_peers.cc:597] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:22.517585  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:22.520988 10133 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.523089 10133 tablet_bootstrap.cc:492] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.523823 10133 ts_tablet_manager.cc:1403] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:05:22.526942 10133 raft_consensus.cc:359] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.527463 10133 raft_consensus.cc:740] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.528162 10133 consensus_queue.cc:260] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.529942 10133 ts_tablet_manager.cc:1434] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:22.531126 10133 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
W20260709 13:05:22.538245  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:22.566284  9391 consensus_peers.cc:597] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:22.571638 10133 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.572559 10133 tablet_bootstrap.cc:492] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.573117 10133 ts_tablet_manager.cc:1403] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 13:05:22.575016 10133 raft_consensus.cc:359] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.575515 10133 raft_consensus.cc:740] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.576272 10133 consensus_queue.cc:260] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.577960 10133 ts_tablet_manager.cc:1434] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:22.583020 10133 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.601830 10133 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.602829 10133 tablet_bootstrap.cc:492] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.603585 10133 ts_tablet_manager.cc:1403] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:05:22.606173 10133 raft_consensus.cc:359] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.606894 10133 raft_consensus.cc:740] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.607724 10133 consensus_queue.cc:260] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.609970 10133 ts_tablet_manager.cc:1434] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:22.611040 10133 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.626142 10133 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.627326 10133 tablet_bootstrap.cc:492] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.628084 10133 ts_tablet_manager.cc:1403] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:05:22.631152 10133 raft_consensus.cc:359] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.631739 10133 raft_consensus.cc:740] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.632485 10133 consensus_queue.cc:260] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.634155 10133 ts_tablet_manager.cc:1434] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:05:22.635285 10133 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.649176 10133 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.649960 10133 tablet_bootstrap.cc:492] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.650517 10133 ts_tablet_manager.cc:1403] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:05:22.652385 10133 raft_consensus.cc:359] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.652895 10133 raft_consensus.cc:740] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.653430 10133 consensus_queue.cc:260] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.655786 10133 ts_tablet_manager.cc:1434] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:22.657388 10133 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.675673 10177 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.679899 10133 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.681104 10133 tablet_bootstrap.cc:492] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.681798 10133 ts_tablet_manager.cc:1403] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:05:22.684104 10133 raft_consensus.cc:359] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.684731 10133 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.685365 10133 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.687218 10133 ts_tablet_manager.cc:1434] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:22.703207 10133 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.731850 10133 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.732820 10133 tablet_bootstrap.cc:492] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.733474 10133 ts_tablet_manager.cc:1403] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:05:22.735316 10133 raft_consensus.cc:359] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.735858 10133 raft_consensus.cc:740] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.736486 10133 consensus_queue.cc:260] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.738608 10133 ts_tablet_manager.cc:1434] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:05:22.739413 10133 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.748370 10177 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.803148 10133 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.804116 10133 tablet_bootstrap.cc:492] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.804780 10133 ts_tablet_manager.cc:1403] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.066s	user 0.040s	sys 0.020s
I20260709 13:05:22.807138 10133 raft_consensus.cc:359] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.808276 10133 raft_consensus.cc:740] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.808900 10133 consensus_queue.cc:260] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.810906 10133 ts_tablet_manager.cc:1434] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:22.811651 10133 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.830564 10133 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.831377 10133 tablet_bootstrap.cc:492] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.831944 10133 ts_tablet_manager.cc:1403] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:05:22.833856 10133 raft_consensus.cc:359] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.834383 10133 raft_consensus.cc:740] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.834995 10133 consensus_queue.cc:260] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.836544 10133 ts_tablet_manager.cc:1434] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:22.837527 10133 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.869427 10133 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.870664 10133 tablet_bootstrap.cc:492] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.871415 10133 ts_tablet_manager.cc:1403] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.008s
I20260709 13:05:22.874626 10133 raft_consensus.cc:359] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.875474 10133 raft_consensus.cc:740] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.876294 10133 consensus_queue.cc:260] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:22.878827 10133 ts_tablet_manager.cc:1434] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:22.879638 10133 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.901288 10133 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.902273 10133 tablet_bootstrap.cc:492] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.903026 10133 ts_tablet_manager.cc:1403] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:05:22.906443 10133 raft_consensus.cc:359] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.907222 10133 raft_consensus.cc:740] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.908007 10133 consensus_queue.cc:260] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.910000 10133 ts_tablet_manager.cc:1434] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:05:22.911172 10133 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.924575 10133 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.925590 10133 tablet_bootstrap.cc:492] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.926316 10133 ts_tablet_manager.cc:1403] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:05:22.928692 10133 raft_consensus.cc:359] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.929422 10133 raft_consensus.cc:740] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.930130 10133 consensus_queue.cc:260] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:22.932319 10133 ts_tablet_manager.cc:1434] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:22.933145 10133 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Bootstrap starting.
I20260709 13:05:22.945330 10133 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:22.946049 10133 tablet_bootstrap.cc:492] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Bootstrap complete.
I20260709 13:05:22.946563 10133 ts_tablet_manager.cc:1403] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:05:22.948837 10133 raft_consensus.cc:359] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.949509 10133 raft_consensus.cc:740] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Initialized, Role: FOLLOWER
I20260709 13:05:22.950147 10133 consensus_queue.cc:260] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:22.952178 10133 ts_tablet_manager.cc:1434] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:05:23.275589 10179 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.356048   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:31.412246  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2598613081aa46f793a217ccf880c19e"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:31.413160  9424 raft_consensus.cc:606] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:31.415832  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:31.416343  9424 raft_consensus.cc:606] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:31.418583  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:31.419026  9424 raft_consensus.cc:606] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:31.433917  9575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "930e01c56898417191283e02b2ae37c9"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:31.434434  9575 raft_consensus.cc:606] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:31.446686  9495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30"
dest_uuid: "2319bdfca4124710b4064192c524a068"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:05:31.447350  9495 raft_consensus.cc:606] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:31.450074  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:31.450532  9424 raft_consensus.cc:606] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:31.451571   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:31.452972   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:31.454859 10304 raft_consensus.cc:993] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:31.455488 10318 raft_consensus.cc:1081] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:31.456588 10318 raft_consensus.cc:993] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:31.457024 10304 raft_consensus.cc:1081] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:31.457149  9495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:57092
I20260709 13:05:31.457768  9495 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.458094  9495 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.458732  9501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:57092
I20260709 13:05:31.459254  9501 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.459530  9501 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.465840  9495 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.467237  9501 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.468519  9495 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:31.469290  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:31.470419  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:31.469537  9501 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:31.469974  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:31.471025  9427 raft_consensus.cc:3055] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.471427  9427 raft_consensus.cc:740] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:31.470986  9424 raft_consensus.cc:3055] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.470733  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:31.471514  9575 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.472316  9567 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.472450  9427 consensus_queue.cc:260] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.473989  9427 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.476173  9424 raft_consensus.cc:740] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:31.477120  9424 consensus_queue.cc:260] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.478993  9424 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.479563  9575 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:31.481730  9464 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:31.482074  9567 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:31.482642 10301 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.482076  9427 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:31.483147 10301 raft_consensus.cc:697] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:31.483325  9464 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:31.484151 10301 consensus_queue.cc:237] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.485203 10319 raft_consensus.cc:2804] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.486500 10319 raft_consensus.cc:697] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:31.487552 10319 consensus_queue.cc:237] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.497225  9249 catalog_manager.cc:5697] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.498499  9424 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:31.521121  9249 catalog_manager.cc:5697] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.674185 10304 raft_consensus.cc:993] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:31.674886 10318 raft_consensus.cc:1081] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:31.676708 10177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:05:31.677263 10177 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.677667 10177 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.686105 10177 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.691150 10316 raft_consensus.cc:993] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:31.691740 10316 raft_consensus.cc:1081] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Signalling peer 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:31.696445  9424 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "930e01c56898417191283e02b2ae37c9"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:33744
I20260709 13:05:31.697269  9424 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.697796  9424 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.698163 10177 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:31.704752  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:31.705345  9427 raft_consensus.cc:3055] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.705730  9427 raft_consensus.cc:740] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:31.706599  9427 consensus_queue.cc:260] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.708194  9427 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.715669  9427 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:31.720808 10128 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:31.721987  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:31.722896  9495 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.723248 10336 raft_consensus.cc:2804] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.724728 10336 raft_consensus.cc:697] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:31.726047 10336 consensus_queue.cc:237] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.711678  9424 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.731967  9495 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:31.732592  9424 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:31.733755  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:31.734320  9501 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.737246  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:31.737843  9567 raft_consensus.cc:3055] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.738113  9567 raft_consensus.cc:740] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:31.738890  9567 consensus_queue.cc:260] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.751775  9567 raft_consensus.cc:3060] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.753679  9501 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:31.760746  9567 raft_consensus.cc:2468] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:31.761086  9392 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:31.762317 10335 raft_consensus.cc:2804] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.761749  9249 catalog_manager.cc:5697] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.762814 10335 raft_consensus.cc:697] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:31.764123 10335 consensus_queue.cc:237] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:31.774443  9249 catalog_manager.cc:5697] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.817663 10304 raft_consensus.cc:993] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:31.818142 10304 raft_consensus.cc:1081] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:31.819751 10178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2598613081aa46f793a217ccf880c19e"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:05:31.820304 10178 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:31.820647 10178 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.827848 10178 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.830241 10178 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:31.830817  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:31.831439  9424 raft_consensus.cc:3055] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.831772  9424 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:31.832754  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:31.832623  9424 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.833308  9495 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.833935  9424 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.840215  9495 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:31.840538  9424 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:31.841614 10128 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:31.842439 10336 raft_consensus.cc:2804] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.842926 10336 raft_consensus.cc:697] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:31.843873 10336 consensus_queue.cc:237] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:31.854745  9249 catalog_manager.cc:5697] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.896608  9567 raft_consensus.cc:1275] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.897804 10319 consensus_queue.cc:1048] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.908449  9427 raft_consensus.cc:1275] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.909861 10319 consensus_queue.cc:1048] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.027194 10301 raft_consensus.cc:993] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.027673 10319 raft_consensus.cc:1081] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.029072 10177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:05:32.029482 10177 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.029702 10177 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.036381 10177 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.037019  9427 raft_consensus.cc:1275] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.037854 10177 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:32.038636 10319 consensus_queue.cc:1048] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:32.039108  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:32.039103  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:32.039769  9495 raft_consensus.cc:3055] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:32.040256  9427 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.040518  9495 raft_consensus.cc:740] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:32.041355  9495 consensus_queue.cc:260] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.042620  9495 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.045958  9427 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:32.047065 10128 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:32.047878 10336 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:32.048410 10336 raft_consensus.cc:697] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:32.049225 10336 consensus_queue.cc:237] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.049953  9495 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:32.061115  9250 catalog_manager.cc:5697] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 3, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.074702  9567 raft_consensus.cc:1275] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.076581 10348 consensus_queue.cc:1048] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:32.139295  9495 raft_consensus.cc:1275] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.140851 10336 consensus_queue.cc:1048] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.161621  9427 raft_consensus.cc:1275] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.164709 10336 consensus_queue.cc:1048] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.230350  9495 raft_consensus.cc:1275] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.231586 10304 consensus_queue.cc:1048] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.240640  9575 raft_consensus.cc:1275] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.241776 10304 consensus_queue.cc:1048] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.405186  9501 raft_consensus.cc:1275] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.406569 10336 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.409552  9427 raft_consensus.cc:1275] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.411604 10336 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:32.454016   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:32.498504   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:32.534312  9501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820"
dest_uuid: "2319bdfca4124710b4064192c524a068"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:05:32.534893  9501 raft_consensus.cc:606] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:32.537453  9501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47b32e90e45f4c73a82822a137702764"
dest_uuid: "2319bdfca4124710b4064192c524a068"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:05:32.537912  9501 raft_consensus.cc:606] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:32.540324  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9832319718e143058c54278ed4f330ae"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:32.540962  9424 raft_consensus.cc:606] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:32.543815  9424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:32.544319  9424 raft_consensus.cc:606] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:32.546639  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf68916785184cb081d3032e1da7db46"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:32.547049  9567 raft_consensus.cc:606] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:32.548267   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:32.549546   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:32.554523 10319 raft_consensus.cc:993] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.555040 10301 raft_consensus.cc:1081] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.556306 10177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:05:32.556767 10177 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.557083 10177 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.562728 10177 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:32.564443 10177 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:32.565253  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:32.569299  9501 raft_consensus.cc:3055] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.569631  9501 raft_consensus.cc:740] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:32.570732  9501 consensus_queue.cc:260] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:32.572371  9501 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.581404  9501 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.583426 10129 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:32.584615 10357 raft_consensus.cc:2804] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.585096 10357 raft_consensus.cc:697] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:32.585525 10335 raft_consensus.cc:993] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:32.586042 10318 raft_consensus.cc:1081] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:32.585944 10357 consensus_queue.cc:237] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:32.587734  9501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:57092
I20260709 13:05:32.588271  9501 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.589023  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:32.588645  9501 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.589608  9567 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.596427  9567 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.597640  9501 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:32.597932  9249 catalog_manager.cc:5697] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.599843  9501 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:32.600200  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:32.600380  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:32.600868  9424 raft_consensus.cc:3055] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.600934  9567 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.601351  9424 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:32.604059  9424 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:32.605679  9424 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.610006  9567 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:32.611550  9464 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:32.612546  9424 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:32.612996 10301 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.614509 10301 raft_consensus.cc:697] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:32.615996 10348 raft_consensus.cc:993] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.616606 10319 raft_consensus.cc:1081] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.619509 10179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47b32e90e45f4c73a82822a137702764"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44260
I20260709 13:05:32.619596 10301 consensus_queue.cc:237] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:32.620182 10179 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.620700 10179 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.628723  9501 raft_consensus.cc:1275] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:32.632243 10357 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.635845 10318 raft_consensus.cc:993] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.636575 10318 raft_consensus.cc:1081] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.639622 10177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9832319718e143058c54278ed4f330ae"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:05:32.640163 10177 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.640501 10177 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.647210 10177 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.649085 10179 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.650918 10179 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:32.652405 10177 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:32.658838  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:32.659045  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:32.659571  9425 raft_consensus.cc:3055] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.659675  9422 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.660073  9425 raft_consensus.cc:740] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:32.661041  9425 consensus_queue.cc:260] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.662678  9425 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.662911  9427 raft_consensus.cc:1275] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:32.673491  9425 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.678179 10316 raft_consensus.cc:993] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.688436 10316 raft_consensus.cc:1081] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:32.679382  9250 catalog_manager.cc:5697] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.680501  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:32.689575  9495 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.696918 10128 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:32.697968 10357 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.699317 10357 raft_consensus.cc:2804] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.699721 10357 raft_consensus.cc:697] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:32.681182  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:32.702579  9422 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.703061  9501 raft_consensus.cc:3055] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:32.703387  9501 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:32.704288  9501 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.705430  9501 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:32.703408 10178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf68916785184cb081d3032e1da7db46"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:05:32.705983 10178 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:32.706333 10178 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.709044 10357 consensus_queue.cc:237] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.711373  9501 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.712486 10129 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:32.713404 10337 raft_consensus.cc:2804] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:32.713872 10337 raft_consensus.cc:697] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:32.714774 10337 consensus_queue.cc:237] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:32.720350  9495 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:32.723121 10178 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:32.726526  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:32.733471  9567 raft_consensus.cc:3055] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:32.733865  9567 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:32.734650  9567 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:32.735576  9567 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.742736 10178 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:32.744123  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:32.745136  9422 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.748615  9249 catalog_manager.cc:5697] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.750308  9249 catalog_manager.cc:5697] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.752220  9422 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:32.754050 10128 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:32.754096  9567 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:32.755038 10337 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:32.755529 10337 raft_consensus.cc:697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:32.756410 10337 consensus_queue.cc:237] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:32.768937  9249 catalog_manager.cc:5697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 3, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.025635  9495 raft_consensus.cc:1275] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.026984 10337 consensus_queue.cc:1048] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:33.035842  9567 raft_consensus.cc:1275] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.037310 10357 consensus_queue.cc:1048] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.064702  9427 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.066048 10301 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.078361  9567 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.079871 10301 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.132098  9427 raft_consensus.cc:1275] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.134025 10337 consensus_queue.cc:1048] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:33.155385  9422 raft_consensus.cc:1275] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.157389 10336 consensus_queue.cc:1048] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.175110  9501 raft_consensus.cc:1275] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.181286 10337 consensus_queue.cc:1048] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.199527  9424 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:33.201505 10377 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.230965  9501 raft_consensus.cc:1275] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.242179 10336 consensus_queue.cc:1048] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.250628  9575 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:33.256542 10336 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.550480   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.591445   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.636094  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1786e708043842a3884b58092b23b91b"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:33.636559  9567 raft_consensus.cc:606] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:33.638741  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:33.639292  9567 raft_consensus.cc:606] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:33.641940  9501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20"
dest_uuid: "2319bdfca4124710b4064192c524a068"
mode: GRACEFUL
new_leader_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:05:33.642498  9501 raft_consensus.cc:606] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Received request to transfer leadership to TS 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:33.644904  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3e8e061f8c943a98676c36322363053"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:33.645357  9567 raft_consensus.cc:606] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:33.647672  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:33.648190  9567 raft_consensus.cc:606] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:33.649291   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:33.650823   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.790923 10322 raft_consensus.cc:993] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.791531 10382 raft_consensus.cc:1081] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.793442 10177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1786e708043842a3884b58092b23b91b"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:05:33.794088 10177 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.794435 10177 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.800637 10177 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.802062 10177 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:33.802990  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:33.803150  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:33.803715  9495 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.803735  9567 raft_consensus.cc:3055] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.804309  9567 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:33.805140  9567 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.806278  9567 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.810840  9495 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:33.812083 10129 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:33.812826 10357 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.813186  9567 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:33.813268 10357 raft_consensus.cc:697] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:33.814932 10357 consensus_queue.cc:237] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.825564  9248 catalog_manager.cc:5697] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 3, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.831383 10322 raft_consensus.cc:993] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.832273 10322 raft_consensus.cc:1081] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.834355 10183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:05:33.835139 10183 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.835597 10183 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.843744 10183 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:33.846845  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:33.846946  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:33.847522  9567 raft_consensus.cc:3055] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.847646  9427 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.846422 10183 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:33.848096  9567 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:33.849090  9567 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:33.850375  9567 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.850826 10388 raft_consensus.cc:993] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.852617 10322 raft_consensus.cc:1081] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:33.857206 10183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3e8e061f8c943a98676c36322363053"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44248
I20260709 13:05:33.857499  9427 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:33.857882 10183 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.858361 10183 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.858827 10128 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:33.859802 10357 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.860318 10357 raft_consensus.cc:697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:33.861110 10357 consensus_queue.cc:237] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:33.866433 10183 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.868789 10183 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:33.870652  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:33.871299  9575 raft_consensus.cc:3055] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.871723  9575 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:33.871479  9567 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:33.872943  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:33.872722  9575 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.873598  9501 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.875089  9575 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.880700  9501 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:33.882124 10129 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:33.882894  9575 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:33.883067 10357 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.884743 10357 raft_consensus.cc:697] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:33.886200 10357 consensus_queue.cc:237] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:33.888751  9248 catalog_manager.cc:5697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 3, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.907779  9248 catalog_manager.cc:5697] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.026582 10319 raft_consensus.cc:993] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: : Instructing follower 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:34.027072 10319 raft_consensus.cc:1081] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Signalling peer 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:34.029213  9427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:47398
I20260709 13:05:34.029946  9427 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.030417  9427 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.036695  9427 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:34.038328  9427 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:34.039109  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:34.039170  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:34.040165  9575 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.040223  9501 raft_consensus.cc:3055] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.041355  9501 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:34.042165  9501 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:34.043150  9501 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.045317  9575 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:34.046469  9390 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:34.047123 10304 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.047566 10304 raft_consensus.cc:697] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:34.048197  9501 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:34.048291 10304 consensus_queue.cc:237] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:34.058022  9248 catalog_manager.cc:5697] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 2 to 3, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.387185  9567 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.389616 10357 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:34.456951  9569 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.545742  9569 raft_consensus.cc:1275] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.556102 10336 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:34.653254 10377 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.116922 10377 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.117719 10377 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.121517 10377 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.166730 10377 raft_consensus.cc:493] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.167584 10377 raft_consensus.cc:515] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.170567 10377 leader_election.cc:290] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.249553 10377 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.250223 10377 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.253283 10377 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.274156 10377 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.275002 10377 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.392449 10394 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.393388 10395 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.394060 10395 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.396859 10395 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.605685 10395 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.606539 10395 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.609318 10395 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.393232 10394 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.648351 10394 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.649178 10394 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.649852 10394 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.652348 10394 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.653965 10394 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.675948 10394 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.523483 10396 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.809190 10396 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.542635 10377 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.812613 10377 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.813374 10377 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.816108 10377 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.817417 10377 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.816687 10396 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.752190 10395 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.818583 10395 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.821331 10395 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.826905 10394 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.849351 10377 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.851667 10377 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.852293 10377 raft_consensus.cc:493] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.853003 10377 raft_consensus.cc:515] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.854756 10398 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.855705 10377 leader_election.cc:290] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.855486 10398 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.856647 10377 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.857164 10377 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.858047 10398 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:35.858260  9538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.030s	sys 0.042s
W20260709 13:05:35.858709  9538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.031s	sys 0.043s
I20260709 13:05:35.859032 10396 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.859330 10377 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.859884 10377 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.859591 10396 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.860354 10377 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.861066 10393 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.861752 10396 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.861666 10393 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.862408 10377 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.864848 10396 raft_consensus.cc:493] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.865573 10396 raft_consensus.cc:515] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.866581 10397 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.867117 10397 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.867825 10396 leader_election.cc:290] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.868420 10396 raft_consensus.cc:493] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.868868 10396 raft_consensus.cc:515] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.869300 10397 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.869853 10397 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.870280 10397 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.870884 10396 leader_election.cc:290] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.871824 10377 raft_consensus.cc:493] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.872694 10377 raft_consensus.cc:515] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:35.875280 10392 log.cc:927] Time spent T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:05:35.876132 10377 leader_election.cc:290] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.876724 10377 raft_consensus.cc:493] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.877249 10396 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.877414 10377 raft_consensus.cc:515] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.877837 10396 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.879467 10377 leader_election.cc:290] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.876667 10398 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.879853 10396 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.875373 10397 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.880162 10398 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.852994 10399 raft_consensus.cc:493] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.890534 10399 raft_consensus.cc:515] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.891860 10398 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.892721 10399 leader_election.cc:290] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.905001 10402 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:35.910228 10405 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.910559 10393 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.912475 10393 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:35.913105 10393 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.915761 10393 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.908054 10403 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.910976 10405 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.921566  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.922102 10405 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:35.909968 10402 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.911779 10401 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.923142  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.923262 10401 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.924114 10403 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.925030 10402 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.925607 10401 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.923182 10400 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.926743 10400 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.927557  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.928264  9497 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.928913 10400 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:35.929198  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.930481 10403 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.923835  9496 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.929495 10393 raft_consensus.cc:493] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.933106 10393 raft_consensus.cc:515] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.933527 10129 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:35.934566 10399 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:35.934631  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.935043 10399 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.968560 10399 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.970216 10406 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.971165 10406 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.974149 10406 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.974977 10399 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.933646  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.977174  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.935902 10129 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:35.978101 10399 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.978755 10399 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:35.979100 10399 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.931618 10400 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.979467 10399 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.940049 10401 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.940687 10403 raft_consensus.cc:493] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.980332 10401 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.980548 10403 raft_consensus.cc:515] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.981985  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.982491 10401 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.941453 10402 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:35.941784 10398 raft_consensus.cc:493] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.983110 10401 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:35.982709 10403 leader_election.cc:290] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.983345 10398 raft_consensus.cc:515] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.979739 10400 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.942754 10405 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.984863 10405 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:35.983611 10401 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.957592 10397 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.986609 10397 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.986980 10405 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:35.987713 10401 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.977910  9497 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.985931 10398 leader_election.cc:290] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.942044 10404 raft_consensus.cc:493] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:35.988806 10397 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.988585 10404 raft_consensus.cc:515] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:35.983248 10402 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:35.990886 10404 leader_election.cc:290] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:35.992182  9496 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.992313 10402 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.993219  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.995321  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.982795 10408 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:35.985996 10400 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:35.995831  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.996431 10400 raft_consensus.cc:493] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:35.997107  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.996961 10400 raft_consensus.cc:515] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:35.998289  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.998907  9496 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.999192 10400 leader_election.cc:290] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:35.999763  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.000466 10408 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.001278  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:35.994313  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.002583  9497 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.003582  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.005173 10408 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.005832  9497 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.006513 10129 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.007462 10398 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.007517  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.007926 10398 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.008263  9497 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.935544 10393 leader_election.cc:290] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.008335 10398 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.009698  9497 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.011420  9497 raft_consensus.cc:1275] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.016842 10129 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.017918 10397 raft_consensus.cc:2804] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.017746 10399 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.018342 10397 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.018754 10397 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.001991  9496 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.029142 10396 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.030026 10396 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.032246 10394 raft_consensus.cc:493] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.033004 10394 raft_consensus.cc:515] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.034510 10395 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.035045 10395 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.080078 10396 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.081418 10394 leader_election.cc:290] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.109180 10396 raft_consensus.cc:493] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.110051 10396 raft_consensus.cc:515] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.119992 10396 leader_election.cc:290] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.127308 10377 raft_consensus.cc:493] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.129117 10396 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.129149 10377 raft_consensus.cc:515] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.129663 10396 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.131495 10377 leader_election.cc:290] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.192703  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.194962  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:36.195751  9495 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.198191 10395 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.206481 10397 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.210824 10399 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.228912  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:36.229951  9497 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.237954 10398 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.131510 10396 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.265719  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.279721  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.280937  9496 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:35.983414  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.306449  9495 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
W20260709 13:05:36.308782 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 116578us
I20260709 13:05:36.310882 10129 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.321341  9500 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:36.324955 10397 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.325223 10398 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.332388  9497 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:36.348242 10408 raft_consensus.cc:493] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.350728 10393 raft_consensus.cc:493] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.353574 10393 raft_consensus.cc:515] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.357793 10393 leader_election.cc:290] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.358350 10408 raft_consensus.cc:515] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.360703 10406 raft_consensus.cc:493] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.358757 10393 raft_consensus.cc:493] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.362581 10393 raft_consensus.cc:515] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.361581 10406 raft_consensus.cc:515] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.365279 10393 leader_election.cc:290] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.365999 10393 raft_consensus.cc:493] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.366607 10393 raft_consensus.cc:515] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.370615 10418 raft_consensus.cc:493] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.371210 10418 raft_consensus.cc:515] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.371511 10406 leader_election.cc:290] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.372324 10406 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.372927 10406 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.373478 10418 leader_election.cc:290] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.374233 10419 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.369730 10412 raft_consensus.cc:493] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.375031 10419 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.375911 10412 raft_consensus.cc:515] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.377887 10419 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.378506 10419 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.379943 10419 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.380738 10404 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.381306 10404 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.382956 10419 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:36.384724  9567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.938s	user 0.026s	sys 0.052s
W20260709 13:05:36.385242  9567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.939s	user 0.027s	sys 0.053s
I20260709 13:05:36.389348 10410 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.390044 10410 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.393337 10401 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.385798 10404 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.398036 10406 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.403569 10412 leader_election.cc:290] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.393992 10401 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.410110 10408 leader_election.cc:290] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.412446 10393 leader_election.cc:290] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.394665  9567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60370 (request call id 14) took 1944 ms. Trace:
I20260709 13:05:36.414983  9567 rpcz_store.cc:276] 0709 13:05:34.444556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.444708 (+   152us) service_pool.cc:224] Handling call
0709 13:05:34.445123 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.445520 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.445554 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.446197 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.388590 (+1942393us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.388650 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.388753 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.388810 (+    57us) raft_consensus.cc:1685] finished
0709 13:05:36.388828 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.388984 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4839,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":1941907,"threads_started":1,"wal-append.queue_time_us":1351583}
I20260709 13:05:36.418344 10401 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.426654  9575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60370 (request call id 11) took 2247 ms. Trace:
I20260709 13:05:36.431028  9575 rpcz_store.cc:276] 0709 13:05:34.178911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.425275 (+2246364us) service_pool.cc:224] Handling call
0709 13:05:36.425727 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.426170 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.426218 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.426278 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.426324 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.426402 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.426573 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:36.442538 10419 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.443190 10419 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.458081 10424 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.459089 10424 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.459692 10419 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.470971  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.467751  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.458288 10423 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.460505 10415 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.484545 10420 raft_consensus.cc:493] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.487598  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.488236 10420 raft_consensus.cc:515] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.497015 10410 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.497017 10416 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.499471 10416 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.501652 10416 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.490398 10415 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.504451 10415 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.506102 10424 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.489666 10423 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.508834 10423 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.509498 10420 leader_election.cc:290] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.539680  9420 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
W20260709 13:05:36.540903  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 140179us
I20260709 13:05:36.544319  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.545971  9420 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:36.548553  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.550743  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.489251  9426 raft_consensus.cc:2468] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:36.551941  9424 raft_consensus.cc:2468] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:36.565207 10426 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.566535 10422 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.566708 10426 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.567778 10422 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.570297 10426 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.570705 10420 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.571027 10426 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.571653 10420 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.571846 10426 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.574905 10420 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.575659 10409 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.575888 10426 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.576717 10409 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.575529 10424 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.577783  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.574321 10416 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.578706 10424 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.579344 10416 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.580818  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.570313 10422 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.582305  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.582484 10416 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.584007  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.584324  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.592808  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.594645 10408 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.595196 10408 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.595659 10408 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.602144 10411 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.607067 10423 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.612602 10423 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.603396 10411 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.615881  9539 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.617740 10393 raft_consensus.cc:2804] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.618198 10393 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.608507 10414 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.618615 10393 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.619423 10414 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.622763 10414 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:36.618566 10423 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.615450 10408 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.582337 10424 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.628934 10424 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.627624  9539 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.631428 10423 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:36.632604 10410 raft_consensus.cc:2804] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.632375 10423 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.633116 10410 raft_consensus.cc:493] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.633634 10410 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.635358 10423 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.630721 10424 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.630659 10408 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.639025 10424 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.642961  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.618709 10411 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.614586 10427 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.650442 10427 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.661188  9426 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.666591  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.670269  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.670750  9539 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.672823  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.673110  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.674202 10427 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.677107 10408 raft_consensus.cc:2804] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.677671 10408 raft_consensus.cc:493] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.678156 10408 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.679087  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.679801  9426 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.677201  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.681034 10402 raft_consensus.cc:493] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.681597  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.682174  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.682117 10402 raft_consensus.cc:515] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.682538  9421 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.682950  9424 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.681105  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.684470  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.686070  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.686731  9424 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.686733 10402 leader_election.cc:290] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.688230  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.690267  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.692452  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.692728  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.693184  9422 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.696910  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.698589 10408 raft_consensus.cc:515] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.701578  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.701565 10393 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.703636 10408 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.701742 10410 raft_consensus.cc:515] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.705009  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.705969  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.706193 10393 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.706672  9421 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.708778  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.709327 10410 leader_election.cc:290] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.706580  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.710527  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.711458  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.714910  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.714197  9422 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.716704  9421 raft_consensus.cc:2468] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:36.716763  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.717636  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.721712  9539 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.722164  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.723420 10410 raft_consensus.cc:2804] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.724293  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.725206  9419 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:36.726455  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.727193  9419 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 1.
I20260709 13:05:36.728380  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.729640  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.730603  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:36.731127  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.732570  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.732795 10410 raft_consensus.cc:697] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:36.734124 10410 consensus_queue.cc:237] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.736891  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.739571  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.715595  9426 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.743395  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.743830  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.744819  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.746013  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.748322  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.750501  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.752736  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.757030  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.758052  9492 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.760942 10395 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.766394  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.766719  9422 raft_consensus.cc:2468] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:36.768146  9539 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.768200 10414 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.769630 10393 raft_consensus.cc:2804] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:36.770186 10393 raft_consensus.cc:697] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:36.771129 10409 leader_election.cc:290] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.771378 10393 consensus_queue.cc:237] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.790130 10408 raft_consensus.cc:493] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.790988 10408 raft_consensus.cc:515] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:36.793908 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 483021us
I20260709 13:05:36.794200 10400 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.795832 10129 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
W20260709 13:05:36.803375  9465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.197s	sys 0.309s
I20260709 13:05:36.803232 10398 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:36.803897  9465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.197s	sys 0.309s
I20260709 13:05:36.803999 10398 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.804714 10398 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.810696 10129 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.812094 10397 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.812228 10129 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.812604 10397 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.813040 10397 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.795172 10400 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.824216  9499 raft_consensus.cc:1240] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:36.826505 10400 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.827572  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.829041 10408 leader_election.cc:290] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.825937 10397 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.831076 10395 raft_consensus.cc:2804] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.831570 10395 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.832123 10395 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.833542 10397 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:36.835502 10397 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.837085 10397 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.838358 10397 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.841828 10128 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:36.851262 10399 raft_consensus.cc:2804] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.837150 10398 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.853963 10398 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.857697 10397 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:36.865020 10397 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
W20260709 13:05:36.877151  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 45046.8us
I20260709 13:05:36.877868  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.878178  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.879061  9422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.879489  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.880136  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.881517  9419 raft_consensus.cc:1240] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:36.851801 10399 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.888883  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.896781  9426 raft_consensus.cc:2468] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:36.890723  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.890255 10399 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.902876 10400 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.912737 10417 raft_consensus.cc:493] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.913662 10417 raft_consensus.cc:515] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.916340 10412 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.911343  9423 raft_consensus.cc:1240] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:36.916972 10412 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.919379 10412 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.919445  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.920172 10410 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.920806 10410 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.922917 10410 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.925661  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.925800 10408 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.926679 10408 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.926960  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.927381  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.928682 10128 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.928759  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.928723  9492 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:36.930588 10400 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.931936 10417 leader_election.cc:290] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.933053 10400 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.936719 10412 raft_consensus.cc:493] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:36.938006 10412 raft_consensus.cc:515] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:36.938871  9248 catalog_manager.cc:5697] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 2 to 3, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.936894 10408 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.941761  9497 raft_consensus.cc:1240] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:36.950610  9539 leader_election.cc:304] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:36.951298 10399 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:36.947729  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.948123  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.965628  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.973269 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:36.974269  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:36.974453  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:36.975261  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.975752  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bf6d31f0484d90903e72e4e463f5a0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:36.948690  9418 raft_consensus.cc:1240] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:36.948509 10428 consensus_queue.cc:1059] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.978049 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:36.978440 10428 raft_consensus.cc:3055] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:36.978965  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.948889  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.952602 10128 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:36.982059 10399 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.953797 10398 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.945362  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.953974 10412 leader_election.cc:290] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:36.955515  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.956771  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.958981  9426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.965765  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.967170 10404 consensus_queue.cc:1059] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:36.992005 10404 raft_consensus.cc:3055] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:36.907069 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 94505.8us
I20260709 13:05:36.968152 10395 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:36.992398  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.971138 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:36.978266  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a09b02e9a184cb1bdbec1c0c7eb8ed7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:36.952231 10400 raft_consensus.cc:2804] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:36.989003  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.990043 10433 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:36.990463 10398 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:36.991405 10128 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:36.978909 10428 raft_consensus.cc:740] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:36.998308 10395 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:36.998760 10400 raft_consensus.cc:697] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:36.998890  9501 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:36.998795 10178 raft_consensus.cc:2393] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:36.999511 10398 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.999385  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:36.997238 10433 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:36.996963 10397 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:36.992420 10404 raft_consensus.cc:740] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.012022  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:37.012499 10428 consensus_queue.cc:260] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.013233 10404 consensus_queue.cc:260] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.014011 10428 raft_consensus.cc:3060] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.015024 10404 raft_consensus.cc:3060] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.000700  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:37.001029 10179 raft_consensus.cc:2393] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:37.009838 10433 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.001778 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.018347 10400 consensus_queue.cc:237] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.018983  9424 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:37.001715 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.020175 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:37.011014 10127 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:44225 timed out after 1.918s (SENT) [suppressed 92 similar messages]
I20260709 13:05:37.024569 10128 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:37.039069 10397 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.039650 10397 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.040112 10397 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.040211 10395 raft_consensus.cc:2804] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.040652 10395 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.041033 10395 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.021903  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:37.045815 10401 consensus_queue.cc:1059] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.046972 10402 raft_consensus.cc:3055] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.047482 10402 raft_consensus.cc:740] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.048641 10402 consensus_queue.cc:260] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.049294  9539 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:37.049901 10402 raft_consensus.cc:3060] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.050289 10431 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:37.050750 10431 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.051061 10431 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.052942 10398 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:37.057663 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.059180 10179 raft_consensus.cc:1240] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.064061 10128 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.009459 10399 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:05:37.075978 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.078073 10182 raft_consensus.cc:1240] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:37.078653  9467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.078917 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:37.037098 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 43799.1us
I20260709 13:05:37.093410 10179 raft_consensus.cc:1240] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:37.092545 10128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 52642.5us
I20260709 13:05:37.102753 10128 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.104789 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.106742 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.107277 10399 raft_consensus.cc:2804] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.107914 10399 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.108355  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.108445 10399 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.112303 10398 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:37.086450 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 75616.5us
I20260709 13:05:37.123831 10397 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.125258 10180 raft_consensus.cc:1240] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.128799 10397 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:37.131157 10437 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.131274  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.131665  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.131846 10437 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.090596 10395 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.135973  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.136221 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.136758  9573 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:37.136693 10433 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.138007 10177 raft_consensus.cc:1240] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.149441  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.151274 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.152096 10180 raft_consensus.cc:2468] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:37.154552  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.135320 10437 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.119666 10431 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:37.162869  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.165910  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.166712  9573 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:37.171329  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.171567 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.172583  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.172786  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.173307  9572 raft_consensus.cc:2468] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
I20260709 13:05:37.174335  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.174595  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.175079  9567 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 1.
W20260709 13:05:37.175760  9467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.176812  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.176981  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.181082  9575 raft_consensus.cc:2393] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 4: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:37.183297 10395 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:37.185704  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.185781 10431 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:37.185683 10433 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:37.186872  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.190828  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.199630 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.203302 10412 consensus_queue.cc:1059] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.205099 10412 raft_consensus.cc:3055] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.205521 10177 raft_consensus.cc:1240] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.205752 10412 raft_consensus.cc:740] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:37.206471 10399 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:37.207191  9466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.206748 10412 consensus_queue.cc:260] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.205287  9575 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.208014 10180 raft_consensus.cc:2393] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:37.208526 10412 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.209609 10182 raft_consensus.cc:1240] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.206588  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a689cd004db4bbebd7fc4c6c5aecada" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.211208 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.212157 10182 raft_consensus.cc:2393] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:37.221379 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.228600 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.231914  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.232967 10399 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:37.237849 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.237963 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.238924 10181 raft_consensus.cc:1240] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.240175 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.240379 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.241734 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.238867 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.205108  9540 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:37.248739 10431 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.249275 10431 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.249678 10431 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.251101 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.252612 10177 raft_consensus.cc:1240] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.252897 10179 raft_consensus.cc:1240] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.254354 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.255410 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.256141 10417 consensus_queue.cc:1059] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.257962 10417 raft_consensus.cc:3055] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.258561 10417 raft_consensus.cc:740] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:37.259466 10417 consensus_queue.cc:260] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.260916 10417 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.260535 10437 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.263345 10437 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:37.263150 10431 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.264319  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:37.266515 10431 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.259342  9540 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.269191 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.270148 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.271037 10431 raft_consensus.cc:2749] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.272447 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.278110 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.281561 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.284773  9540 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.285970 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.287609 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:37.291215 10408 raft_consensus.cc:2749] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:37.291436  9540 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.292789 10408 raft_consensus.cc:2749] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.295142 10182 raft_consensus.cc:1240] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.298487 10180 raft_consensus.cc:1240] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:37.299283 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 185589us
I20260709 13:05:37.300542 10180 raft_consensus.cc:1240] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.301460 10129 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.302318   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.302943 10398 raft_consensus.cc:2804] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.303615 10398 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.304178 10398 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.303108 10129 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.312911 10397 raft_consensus.cc:2804] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.313354 10397 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.313746 10397 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.315442 10129 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.317854 10445 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.318423 10445 raft_consensus.cc:697] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
W20260709 13:05:37.319008  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3ec0 after lost signal to thread 434
I20260709 13:05:37.319412 10445 consensus_queue.cc:237] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:37.320261  9596 debug-util.cc:398] Leaking SignalData structure 0x7b080013e520 after lost signal to thread 9284
W20260709 13:05:37.321920  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08000967a0 after lost signal to thread 9451
W20260709 13:05:37.323489  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08001354c0 after lost signal to thread 9525
W20260709 13:05:37.323808  9596 debug-util.cc:398] Leaking SignalData structure 0x7b080012d720 after lost signal to thread 9526
W20260709 13:05:37.324123  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6ca0 after lost signal to thread 9538
I20260709 13:05:37.293170  9540 leader_election.cc:304] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.324308 10129 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.325218 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:37.324441  9596 debug-util.cc:398] Leaking SignalData structure 0x7b080008d4a0 after lost signal to thread 9539
W20260709 13:05:37.326687  9596 debug-util.cc:398] Leaking SignalData structure 0x7b080009ae20 after lost signal to thread 9567
W20260709 13:05:37.327131  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef2c0 after lost signal to thread 9575
W20260709 13:05:37.327754  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1240 after lost signal to thread 9599
I20260709 13:05:37.328210  9540 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:37.328070 10417 raft_consensus.cc:2749] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:37.329070  9596 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd280 after lost signal to thread 10208
I20260709 13:05:37.329770 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:37.330911 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:37.337270  9465 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.338140 10404 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:37.331732 10397 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.339301  9465 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.341495 10404 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.343246  9391 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.346132 10414 raft_consensus.cc:2749] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.346437 10412 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:37.346881 10412 raft_consensus.cc:493] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:37.347362 10412 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.348419 10434 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.348865 10434 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:37.349218 10434 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.346978  9465 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.352669 10402 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.353636  9465 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.354506 10402 raft_consensus.cc:2749] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.356446  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.357167  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.357862  9569 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
W20260709 13:05:37.359064  9539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.358896  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.360416  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.361891  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.361792 10409 consensus_queue.cc:1059] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.362695  9575 raft_consensus.cc:2393] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 3: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:37.363270 10413 raft_consensus.cc:3055] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.363698 10413 raft_consensus.cc:740] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:37.365417 10129 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.365688 10413 consensus_queue.cc:260] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.366746 10399 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.367347 10399 raft_consensus.cc:697] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:37.368160 10404 raft_consensus.cc:2749] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.384905 10428 consensus_queue.cc:1059] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:37.368325 10399 consensus_queue.cc:237] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.369011 10402 consensus_queue.cc:1059] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:05:37.363638  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.369465  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.330631 10398 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.393008  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.369935 10397 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:37.396766  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.398085  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.370249 10181 raft_consensus.cc:1240] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.394212  9391 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.403513  9248 catalog_manager.cc:5697] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.407639  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.399155 10398 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:37.425550  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.395975 10428 raft_consensus.cc:3055] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.426692 10428 raft_consensus.cc:740] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.396162  9539 leader_election.cc:304] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.435423 10404 raft_consensus.cc:493] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.436124 10404 raft_consensus.cc:515] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.436896  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.437506  9574 raft_consensus.cc:1240] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.395258 10413 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.394846  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.363611 10412 raft_consensus.cc:515] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.427582 10428 consensus_queue.cc:260] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:37.446550  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 52385.3us
I20260709 13:05:37.424500  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.438393  9573 raft_consensus.cc:1240] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.430387  9248 catalog_manager.cc:5697] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.452447  9391 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.432783 10414 raft_consensus.cc:2749] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.438203  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.458294  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.438263 10404 leader_election.cc:290] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.464776  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.394450 10409 consensus_queue.cc:1059] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:05:37.466655  9467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.469753  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.470427  9575 raft_consensus.cc:2393] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 4: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:37.452924 10417 raft_consensus.cc:2749] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.394410 10407 consensus_queue.cc:1059] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:05:37.487558  9567 raft_consensus.cc:1240] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Rejecting Update request from peer eae0fc1c2353497a889fdda2eda53679 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:37.486807  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 90778.7us
I20260709 13:05:37.490769  9539 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.492340  9569 raft_consensus.cc:1240] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Rejecting Update request from peer eae0fc1c2353497a889fdda2eda53679 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:37.494107 10393 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.490798 10428 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.496150  9572 raft_consensus.cc:1240] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:37.496730  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 44388.1us
I20260709 13:05:37.497762  9391 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.468246 10414 raft_consensus.cc:2749] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.513367  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.516559  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.473101 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.496441 10404 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.531621  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.534004  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd83b93312541268dff3bd7a85eec65" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.534543  9573 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:37.533792  9391 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:37.535708  9391 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.514298 10434 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.544170  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.534365 10417 consensus_queue.cc:1059] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:05:37.549901  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.581298  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.582547  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3c57d630a44e97be12c1acca969da6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.559597 10452 raft_consensus.cc:493] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.560235 10412 leader_election.cc:290] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.592922 10458 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.594051 10458 consensus_queue.cc:1059] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.551764 10457 raft_consensus.cc:2749] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.583693  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.585187 10414 raft_consensus.cc:2804] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.604768 10129 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.605175  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e05a12bacf4f7fa5e42fa62b7c03c0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.605459  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:37.583634 10454 log.cc:927] Time spent T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.127s	user 0.000s	sys 0.004s
I20260709 13:05:37.623677  9498 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:37.551484 10404 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.606271  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.583456 10452 raft_consensus.cc:515] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.605243 10419 raft_consensus.cc:3055] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.613375 10434 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:37.571050 10453 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
W20260709 13:05:37.616534  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 103578us
I20260709 13:05:37.582867  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:37.629385  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 58203.2us
I20260709 13:05:37.618497 10414 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:37.631778 10419 raft_consensus.cc:740] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:37.634054  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.652868  9391 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.664423  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894e48d005e4cabb8a0482567ba71de" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.664966  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.666203  9391 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.634419 10414 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.638635 10437 raft_consensus.cc:2749] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.675565  9539 leader_election.cc:304] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.669023 10409 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.682257 10463 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:37.683146 10401 raft_consensus.cc:3055] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.683629 10401 raft_consensus.cc:740] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.684762  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.683159 10459 raft_consensus.cc:2749] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.683795  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191f9b27ce534ccba550f1ec90d42114" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.685312 10460 raft_consensus.cc:2749] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.687796  9391 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
W20260709 13:05:37.670708 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 83214.8us
I20260709 13:05:37.701730  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.702752 10129 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.702987  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f607d360325242ad9ca1ce2b690f164a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.690569  9539 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.685747  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.691691  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.692585 10401 consensus_queue.cc:260] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:37.696569 10205 debug-util.cc:398] Leaking SignalData structure 0x7b080030c120 after lost signal to thread 434
I20260709 13:05:37.697096  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "867c2d023234405b9cf88b5b0812f09b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.697504 10452 leader_election.cc:290] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.698745 10404 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.669253 10457 consensus_queue.cc:1059] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:37.662197 10453 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.689692  9391 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.704133 10129 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.705559 10393 raft_consensus.cc:3055] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.705890 10463 raft_consensus.cc:2749] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.709794  9390 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:37.710493  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f812886de1104bf391487c26fbadfd1f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.711153 10434 raft_consensus.cc:2749] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.680413 10419 consensus_queue.cc:260] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:37.712347  9464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 87067.9us
I20260709 13:05:37.722214  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.722530  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.723337  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.723577  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.724125  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:37.725033 10205 debug-util.cc:398] Leaking SignalData structure 0x7b080038be40 after lost signal to thread 9284
I20260709 13:05:37.725235  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
W20260709 13:05:37.726563 10205 debug-util.cc:398] Leaking SignalData structure 0x7b0800173240 after lost signal to thread 9451
I20260709 13:05:37.726482  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.727638 10127 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.721462 10393 raft_consensus.cc:740] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:37.721233  9574 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:37.716693  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.707875  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.597741   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.723591 10434 consensus_queue.cc:1059] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:05:37.724241  9467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.718283 10401 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.716305 10399 consensus_queue.cc:1059] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.724944  9571 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:37.729611  9539 leader_election.cc:304] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.719703  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.728284  9390 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:37.738125 10398 raft_consensus.cc:2749] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.732370 10453 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:37.732688 10399 raft_consensus.cc:3055] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.742170  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.730552  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.732282 10434 raft_consensus.cc:3055] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.744295 10399 raft_consensus.cc:740] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:37.744956 10434 raft_consensus.cc:740] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:37.745220  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.745546  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.745628 10399 consensus_queue.cc:260] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:37.729694 10431 raft_consensus.cc:2749] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.746484  9571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.746999 10399 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.728430  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.740998  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.730906 10460 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.748716 10460 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.749076 10460 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.749878  9569 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:37.745818 10434 consensus_queue.cc:260] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:37.741950 10412 raft_consensus.cc:2749] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:37.752226  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 62586.2us
I20260709 13:05:37.752625 10434 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.733481 10127 leader_election.cc:304] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.730070  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.754417 10127 leader_election.cc:304] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.754655 10398 raft_consensus.cc:2749] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.755343 10398 raft_consensus.cc:2749] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.756409  9571 raft_consensus.cc:1240] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Rejecting Update request from peer eae0fc1c2353497a889fdda2eda53679 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:37.732378  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.733266  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776de67e897f4c53aab91cb04628fd1b" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.760551 10463 raft_consensus.cc:2749] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.728950 10393 consensus_queue.cc:260] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:37.731427  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:37.728929 10437 raft_consensus.cc:2749] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.763046  9390 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
W20260709 13:05:37.763716 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 59734.9us
I20260709 13:05:37.764302  9390 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.789110 10179 raft_consensus.cc:1240] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.794104  9573 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
W20260709 13:05:37.811167  9466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.788188 10177 raft_consensus.cc:1240] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.767450  9390 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:37.789841 10178 raft_consensus.cc:1240] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:37.727989 10205 debug-util.cc:398] Leaking SignalData structure 0x7b0800285640 after lost signal to thread 9525
I20260709 13:05:37.724267 10457 raft_consensus.cc:3055] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.765259 10413 raft_consensus.cc:2749] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.765082 10463 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:37.788555 10175 raft_consensus.cc:1240] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.784343 10416 raft_consensus.cc:3055] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.775074  9568 raft_consensus.cc:1240] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Rejecting Update request from peer eae0fc1c2353497a889fdda2eda53679 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:37.785188 10455 raft_consensus.cc:3055] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.852231  9464 leader_election.cc:304] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.766079 10458 raft_consensus.cc:2749] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.850077 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.830173 10409 raft_consensus.cc:2749] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.777932  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:37.852959 10457 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:37.863675 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.875560 10177 raft_consensus.cc:1240] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.857458 10416 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:37.875948 10457 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.855001 10463 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.876745 10416 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.877311 10457 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.877818 10416 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.755951 10127 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.880793 10399 raft_consensus.cc:2749] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:37.881057 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 125259us
I20260709 13:05:37.882030 10127 leader_election.cc:304] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.884451 10399 raft_consensus.cc:2749] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.884754  9464 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.886642 10453 raft_consensus.cc:2764] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:37.889207 10404 consensus_queue.cc:1059] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.889495 10453 consensus_queue.cc:1059] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.890574 10453 raft_consensus.cc:3055] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.890493 10452 consensus_queue.cc:1059] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.890980 10453 raft_consensus.cc:740] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.891923 10464 raft_consensus.cc:3055] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.892318 10464 raft_consensus.cc:740] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.892853 10419 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.893114 10464 consensus_queue.cc:260] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.887728  9464 leader_election.cc:304] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
W20260709 13:05:37.868948  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 139423us
I20260709 13:05:37.836843 10414 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:37.884434 10401 raft_consensus.cc:2749] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.866142 10181 raft_consensus.cc:1240] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.872587 10409 raft_consensus.cc:2804] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:37.872939  9418 raft_consensus.cc:1240] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.764566 10129 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
W20260709 13:05:37.903256 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 138783us
I20260709 13:05:37.903978 10129 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.904130 10409 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:37.877333 10463 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.905520 10129 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.906513 10393 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.907430 10445 raft_consensus.cc:2749] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:37.873059 10205 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5dc0 after lost signal to thread 9599
I20260709 13:05:37.900527 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:37.904600 10409 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.910913 10397 raft_consensus.cc:2749] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.914260 10464 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:37.914958 10205 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8480 after lost signal to thread 10208
I20260709 13:05:37.908157 10445 raft_consensus.cc:2749] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.920253 10453 consensus_queue.cc:260] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.921911 10453 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.903997 10414 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:37.906792 10129 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.927750 10445 raft_consensus.cc:2749] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:37.928512 10130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.930374  9465 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.931288 10407 raft_consensus.cc:2749] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:37.933085 10129 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:37.931316  9249 catalog_manager.cc:5697] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.898932 10404 raft_consensus.cc:2749] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.883980 10127 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:37.866735 10455 raft_consensus.cc:740] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
W20260709 13:05:37.945309 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 61447.4us
I20260709 13:05:37.945607 10455 consensus_queue.cc:260] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:37.947585 10455 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.935150 10445 raft_consensus.cc:2749] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.945344 10437 raft_consensus.cc:2749] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:37.948796  9464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 46516.6us
I20260709 13:05:37.950644  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:37.890574 10460 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.952600  9421 raft_consensus.cc:1240] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:37.953680 10460 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:37.956553  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.953073  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:37.896982  9539 leader_election.cc:304] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.958329 10404 consensus_queue.cc:1059] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.959295 10404 raft_consensus.cc:3055] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.959626 10404 raft_consensus.cc:740] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.960306 10471 raft_consensus.cc:2749] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.960728 10404 consensus_queue.cc:260] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.961629 10409 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.962114 10404 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.972306  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.974642 10409 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:37.974900  9496 raft_consensus.cc:1275] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.976457  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d601528765d4c458eac4ca0aa48f348" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
W20260709 13:05:37.962412  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 65543.7us
I20260709 13:05:37.951133  9249 catalog_manager.cc:5697] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.977686  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.965219  9568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:37.979866  9568 raft_consensus.cc:606] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.980329  9539 leader_election.cc:304] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.969153  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:37.970126  9495 raft_consensus.cc:1275] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.972337  9567 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:37.970070  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.984633 10393 raft_consensus.cc:2749] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.969439  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5f2184d23f426b99f302ec643dbf6c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:37.986229  9539 leader_election.cc:304] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.987102 10393 raft_consensus.cc:2749] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:37.987715 10463 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:37.988842  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.989123  9419 raft_consensus.cc:1240] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.991837 10407 consensus_queue.cc:1059] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.992626 10463 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:37.992883 10407 raft_consensus.cc:3055] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.993044 10393 raft_consensus.cc:2749] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:37.993168  9498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:37.996412  9567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:37.993378 10407 raft_consensus.cc:740] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:37.997038  9567 raft_consensus.cc:606] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:37.995793  9539 leader_election.cc:304] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.002223  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22747041983e40adb9eafaae809e7651" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:37.998308 10407 consensus_queue.cc:260] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.003742  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930e01c56898417191283e02b2ae37c9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:38.004283  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 236707us
I20260709 13:05:38.005435  9390 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:38.009552  9390 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.013149  9498 raft_consensus.cc:1275] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.002882  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.014417  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25e2626c84a989dd00de807fb51c6" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.014614  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.015435  9572 raft_consensus.cc:2393] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 3: Already voted for candidate e3b7aa42b8924e21bbeb620671e29bd0 in this term.
I20260709 13:05:38.016446  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:38.017558 10409 raft_consensus.cc:2804] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.018007 10409 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:38.012431 10393 raft_consensus.cc:2749] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.018935  9420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:42550
I20260709 13:05:38.019120 10393 consensus_queue.cc:1059] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.019698  9420 raft_consensus.cc:606] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.020320 10459 raft_consensus.cc:3055] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.020727 10459 raft_consensus.cc:740] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.021606 10459 consensus_queue.cc:260] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.018232  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae838928be04675a8741bd898683d34" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.018409 10409 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.022017 10127 leader_election.cc:304] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.024454 10127 leader_election.cc:304] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.025262 10399 raft_consensus.cc:2749] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.025952 10399 raft_consensus.cc:2749] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.026019 10127 leader_election.cc:304] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.029315 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:38.018991  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:38.029301 10127 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.032394 10461 consensus_queue.cc:1059] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.032599 10399 raft_consensus.cc:2749] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.034447 10475 raft_consensus.cc:3055] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:38.034819 10475 raft_consensus.cc:740] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:38.035046  9574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:38.035679  9464 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.035755  9574 raft_consensus.cc:606] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:38.035902 10129 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.036906 10445 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.036782 10475 consensus_queue.cc:260] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:38.037473 10445 raft_consensus.cc:697] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:38.038468 10445 consensus_queue.cc:237] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:38.038899 10401 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.038828 10127 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.039417  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.041026  9568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8f83a10da7493282e02784080114a7"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:38.041332 10407 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.041674  9568 raft_consensus.cc:606] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.041944 10475 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.030834 10437 raft_consensus.cc:2749] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.043617   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:38.045097 10437 consensus_queue.cc:1048] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.045462   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:38.046336 10461 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.047783  9390 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.048611 10395 raft_consensus.cc:2749] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.051558 10463 raft_consensus.cc:2749] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.051944 10128 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.052358  9390 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.053264 10463 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.053444 10395 raft_consensus.cc:2749] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.054239  9390 leader_election.cc:304] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.054441 10476 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.050395 10127 leader_election.cc:304] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.055810 10476 raft_consensus.cc:2749] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.056485 10398 raft_consensus.cc:2749] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.051333  9540 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.059768 10474 raft_consensus.cc:2749] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.059042 10127 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.061472 10398 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.061975  9540 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
W20260709 13:05:38.062367  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 44928.3us
I20260709 13:05:38.061915  9496 raft_consensus.cc:1275] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.065353 10459 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.070103 10409 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.082310  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:38.082763 10409 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:38.085161 10393 consensus_queue.cc:1059] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.086478 10474 raft_consensus.cc:3055] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.086899 10474 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.087831 10474 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.089658 10474 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.094919 10393 consensus_queue.cc:1059] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.096191 10471 raft_consensus.cc:3055] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.096568 10471 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.097433 10471 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.099047  9539 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.107249  9540 leader_election.cc:304] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.109052  9464 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.109406  9540 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.119524 10464 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:38.108579 10408 raft_consensus.cc:2749] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.119565 10393 consensus_queue.cc:1059] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:05:38.126186 10408 raft_consensus.cc:2749] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.127048 10408 raft_consensus.cc:3055] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.127393 10408 raft_consensus.cc:740] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.128185 10408 consensus_queue.cc:260] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.128595 10471 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.106611 10463 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.108335 10431 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.120093 10464 raft_consensus.cc:493] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:38.130215 10464 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.132186 10455 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:38.123227  9464 leader_election.cc:304] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.132777 10455 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.133373 10404 raft_consensus.cc:2749] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.133853  9464 leader_election.cc:304] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.134646 10404 raft_consensus.cc:2749] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.134805 10455 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:38.136973 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:38.137725 10178 raft_consensus.cc:2393] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.137787 10461 raft_consensus.cc:2749] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.139412 10464 raft_consensus.cc:515] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.112839 10417 consensus_queue.cc:1048] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:05:38.137737  9496 raft_consensus.cc:1275] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.141175  9423 raft_consensus.cc:1240] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:38.142814 10404 consensus_queue.cc:1059] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.143242  9493 raft_consensus.cc:1240] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:38.114866 10400 raft_consensus.cc:2749] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.143918 10404 raft_consensus.cc:3055] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.144316 10404 raft_consensus.cc:740] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:38.145181 10404 consensus_queue.cc:260] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.146179 10419 consensus_queue.cc:1059] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.147047 10419 raft_consensus.cc:3055] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:38.147403 10419 raft_consensus.cc:740] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:38.147511 10404 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.148406 10419 consensus_queue.cc:260] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.149576 10419 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.149885 10398 consensus_queue.cc:1048] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:38.114027 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 55116.1us
I20260709 13:05:38.154394 10476 raft_consensus.cc:993] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: : Instructing follower eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:38.162675 10457 raft_consensus.cc:1081] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Signalling peer eae0fc1c2353497a889fdda2eda53679 to start an election
I20260709 13:05:38.162989  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:38.168426  9249 catalog_manager.cc:5697] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.169728 10178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:05:38.171423 10178 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:38.173429 10178 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.177778 10127 leader_election.cc:304] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.173898 10464 leader_election.cc:290] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:38.152995 10401 raft_consensus.cc:2749] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.190006  9424 raft_consensus.cc:1240] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:38.191541 10464 consensus_queue.cc:1059] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.192728 10453 raft_consensus.cc:3055] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.193136 10453 raft_consensus.cc:740] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:38.193414 10398 raft_consensus.cc:2749] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.194015 10453 consensus_queue.cc:260] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.194433 10127 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.195048 10453 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.197456 10445 raft_consensus.cc:2749] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.196769 10127 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.200467 10445 consensus_queue.cc:1059] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.201437 10398 raft_consensus.cc:3055] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:38.200278 10178 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.201789 10398 raft_consensus.cc:740] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:38.202457 10397 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.202641 10398 consensus_queue.cc:260] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.204396 10398 raft_consensus.cc:3060] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.212471 10408 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.216800  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:38.217490  9424 raft_consensus.cc:3055] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.217772  9424 raft_consensus.cc:740] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:38.218502  9424 consensus_queue.cc:260] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.219524  9424 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.210518 10178 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:38.209579  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 95920us
I20260709 13:05:38.227562  9421 raft_consensus.cc:1275] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.227730  9420 raft_consensus.cc:1275] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.229029 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1786e708043842a3884b58092b23b91b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:38.221553 10127 leader_election.cc:304] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.234145 10445 raft_consensus.cc:2749] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.234894  9423 raft_consensus.cc:2468] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:38.235684 10127 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.236775 10445 raft_consensus.cc:2749] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.239415  9418 raft_consensus.cc:1240] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:38.241698 10445 consensus_queue.cc:1059] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.242523  9418 raft_consensus.cc:1275] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.242816 10397 raft_consensus.cc:3055] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:38.243264 10397 raft_consensus.cc:740] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:38.244009 10397 consensus_queue.cc:260] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.246444 10397 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.247840  9424 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
W20260709 13:05:38.248634  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 139301us
I20260709 13:05:38.250468  9540 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.250895  9465 leader_election.cc:304] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:38.251825  9540 leader_election.cc:304] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.254206 10127 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:38.255486 10395 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.256120 10395 raft_consensus.cc:697] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:38.256177 10128 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:38.252386 10393 raft_consensus.cc:2749] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.257263 10395 consensus_queue.cc:237] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.257148 10437 raft_consensus.cc:2804] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.264508 10437 raft_consensus.cc:697] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:38.265514 10437 consensus_queue.cc:237] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.252988 10453 raft_consensus.cc:2804] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:38.268570 10453 raft_consensus.cc:697] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:38.268811 10181 raft_consensus.cc:2468] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 4.
I20260709 13:05:38.269539 10453 consensus_queue.cc:237] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.252717 10408 consensus_queue.cc:1048] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:05:38.281724 10483 raft_consensus.cc:2749] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.282860 10393 raft_consensus.cc:993] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:38.284780 10393 raft_consensus.cc:1081] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:38.287127 10393 consensus_queue.cc:1048] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.288810  9568 raft_consensus.cc:1275] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.289134  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.290028  9572 raft_consensus.cc:2376] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2. Re-sending same reply.
I20260709 13:05:38.290249  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6cf54da48346c28143eaad060b9ccb" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.295714  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.296414  9567 raft_consensus.cc:2376] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2. Re-sending same reply.
I20260709 13:05:38.296742  9464 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.299139  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.299350 10404 raft_consensus.cc:2749] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.303561  9570 raft_consensus.cc:1275] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.302977 10393 consensus_queue.cc:1048] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.305920 10481 consensus_queue.cc:1048] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.306197  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.308048  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.308848  9568 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:38.309653 10393 consensus_queue.cc:1059] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.310053  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c24c026c7048d9847a58777efe8770" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.311005  9573 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.311002 10408 raft_consensus.cc:3055] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.312878 10408 raft_consensus.cc:740] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.314180 10408 consensus_queue.cc:260] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.302810  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676c09e0537147d886a1c9236674359a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.321018  9573 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:38.323007 10393 consensus_queue.cc:1048] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.323590 10408 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.328208  9464 leader_election.cc:304] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.333963 10181 raft_consensus.cc:1240] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:38.333711 10397 consensus_queue.cc:1048] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.334270 10127 leader_election.cc:304] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.339329 10464 raft_consensus.cc:493] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.341773  9539 leader_election.cc:304] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:38.344064  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.340757 10404 raft_consensus.cc:2749] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.344988  9464 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.349191  9464 leader_election.cc:304] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.350440  9464 leader_election.cc:304] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.351249  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.353049  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.354053  9575 raft_consensus.cc:2393] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.356117 10407 raft_consensus.cc:2749] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.356494  9566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af16b22a6c904b34aef360a0f7cd9e20" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.358425  9499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:57096
I20260709 13:05:38.359071  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.359488 10404 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.360409  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.360961 10474 consensus_queue.cc:1059] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.361645 10481 raft_consensus.cc:2804] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:38.347568 10464 raft_consensus.cc:515] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.372661  9249 catalog_manager.cc:5697] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.374715 10464 leader_election.cc:290] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:38.352150 10395 raft_consensus.cc:2749] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.370266  9499 raft_consensus.cc:493] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:38.376084  9499 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.360980  9390 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.377192  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:38.378468 10469 raft_consensus.cc:2749] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.363292 10453 raft_consensus.cc:2749] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.395861  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.394563 10481 raft_consensus.cc:697] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.400113 10395 consensus_queue.cc:1048] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:05:38.411350 10481 consensus_queue.cc:237] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.420146 10127 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.421142 10395 raft_consensus.cc:2749] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.422464 10127 leader_election.cc:304] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.429950  9464 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.425997  9390 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.440016  9390 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.447659  9390 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.445997 10457 raft_consensus.cc:2749] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.451862 10395 raft_consensus.cc:2749] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.451917 10469 raft_consensus.cc:2749] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.438019 10401 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.456619  9499 raft_consensus.cc:515] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.462996  9250 catalog_manager.cc:5697] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 3 to 4, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.460052 10455 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:38.465543  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405f4dfd2e604f208c69fcc85c065d0c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.466076 10455 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.452181 10463 raft_consensus.cc:2749] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.474143 10464 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:38.474951 10464 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:38.479655  9464 leader_election.cc:304] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.482111  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:38.482951  9572 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
W20260709 13:05:38.477722 10487 log.cc:927] Time spent T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:05:38.488794 10471 raft_consensus.cc:3055] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.489259 10471 raft_consensus.cc:740] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.490177 10471 consensus_queue.cc:260] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.498962  9464 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:38.497260 10471 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.505595  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.506194  9572 raft_consensus.cc:3055] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.506467  9572 raft_consensus.cc:740] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:38.507270  9572 consensus_queue.cc:260] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.508777  9572 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.508968 10401 raft_consensus.cc:2749] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.512254 10453 raft_consensus.cc:2804] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.512806 10453 raft_consensus.cc:493] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:38.513178 10453 raft_consensus.cc:3060] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.516259 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7191b50632234abe9017c3d7f8cd9879" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:38.516976 10181 raft_consensus.cc:3060] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:38.517488 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 95140.3us
I20260709 13:05:38.518364 10127 leader_election.cc:304] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:38.516748  9572 raft_consensus.cc:2468] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:38.496742  9499 leader_election.cc:290] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:38.504935 10404 raft_consensus.cc:2749] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.503813 10407 raft_consensus.cc:2749] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.526214  9464 leader_election.cc:304] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:38.530946 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:38.532194 10401 raft_consensus.cc:2804] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.533226 10401 raft_consensus.cc:697] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:38.533319  9499 raft_consensus.cc:1275] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.534147 10401 consensus_queue.cc:237] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.534741 10177 raft_consensus.cc:2393] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.536841  9574 raft_consensus.cc:2468] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:38.529881 10455 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:38.543509 10395 raft_consensus.cc:2749] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.564996 10464 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:38.565620 10489 log.cc:927] Time spent T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:05:38.566882 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 48615.2us
I20260709 13:05:38.575353 10445 consensus_queue.cc:1048] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.599932  9248 catalog_manager.cc:5697] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.578472 10453 raft_consensus.cc:515] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.611053 10453 leader_election.cc:290] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:38.614619  9390 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.615859 10463 raft_consensus.cc:2804] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.616374 10463 raft_consensus.cc:697] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:38.617208 10463 consensus_queue.cc:237] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:38.618798 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:38.619594 10178 raft_consensus.cc:2393] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.620453 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:38.621274 10176 raft_consensus.cc:2393] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.645601  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ae14c90ac540308e971d9148ceb222" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:38.645394  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:38.696941  9570 raft_consensus.cc:2468] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:38.663919  9420 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.698786  9418 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:38.761436 10181 raft_consensus.cc:2468] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:38.763569  9465 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.765736 10464 raft_consensus.cc:2804] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.766148 10464 raft_consensus.cc:493] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:38.766506 10464 raft_consensus.cc:3060] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:38.781420  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 53900.9us
I20260709 13:05:38.788199  9464 leader_election.cc:304] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:38.789520 10404 raft_consensus.cc:2804] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.790053 10404 raft_consensus.cc:697] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:38.790920 10404 consensus_queue.cc:237] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:38.796401  9423 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.798187 10401 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.814073  9567 raft_consensus.cc:1275] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.830060  9248 catalog_manager.cc:5697] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.856125 10395 consensus_queue.cc:1048] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.858665  9420 raft_consensus.cc:1275] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.859061  9427 raft_consensus.cc:1275] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.862052  9570 raft_consensus.cc:3060] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.862255 10397 consensus_queue.cc:1048] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.862900  9572 raft_consensus.cc:1275] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.864049 10397 consensus_queue.cc:1048] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.864965 10445 consensus_queue.cc:1048] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.867390 10483 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:38.870366 10483 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.872432 10483 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:38.872202 10464 raft_consensus.cc:515] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:38.875226  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:38.879881 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:38.883452  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:38.885190 10177 raft_consensus.cc:2393] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:38.884279  9500 raft_consensus.cc:2468] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:38.889214  9540 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:38.892640 10400 raft_consensus.cc:2804] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:38.893034 10400 raft_consensus.cc:493] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:38.893391 10400 raft_consensus.cc:3060] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.905663  9500 raft_consensus.cc:1275] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.917838 10445 consensus_queue.cc:1048] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.921564  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee539e5ae0140c097952f76679d785d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:38.914835 10464 leader_election.cc:290] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:38.948973  9248 catalog_manager.cc:5697] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 3 to 4, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.970180 10400 raft_consensus.cc:515] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:38.972846 10400 leader_election.cc:290] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:38.973554  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:38.976903  9418 raft_consensus.cc:2468] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:38.961921  9570 raft_consensus.cc:1275] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.984758 10401 consensus_queue.cc:1048] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.991806  9499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b02f7bce11408e9641daf8a5ff79ed" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.001727 10177 raft_consensus.cc:1275] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.001809 10181 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:39.005523  9494 raft_consensus.cc:1275] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:39.010174  9499 raft_consensus.cc:2468] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.016471  9572 raft_consensus.cc:1275] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.024791 10453 consensus_queue.cc:1048] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.027180 10474 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:39.031318 10401 consensus_queue.cc:1048] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.034529 10409 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.035189 10409 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.037602 10409 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.039201  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.054203  9496 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:39.039834  9465 leader_election.cc:304] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:39.046756   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:39.065279  9392 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.066084 10461 raft_consensus.cc:2804] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.066471 10461 raft_consensus.cc:493] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.066788 10461 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.049690 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.036196 10397 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.068110 10181 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:39.068207 10397 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.073693  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.077026 10483 consensus_queue.cc:1048] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:39.078739  9540 leader_election.cc:304] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:39.078294 10461 raft_consensus.cc:515] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.081982 10461 leader_election.cc:290] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.083058  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.083307  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.083880  9496 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.085399 10474 raft_consensus.cc:2804] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.086561 10474 raft_consensus.cc:697] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:39.087181  9567 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:39.089143 10397 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.067571 10453 raft_consensus.cc:2804] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.093611 10177 raft_consensus.cc:3060] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.095919 10453 raft_consensus.cc:697] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:39.096891  9574 raft_consensus.cc:1275] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.098428 10453 consensus_queue.cc:237] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.087620 10474 consensus_queue.cc:237] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.127902 10475 consensus_queue.cc:1048] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:39.141537 10177 raft_consensus.cc:1275] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.133906 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3258bebb55ec437b935b7b7e8f192ded" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.148440 10461 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.173892 10461 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.176806 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.177430 10177 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:39.178503  9391 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.179314 10469 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.179695 10469 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.180022 10469 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.161160 10463 consensus_queue.cc:1048] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:39.161109 10180 raft_consensus.cc:3060] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.185598 10468 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.186138 10468 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.125422 10127 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:39.193018 10468 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.194947 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.195648 10178 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.196122 10398 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:39.196605 10398 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.196970 10398 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.201930  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.202661  9418 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 1.
W20260709 13:05:39.192905 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 97698.1us
I20260709 13:05:39.210208 10178 raft_consensus.cc:1275] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.207460  9465 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.211673  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.214346  9496 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:39.220120 10453 consensus_queue.cc:1048] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.216545 10468 raft_consensus.cc:2804] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.224215 10468 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.224601 10468 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.225849 10469 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.226771 10437 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.227304 10437 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.230401  9392 leader_election.cc:304] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.231328 10409 raft_consensus.cc:2804] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.231850 10409 raft_consensus.cc:697] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:39.232390  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.232729 10409 consensus_queue.cc:237] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.206632  9250 catalog_manager.cc:5697] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.241519  9250 catalog_manager.cc:5697] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.247263   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:39.213786 10461 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.230244 10469 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.261647 10468 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.270586 10468 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.267971 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.286137 10181 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.272545 10461 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.286800 10461 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.287500  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.288260  9575 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:39.288477 10180 raft_consensus.cc:2468] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:39.289456 10127 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.289285 10461 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.290221  9567 raft_consensus.cc:1275] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.290442 10397 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:39.290817 10397 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.291131 10397 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.283793 10437 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:39.292096 10524 log.cc:927] Time spent T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:05:39.291041  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.299008 10398 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.299661 10181 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:39.302558 10404 consensus_queue.cc:1048] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:39.280488  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 63272.2us
I20260709 13:05:39.303580  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:39.305253  9572 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.306980 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.307502 10178 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.312204  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.312892  9493 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:39.313918  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.314540  9423 raft_consensus.cc:3060] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.311765 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.323614 10178 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.316700  9392 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.325223 10463 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.325608 10463 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.325994 10463 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.323828 10182 raft_consensus.cc:2393] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.347458  9465 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.347458  9572 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 5.
I20260709 13:05:39.356357  9391 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:39.373939 10461 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.375021 10453 raft_consensus.cc:2804] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.375566 10453 raft_consensus.cc:697] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:39.376400 10453 consensus_queue.cc:237] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.382524  9248 catalog_manager.cc:5697] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.388141  9572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "eae0fc1c2353497a889fdda2eda53679"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:39.388967  9572 raft_consensus.cc:606] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Received request to transfer leadership to TS eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:39.389355  9572 raft_consensus.cc:614] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:39.392511   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:39.394567   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:39.394755  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.397064 10397 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.398190 10475 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.399200 10397 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.373042 10398 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.373337 10127 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.398209 10468 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:39.402417 10468 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.403349  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:39.404134  9567 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.404549 10468 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.410715 10468 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:39.411298 10468 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.387938 10461 raft_consensus.cc:697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:39.412955 10461 consensus_queue.cc:237] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.413455 10468 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.398857 10475 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.414722 10398 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:39.415259 10398 raft_consensus.cc:697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:39.416101 10398 consensus_queue.cc:237] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.419832 10520 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.420403 10520 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.423009 10520 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.426594 10464 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:39.426891 10437 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.430025  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.430713  9493 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:39.434406 10463 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.427425 10464 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.436962 10129 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.437858  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.438102 10445 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.438230 10464 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.438473 10445 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.439740 10445 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.427475 10437 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.446601 10437 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:39.447588  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.448524  9421 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:39.449594  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.385659  9423 raft_consensus.cc:2468] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
W20260709 13:05:39.461318 10525 log.cc:927] Time spent T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:05:39.467097  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 119707us
I20260709 13:05:39.471380 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.472445 10181 raft_consensus.cc:2368] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3.
I20260709 13:05:39.472735  9249 catalog_manager.cc:5697] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.475337  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.476468 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.477166 10182 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:39.477982 10404 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.478505 10404 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.480634 10404 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.481093 10404 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.481519 10404 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.483461 10404 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.484517  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.485239  9573 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:39.486495  9391 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.476477  9421 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.487790 10475 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.488193 10469 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.488751 10469 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.489077 10469 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.489014 10127 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:39.497704 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.516192 10181 raft_consensus.cc:2393] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 3: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.516295  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.516921  9427 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.499382 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.517099  9465 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.517467 10409 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.513871 10445 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.518281 10182 raft_consensus.cc:2393] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.517678 10520 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.518924 10409 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.519778 10520 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.520449 10520 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.483634  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.521270 10468 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.521723 10468 raft_consensus.cc:493] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:39.522063  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.522701  9494 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.522854  9465 leader_election.cc:400] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3.
I20260709 13:05:39.523247  9465 leader_election.cc:403] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.523268  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.522094 10468 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.523988  9496 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:39.525278  9392 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.526398 10445 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.527148 10528 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.502182  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.525954 10409 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.529712 10409 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.531840  9494 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:39.504385  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.506091  9567 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 5.
I20260709 13:05:39.507462 10469 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.511667  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.514663 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.534472 10409 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.534932 10175 raft_consensus.cc:2368] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 2. Current term is 3.
I20260709 13:05:39.534993 10409 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:39.515031 10527 log.cc:927] Time spent T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 13:05:39.515038 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.517899 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.535889 10469 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.537221 10412 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.538529 10180 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.538794 10412 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.536270 10178 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.503345 10463 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.488158  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.540864 10129 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.542224 10398 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.542806 10398 raft_consensus.cc:697] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:39.543933  9418 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.546418 10412 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.556326 10453 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:39.556911 10453 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.557376 10177 raft_consensus.cc:1275] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.548802  9465 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.536963  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.560019 10464 raft_consensus.cc:2804] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.550205  9423 raft_consensus.cc:1275] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.560462 10464 raft_consensus.cc:493] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.560645  9465 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.560917 10464 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.562260 10412 consensus_queue.cc:1048] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.547570  9247 catalog_manager.cc:5697] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.552667  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.562561 10453 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:39.550899  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.563338 10401 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.566346  9427 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.566591 10401 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:39.567066 10401 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.565572  9391 leader_election.cc:400] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 2. Current term is 3.
I20260709 13:05:39.569259  9391 leader_election.cc:403] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.575901  9427 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:39.576447  9418 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:39.577658 10401 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.584925  9539 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:39.585234 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.585780 10412 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.585852 10180 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.586206 10412 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.579828 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.580925 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.586547 10401 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.586589 10412 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.587045 10178 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.565542 10468 raft_consensus.cc:515] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.582482  9465 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.582976 10464 raft_consensus.cc:515] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.590610 10453 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.590976 10453 raft_consensus.cc:493] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.591133 10464 leader_election.cc:290] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.591279 10453 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.591466 10127 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:39.594169  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.594682 10445 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:39.594836  9574 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.595252 10445 raft_consensus.cc:697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:39.596203 10177 raft_consensus.cc:2393] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 3: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.592222 10464 consensus_queue.cc:1048] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.596210 10445 consensus_queue.cc:237] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.597909  9493 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
W20260709 13:05:39.604003  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 116732us
I20260709 13:05:39.604139 10178 raft_consensus.cc:2468] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 4.
I20260709 13:05:39.584151 10463 raft_consensus.cc:2749] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 2. Current term is 3.
I20260709 13:05:39.563716 10528 raft_consensus.cc:2749] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3.
I20260709 13:05:39.605692 10461 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:39.543704 10398 consensus_queue.cc:237] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.608404 10461 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.617920  9391 leader_election.cc:304] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:39.620072 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.621254 10177 raft_consensus.cc:2393] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.622416  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.623800  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.624400  9427 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.624603  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:39.625762 10461 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:39.626159 10533 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.626583 10533 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:39.626942 10533 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.627130  9423 raft_consensus.cc:1275] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.622577 10536 raft_consensus.cc:2804] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.628352 10536 raft_consensus.cc:697] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 4 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:39.629179 10536 consensus_queue.cc:237] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.631325  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.632174  9567 raft_consensus.cc:2368] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 4. Current term is 5.
I20260709 13:05:39.635146  9427 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.637413 10404 consensus_queue.cc:1048] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.645329  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.645766  9465 leader_election.cc:304] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.646689 10401 raft_consensus.cc:2804] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.646718 10461 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.640833 10483 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.647308 10461 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.649529 10483 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.640929 10468 leader_election.cc:290] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.647285 10401 raft_consensus.cc:697] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:39.652186 10401 consensus_queue.cc:237] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.651185 10461 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:39.603700 10453 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.662562  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.651793 10483 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.640431 10520 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.665457 10468 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.665391 10520 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:39.682183  9496 raft_consensus.cc:1275] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.688421  9427 raft_consensus.cc:2393] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:39.666157  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:39.689812  9570 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.667534  9418 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.667307  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.694872  9465 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.695248  9500 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.698130 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc97c47c7054b42b01d2541e311211f" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.701624 10178 raft_consensus.cc:2368] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 3. Current term is 4.
I20260709 13:05:39.696828 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.703202 10177 raft_consensus.cc:2393] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 2: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.675493  9249 catalog_manager.cc:5697] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.665434  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.707229  9493 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.711402  9540 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:39.703859 10464 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.703539 10483 consensus_queue.cc:1048] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:05:39.670121 10453 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.700362  9247 catalog_manager.cc:5697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.719591 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.638746 10409 raft_consensus.cc:515] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.720628 10178 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.717144 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c2dcc9c8b6476bb6dfdbcf0db7abb4" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.721524 10177 raft_consensus.cc:3060] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.692754 10412 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.726357  9465 leader_election.cc:400] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 3. Current term is 4.
I20260709 13:05:39.729553  9465 leader_election.cc:403] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:05:39.724573  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 79133.4us
I20260709 13:05:39.666173 10468 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.737176  9390 leader_election.cc:400] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225) with higher term. Message: Invalid argument: T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 4. Current term is 5.
I20260709 13:05:39.737560  9390 leader_election.cc:403] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.750027 10178 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:39.720486  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.721290 10459 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:39.755014 10177 raft_consensus.cc:2468] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.742648 10404 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.723451 10464 raft_consensus.cc:697] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:39.754875  9465 leader_election.cc:304] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.742724 10453 raft_consensus.cc:3060] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.758899 10404 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.754638 10536 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.761209 10404 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:39.761734 10404 raft_consensus.cc:2804] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.762162 10404 raft_consensus.cc:697] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:39.762920 10404 consensus_queue.cc:237] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.756601  9421 raft_consensus.cc:2468] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.756880 10459 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.775575 10459 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:39.776894 10412 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.777248 10464 consensus_queue.cc:237] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:39.777864  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.778595  9420 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.780958 10468 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:39.787289  9420 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:39.789017  9539 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:39.790063 10400 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.790135 10409 leader_election.cc:290] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.790601 10400 raft_consensus.cc:697] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:39.791215  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:39.796723 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852931ef972a4b4d835cf4238e0a194e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.797658  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.798650 10177 raft_consensus.cc:2368] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4.
I20260709 13:05:39.799830  9391 leader_election.cc:400] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4.
I20260709 13:05:39.787925  9570 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:39.800720  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.809262  9427 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.801899 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.802356 10548 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.802654 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:39.812320 10182 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.812108 10548 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.814631 10548 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.803921  9391 leader_election.cc:403] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.805626  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.815270  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.815711  9572 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.816855 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.819381 10537 raft_consensus.cc:3060] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.820382 10400 consensus_queue.cc:237] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.822252 10533 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.806047  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.806689  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:39.829283  9573 raft_consensus.cc:2393] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 5: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:39.810876  9465 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:39.839205  9390 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:39.841673  9464 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:39.843329  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.844003  9496 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:39.847529  9540 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:39.850203  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:39.827713 10536 raft_consensus.cc:2749] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225) with higher term. Message: Invalid argument: T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 4. Current term is 5.
I20260709 13:05:39.808727 10412 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.804204  9420 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:39.823978 10453 raft_consensus.cc:2749] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 3. Current term is 4.
I20260709 13:05:39.848755 10463 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.854986 10548 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.860105 10417 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.863377 10401 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.876823  9573 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:39.885074  9500 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:39.874469 10181 raft_consensus.cc:1275] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:39.872802 10547 raft_consensus.cc:2804] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.875211 10548 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:39.878124 10401 raft_consensus.cc:493] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.869695 10412 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:39.866539 10127 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
W20260709 13:05:39.895267 10546 log.cc:927] Time spent T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:05:39.879948 10533 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:39.891733 10408 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.896543 10408 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.898684 10408 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:39.891803 10548 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.909592 10459 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.910269  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.910946  9423 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.879626 10417 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:39.890683 10547 raft_consensus.cc:493] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.912613 10547 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.913034  9539 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:39.913757 10417 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.914311 10417 raft_consensus.cc:2804] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.914669 10417 raft_consensus.cc:493] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.915035 10417 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.915261  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:39.891969 10401 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.916213  9420 raft_consensus.cc:2393] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:39.916355 10445 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.917605 10412 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:39.917101 10445 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:39.918684 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 68127us
I20260709 13:05:39.919389 10398 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.920061 10398 raft_consensus.cc:697] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 4 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:39.920501 10445 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.920905 10398 consensus_queue.cc:237] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.927122 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.927368 10520 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.927837 10176 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.927886 10520 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:39.918325  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:39.929950  9423 raft_consensus.cc:2393] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 2: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:39.930158 10520 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:39.930946 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:39.931622 10181 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:39.933315 10182 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
W20260709 13:05:39.934659 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 48124.3us
I20260709 13:05:39.937947  9539 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.939389  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:39.939643 10537 raft_consensus.cc:2749] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4.
I20260709 13:05:39.911890 10459 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:39.967242 10408 raft_consensus.cc:2804] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.967691 10408 raft_consensus.cc:493] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.965135  9250 catalog_manager.cc:5697] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.968051 10408 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.968884  9250 catalog_manager.cc:5697] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 3, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.975311 10463 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:39.988875 10549 log.cc:927] Time spent T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:05:39.965189  9496 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:39.999233 10129 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:39.950151  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:40.001784  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:40.015859  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:40.016958  9500 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 1.
I20260709 13:05:40.005201 10397 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:40.022390  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:40.005998 10528 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:39.950650 10401 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.027136  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:40.023849 10397 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.041746  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:40.042727  9567 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
W20260709 13:05:40.043602  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 232786us
I20260709 13:05:40.022214 10548 raft_consensus.cc:515] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.042660 10397 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.022771 10408 raft_consensus.cc:515] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:40.040853 10528 raft_consensus.cc:697] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:40.034770 10417 raft_consensus.cc:515] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:40.062644  9500 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:40.064325  9495 raft_consensus.cc:1275] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.077847 10409 consensus_queue.cc:1048] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.075831  9570 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:40.131013 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 73538.6us
I20260709 13:05:40.079070 10528 consensus_queue.cc:237] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:40.079252  9423 raft_consensus.cc:1275] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.068015  9493 raft_consensus.cc:1275] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:40.179070  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 107856us
I20260709 13:05:40.172658 10417 leader_election.cc:290] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:40.177860 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 99635.1us
I20260709 13:05:40.184845 10408 leader_election.cc:290] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:40.187021  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 107977us
I20260709 13:05:40.195676  9424 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:40.198865  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 124321us
I20260709 13:05:40.200271  9540 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:40.183228 10547 raft_consensus.cc:515] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.201095 10417 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.201627 10417 raft_consensus.cc:697] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:40.202512 10417 consensus_queue.cc:237] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.204119  9496 raft_consensus.cc:2368] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 2. Current term is 3.
W20260709 13:05:40.208526  9464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 134497us
I20260709 13:05:40.229089  9540 leader_election.cc:400] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 2. Current term is 3.
I20260709 13:05:40.229497  9540 leader_election.cc:403] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:40.226114  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 148610us
I20260709 13:05:40.206818 10401 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:40.237450  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:40.240343  9495 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.198691 10469 consensus_queue.cc:1048] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:05:40.229938 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 45057.6us
I20260709 13:05:40.241935 10536 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.361158  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 132219us
I20260709 13:05:40.363361 10561 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.393522  9500 raft_consensus.cc:1275] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.377771 10536 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.405119 10536 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:40.408689  9495 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:40.381979 10568 consensus_queue.cc:1048] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:05:40.418341 10563 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.355932 10397 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:40.442943 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:40.443888 10176 raft_consensus.cc:2368] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3.
I20260709 13:05:40.436993 10563 consensus_queue.cc:1048] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:05:40.443199 10397 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:40.458657 10183 raft_consensus.cc:1275] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.459044  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:40.475226  9540 leader_election.cc:304] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:40.483234 10400 raft_consensus.cc:2804] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.485270 10400 raft_consensus.cc:697] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:40.486370 10400 consensus_queue.cc:237] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:40.489881  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:40.463392 10537 consensus_queue.cc:1048] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:05:40.499017  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 266481us
I20260709 13:05:40.494987 10561 raft_consensus.cc:2749] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 2. Current term is 3.
I20260709 13:05:40.424013   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:40.510761  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba7c03f3c344aeab4dd32e9f4b13fc1" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:40.510838  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:40.511544  9418 raft_consensus.cc:3060] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.513571  9420 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.522651 10176 raft_consensus.cc:1275] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.523247  9423 raft_consensus.cc:1275] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:40.527211  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 50282.5us
I20260709 13:05:40.531675  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:40.532475  9575 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.534509  9573 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:40.537525  9572 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:40.541419  9465 leader_election.cc:400] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 2 election: Vote denied by peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181) with higher term. Message: Invalid argument: T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3.
I20260709 13:05:40.555841  9574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:40.560259 10464 consensus_queue.cc:1048] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.566152 10547 leader_election.cc:290] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:40.567945  9573 raft_consensus.cc:1275] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.568827 10568 consensus_queue.cc:1048] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.578716 10180 raft_consensus.cc:1275] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.580403 10176 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:40.580845  9424 raft_consensus.cc:1275] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.585975 10578 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.591501 10468 consensus_queue.cc:1048] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:40.591693 10577 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.593452  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:40.594158  9567 raft_consensus.cc:3060] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.617764 10548 leader_election.cc:290] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:40.618263  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:40.618450  9418 raft_consensus.cc:2468] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
W20260709 13:05:40.620970 10580 log.cc:927] Time spent T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:05:40.621310  9465 leader_election.cc:304] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:40.622274 10588 raft_consensus.cc:2804] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.622632  9495 raft_consensus.cc:1275] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.623039 10588 raft_consensus.cc:697] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:40.624656  9421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:40.624563 10588 consensus_queue.cc:237] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.625519  9421 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 2.
I20260709 13:05:40.627729 10174 raft_consensus.cc:1240] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:40.636916  9567 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:40.647537  9575 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:40.648316  9573 raft_consensus.cc:1240] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:40.655956 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 92311.3us
W20260709 13:05:40.661890 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 53334.5us
I20260709 13:05:40.666208  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:40.667122  9424 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.668671  9495 raft_consensus.cc:1275] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:40.663496 10554 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.676395 10127 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:40.622690  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:40.676632  9464 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
W20260709 13:05:40.644615 10128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 44091.3us
I20260709 13:05:40.688192  9496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9cd875495e4489a7ae864416b8e233" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:40.603835 10409 consensus_queue.cc:1048] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:05:40.701298 10181 raft_consensus.cc:1275] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.702766 10578 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.703323 10578 raft_consensus.cc:697] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:40.703975 10564 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:05:40.689041 10547 raft_consensus.cc:2804] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:40.727202 10578 consensus_queue.cc:237] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:40.680363  9420 raft_consensus.cc:2468] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:40.721459  9426 raft_consensus.cc:1275] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.678001 10572 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:05:40.689539  9493 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:40.728174 10577 consensus_queue.cc:1048] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.748837  9424 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:40.731205 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8e0525be1147f4827361f2bd94ff3b" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:40.737743 10547 raft_consensus.cc:697] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:40.746932 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aee84f299b340bbad1f7999d6bb35b7" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:40.773823 10174 raft_consensus.cc:3060] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.768322 10182 raft_consensus.cc:3060] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.793264 10182 raft_consensus.cc:2468] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:40.794203 10174 raft_consensus.cc:2468] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:40.744333 10570 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:05:40.808427 10583 consensus_queue.cc:1048] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:05:40.765275  9539 leader_election.cc:304] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:40.763185  9392 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0
W20260709 13:05:40.830338  9392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 67236.8us
W20260709 13:05:40.818682 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 47338.4us
W20260709 13:05:40.867523  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 102326us
W20260709 13:05:40.868217  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 188806us
I20260709 13:05:40.842772  9250 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39074 (request call id 98) took 1103 ms. Trace:
I20260709 13:05:40.839910 10469 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:40.880710 10127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 204453us
I20260709 13:05:40.874367 10417 raft_consensus.cc:2804] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.881325 10469 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.931892  9500 raft_consensus.cc:1275] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:40.933152 10594 log.cc:927] Time spent T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:05:40.934577 10556 consensus_queue.cc:1048] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:05:40.935827 10573 consensus_queue.cc:1059] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:05:40.937143 10573 raft_consensus.cc:3055] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.937549 10573 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:40.938601 10573 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:40.941115 10601 log.cc:927] Time spent T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:05:40.944401 10565 consensus_queue.cc:1175] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eae0fc1c2353497a889fdda2eda53679" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:40.899264 10547 consensus_queue.cc:237] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:40.925765  9423 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:40.958523 10561 consensus_queue.cc:1048] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.920367 10469 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.926658 10417 raft_consensus.cc:697] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:40.874483  9250 rpcz_store.cc:276] 0709 13:05:39.731127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.731295 (+   168us) service_pool.cc:224] Handling call
0709 13:05:40.834805 (+1103510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:39.976376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:39.977102 (+   726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:39.977147 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:05:39.977172 (+    25us) tablet.cc:662] Decoding operations
0709 13:05:39.977582 (+   410us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:39.977646 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:39.977677 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:39.978009 (+   332us) tablet.cc:701] Row locks acquired
0709 13:05:39.978031 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:05:39.978180 (+   149us) write_op.cc:270] Start()
0709 13:05:39.978289 (+   109us) write_op.cc:276] Timestamp: P: 1783602339978129 usec, L: 0
0709 13:05:39.978311 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:40.078984 (+100673us) log.cc:844] Serialized 928 byte log entry
0709 13:05:40.186152 (+107168us) op_driver.cc:464] REPLICATION: finished
0709 13:05:40.186562 (+   410us) write_op.cc:301] APPLY: starting
0709 13:05:40.186643 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:40.186770 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:40.186903 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:40.187195 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:40.187383 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:40.187453 (+    70us) write_op.cc:312] APPLY: finished
0709 13:05:40.188921 (+  1468us) log.cc:844] Serialized 28 byte log entry
0709 13:05:40.189070 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:40.189160 (+    90us) write_op.cc:454] Released schema lock
0709 13:05:40.189235 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:40.414763 (+225528us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b540052d0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f4698074e28 00007f469baaf581 00007f469baaed58 00007f469bab39f1 00007f469bab39a9 00007f469bab3939 00007f469bab3901 00007f469bab2b2d 000000000038f354 000000000038f199
0709 13:05:40.415017 (+   254us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:40.415050 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39239,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":118,"apply.run_cpu_time_us":1771,"apply.run_wall_time_us":9114,"num_ops":2,"prepare.queue_time_us":3753,"prepare.run_cpu_time_us":14037,"prepare.run_wall_time_us":438600,"replication_time_us":207711,"spinlock_wait_cycles":195532544}]]}
W20260709 13:05:41.014577  9467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.074445  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 193722us
W20260709 13:05:41.064544  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 186114us
I20260709 13:05:41.053938 10573 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:41.194777 10174 raft_consensus.cc:1275] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.106261 10417 consensus_queue.cc:237] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:41.202108 10561 consensus_queue.cc:1048] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:05:41.207334  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 137374us
W20260709 13:05:41.205471  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 119566us
I20260709 13:05:41.237600 10619 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.238260 10619 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:41.238610 10606 log.cc:927] Time spent T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
I20260709 13:05:41.235661 10469 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:41.262696 10469 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:41.264923 10621 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.301250 10612 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.301836 10612 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.324656  9427 raft_consensus.cc:1275] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:41.326472  9392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 113624us
W20260709 13:05:41.325842  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 71030us
I20260709 13:05:41.328343  9424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:41.329957 10619 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:41.346439 10612 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.350752  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:41.337216 10536 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.359264 10536 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:41.336822 10622 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.338346 10619 consensus_queue.cc:1048] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:41.363586 10622 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.368855 10536 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:41.366111 10622 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.374856  9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:41.390906 10557 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.391458 10557 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.403965 10181 raft_consensus.cc:1275] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.415270  9494 raft_consensus.cc:1275] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.422823 10557 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.430733  9497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.431592  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.435883  9500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.436885  9390 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:41.439383 10610 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.440089 10610 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.439375 10557 raft_consensus.cc:2749] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.461580  9567 raft_consensus.cc:1275] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.451573 10412 consensus_queue.cc:1048] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:05:41.470561 10176 raft_consensus.cc:1275] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.490006  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:41.492379 10574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.000s
W20260709 13:05:41.492830 10574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:05:41.495119  9247 catalog_manager.cc:5697] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:41.485927 10570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.020s
W20260709 13:05:41.497848 10570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.002s	sys 0.021s
I20260709 13:05:41.496740  9247 catalog_manager.cc:5697] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.508639  9247 catalog_manager.cc:5697] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.501236 10574 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.511005 10586 consensus_queue.cc:1048] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:41.556273 10561 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.524966 10574 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:41.576066 10547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.010s	sys 0.024s
W20260709 13:05:41.583441 10547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.024s
I20260709 13:05:41.578672 10561 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:41.610085 10574 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:41.610327 10561 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:41.613453  9573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:41.631618 10128 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.018s	sys 0.071s
W20260709 13:05:41.632066 10128 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.018s	sys 0.071s
W20260709 13:05:41.632368 10128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 927911us
I20260709 13:05:41.633126 10128 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068
I20260709 13:05:41.635365 10610 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:41.637478 10642 log.cc:927] Time spent T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:05:41.613659  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.666303 10646 consensus_queue.cc:1048] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.675844 10397 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:41.676326 10397 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:41.676721 10397 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:41.627933 10461 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:05:41.693774 10610 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.694361 10610 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.684864 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.685001 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.685294 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.685740 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.687470 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:41.688417 10641 log.cc:927] Time spent T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
W20260709 13:05:41.689544 10616 log.cc:927] Time spent T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 13:05:41.690089 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.659325 10572 raft_consensus.cc:493] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:41.712697 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
W20260709 13:05:41.715580 10520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.021s	sys 0.026s
W20260709 13:05:41.723439 10520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.021s	sys 0.026s
I20260709 13:05:41.724051 10575 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.724855 10575 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:41.701632 10128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 63222.9us
I20260709 13:05:41.740236  9420 raft_consensus.cc:1240] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Rejecting Update request from peer e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:41.741679 10610 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.746652  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.727510 10572 raft_consensus.cc:515] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:41.754596  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.761063 10548 consensus_queue.cc:1059] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.769865 10572 leader_election.cc:290] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:41.771363 10412 raft_consensus.cc:3055] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:41.771826 10412 raft_consensus.cc:740] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:41.772652 10412 consensus_queue.cc:260] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
W20260709 13:05:41.784253  9492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.019s	sys 0.026s
I20260709 13:05:41.774127 10412 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:41.787035  9492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.019s	sys 0.026s
I20260709 13:05:41.785388 10397 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.789645 10397 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.806315  9501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
W20260709 13:05:41.819149 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 53837.5us
I20260709 13:05:41.822446  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:41.848276  9426 raft_consensus.cc:1275] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.849015 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.850342 10178 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:41.810670 10575 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.861763  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:41.855542  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3394a244b95c412a9b0d4a2db10fc64a" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:41.880573 10128 leader_election.cc:304] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:41.871834 10409 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:41.888933 10572 raft_consensus.cc:2749] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:41.891383 10409 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:41.857867 10459 consensus_queue.cc:1048] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:05:41.897810  9423 raft_consensus.cc:1275] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:41.898998  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:41.913048  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.914208  9391 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.914958  9496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57096 (request call id 701) took 1227 ms. Trace:
I20260709 13:05:41.915361  9496 rpcz_store.cc:276] 0709 13:05:40.687723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.687894 (+   171us) service_pool.cc:224] Handling call
0709 13:05:41.914760 (+1226866us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540060c7d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe2571 00007f469807d2fa 00007f469d03eb17 00007f46965b96d4 00007f46965b9662 00007f46965b9591 00007f46965b950c 00007f46965b87c2 00007f46963b448c 00007f46963b38c6 00007f46963b326f
0709 13:05:41.914889 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071081728}
I20260709 13:05:41.894614  9420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:41.919083  9391 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.919637  9424 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:41.920221  9465 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:41.912326  9539 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.922719  9540 leader_election.cc:304] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:41.926218 10178 raft_consensus.cc:1240] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Rejecting Update request from peer 2319bdfca4124710b4064192c524a068 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:41.930195 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.931461  9391 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.909168 10409 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:41.934491 10179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.927762 10557 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.937278 10408 raft_consensus.cc:2749] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.937433  9391 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.938743  9391 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:41.939069 10557 raft_consensus.cc:2749] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.921780 10570 consensus_queue.cc:1048] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:05:41.928686 10567 raft_consensus.cc:2749] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.930773 10469 raft_consensus.cc:2749] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.939805 10557 raft_consensus.cc:2749] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.961369 10128 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:41.930629 10632 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.942423 10543 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.931234  9421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47398 (request call id 586) took 1098 ms. Trace:
W20260709 13:05:41.969528 10661 log.cc:927] Time spent T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:05:41.969293  9421 rpcz_store.cc:276] 0709 13:05:40.827123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.829522 (+  2399us) service_pool.cc:224] Handling call
0709 13:05:41.675780 (+846258us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b58001c1198. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4694e14db1 00007f4694f54b71 00007f4694f54a22 00007f469de6dc09 00007f469cfc7ee0 00007f469d0910ab 00007f469d091131 00007f469d052fc0 00007f469d03d929 00007f469d03d3d2 00007f46965b4bd4
0709 13:05:41.676087 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:41.676568 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.676614 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:41.677266 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.900573 (+223307us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800213160. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4697c214bc 00007f4694f6f48b 00007f469ddc9ab9 00007f4694f8b69b 00007f4694f8993f 00007f4694f8bc02 00007f4697c1320b 00007f4697c18d23 00007f4697c190d1
0709 13:05:41.900728 (+   155us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:41.900773 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.900849 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.903163 (+  2314us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800213160. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f469de54de1 00007f469de615b1 00007f4694f8c3f3 00007f4694f8e7c1 00007f4694f8e779 00007f4694f8e709 00007f4694f8e6d1 00007f4694f8d9cd 000000000038f354 000000000038f199 00007f4694f6f83a
0709 13:05:41.905814 (+  2651us) raft_consensus.cc:1685] finished
0709 13:05:41.909523 (+  3709us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.918476 (+  8953us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3080,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":15671,"spinlock_wait_cycles":20219264,"thread_start_us":29885,"threads_started":1,"wal-append.queue_time_us":27811}
I20260709 13:05:41.974218 10572 raft_consensus.cc:2749] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:41.962889 10663 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:05:41.980165 10632 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:41.982371 10632 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:41.983429 10555 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:41.984263 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:41.942198 10575 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.009610   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:42.031468  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:42.035208 10176 raft_consensus.cc:1275] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.039553 10555 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:42.040230 10555 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.043354  9492 raft_consensus.cc:1275] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:42.043829  9492 pending_rounds.cc:85] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Aborting all ops after (but not including) 1
I20260709 13:05:41.988612 10568 consensus_queue.cc:1059] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:05:42.056802 10397 raft_consensus.cc:493] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:42.057405 10397 raft_consensus.cc:515] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:42.044189  9492 pending_rounds.cc:107] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:05:42.063771 10669 log.cc:927] Time spent T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:05:42.088575  9391 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.089986  9391 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.090786 10409 raft_consensus.cc:2749] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.091444 10409 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.094202 10569 raft_consensus.cc:3055] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:42.094782 10569 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:42.070252  9492 raft_consensus.cc:2889] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:42.091471  9391 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.104125 10520 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.105436 10588 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.105965 10588 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:42.094087 10585 consensus_queue.cc:1048] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.095665 10569 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:42.111977 10397 leader_election.cc:290] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:42.112118 10536 raft_consensus.cc:2749] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.117868 10588 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:42.119146 10555 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:42.119686  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:42.119807  9247 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55098 (request call id 151) took 2127 ms. Trace:
I20260709 13:05:42.147094 10555 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:42.149293  9572 raft_consensus.cc:1275] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:42.147356  9247 rpcz_store.cc:276] 0709 13:05:39.992627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.992767 (+   140us) service_pool.cc:224] Handling call
0709 13:05:40.175996 (+183229us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b540052d0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:05:42.119726 (+1943730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:41.664506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:41.665060 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:41.665094 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:05:41.665114 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:41.665653 (+   539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:41.665737 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:41.665771 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:05:41.673207 (+  7436us) tablet.cc:701] Row locks acquired
0709 13:05:41.674385 (+  1178us) write_op.cc:260] PREPARE: finished
0709 13:05:41.697680 (+ 23295us) write_op.cc:270] Start()
0709 13:05:41.714251 (+ 16571us) write_op.cc:276] Timestamp: P: 1783602341692381 usec, L: 0
0709 13:05:41.716124 (+  1873us) op_driver.cc:348] REPLICATION: starting
0709 13:05:41.773911 (+ 57787us) log.cc:844] Serialized 1316 byte log entry
0709 13:05:42.056222 (+282311us) op_driver.cc:464] REPLICATION: finished
0709 13:05:42.103640 (+ 47418us) write_op.cc:301] APPLY: starting
0709 13:05:42.108936 (+  5296us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:42.109070 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:42.109203 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:42.109585 (+   382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:42.109749 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:05:42.109792 (+    43us) write_op.cc:312] APPLY: finished
0709 13:05:42.109997 (+   205us) log.cc:844] Serialized 34 byte log entry
0709 13:05:42.112198 (+  2201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:42.112292 (+    94us) write_op.cc:454] Released schema lock
0709 13:05:42.112334 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":157264640,"child_traces":[["op",{"apply.queue_time_us":47158,"apply.run_cpu_time_us":1860,"apply.run_wall_time_us":9038,"num_ops":3,"prepare.queue_time_us":134486,"prepare.run_cpu_time_us":65696,"prepare.run_wall_time_us":294905,"raft.queue_time_us":19811,"replication_time_us":339913,"thread_start_us":308533,"threads_started":4,"wal-append.queue_time_us":227546}]]}
I20260709 13:05:42.150411  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:42.122710  9250 catalog_manager.cc:5697] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.123955 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:42.155871  9250 catalog_manager.cc:5697] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.151225  9568 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:42.157387  9250 catalog_manager.cc:5697] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } }
I20260709 13:05:42.158188  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:42.158766  9250 catalog_manager.cc:5697] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 3, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.159390 10569 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.165669  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5f31b62d11440182534d9ea52a469c" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:42.168686 10128 leader_election.cc:304] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:42.170360  9391 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.173642 10397 raft_consensus.cc:2749] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.171702  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:42.176846 10177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:42.179062 10176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:42.180094 10409 raft_consensus.cc:2749] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:42.183605 10572 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:42.191036  9248 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55106 (request call id 160) took 2424 ms. Trace:
I20260709 13:05:42.194790 10572 raft_consensus.cc:493] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:42.195381 10572 raft_consensus.cc:515] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:42.195839  9249 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55086 (request call id 146) took 2196 ms. Trace:
I20260709 13:05:42.196321  9249 rpcz_store.cc:276] 0709 13:05:39.999914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.000183 (+   269us) service_pool.cc:224] Handling call
0709 13:05:40.476169 (+475986us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b540052d0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:05:42.195780 (+1719611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283742,"reported_tablets":4,"spinlock_wait_cycles":138967808}
I20260709 13:05:42.192934  9248 rpcz_store.cc:276] 0709 13:05:39.767060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.770075 (+  3015us) service_pool.cc:224] Handling call
0709 13:05:39.831812 (+ 61737us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b540052d0d4. stack: 00007f4694f5a343 00007f4694f5a240 00007f46948e91d4 00007f469e627304 00007f469e627299 00007f4697fe3090 00007f4698081f3a 00007f469de381cc 00007f469df3637e 00007f469c3f72a4 00007f469c3f7232 00007f469c3f7161 00007f469c3f70dc 00007f469c3f6392 00007f46963b448c 00007f46963b38c6
0709 13:05:42.190970 (+2359158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268268,"reported_tablets":3,"spinlock_wait_cycles":53497728}
I20260709 13:05:42.201753  9465 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.203889 10626 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:42.244203 10572 leader_election.cc:290] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:42.237188 10626 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:42.245846 10626 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.217878 10556 raft_consensus.cc:2749] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.253438  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:42.277499  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc8e68c8d8f4c6380be2ffc0070d2b6" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:42.285391 10128 leader_election.cc:304] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:42.288496 10570 raft_consensus.cc:2749] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:42.393730  9492 raft_consensus.cc:1240] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.424557 10626 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:42.426793 10626 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:42.437139  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:42.433696 10557 consensus_queue.cc:1059] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:05:42.467177 10557 raft_consensus.cc:3055] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.467557 10557 raft_consensus.cc:740] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:42.468396 10557 consensus_queue.cc:260] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:42.470079 10557 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.465718 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:42.540387  9465 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:42.542479 10569 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.549253  9250 catalog_manager.cc:5697] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } }
I20260709 13:05:42.553376  9250 catalog_manager.cc:5697] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } }
I20260709 13:05:42.554198  9250 catalog_manager.cc:5697] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } }
I20260709 13:05:42.597479  9248 catalog_manager.cc:5697] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 2, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } }
I20260709 13:05:42.599251  9248 catalog_manager.cc:5697] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.601063  9248 catalog_manager.cc:5697] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.603160 10182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:56498
I20260709 13:05:42.603896 10182 raft_consensus.cc:606] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:42.608153  9575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8f83a10da7493282e02784080114a7"
dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
mode: GRACEFUL
new_leader_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:05:42.608759  9575 raft_consensus.cc:606] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Received request to transfer leadership to TS 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:42.610217   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:42.612212   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:42.767442  9493 raft_consensus.cc:1240] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Rejecting Update request from peer eae0fc1c2353497a889fdda2eda53679 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.772142 10520 consensus_queue.cc:1059] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:42.774210 10520 raft_consensus.cc:3055] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.774608 10520 raft_consensus.cc:740] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:42.803383 10412 raft_consensus.cc:993] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: : Instructing follower 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:42.808745 10412 raft_consensus.cc:1081] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Signalling peer 35817eed7a6449bc913deabeec3a66a2 to start an election
I20260709 13:05:42.811821  9418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8f83a10da7493282e02784080114a7"
dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
 from {username='slave'} at 127.0.0.1:33744
I20260709 13:05:42.812577  9418 raft_consensus.cc:493] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.812994  9418 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.821126  9418 raft_consensus.cc:515] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:42.824574  9418 leader_election.cc:290] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:42.837523  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:42.838225  9569 raft_consensus.cc:3055] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:42.838542  9569 raft_consensus.cc:740] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:42.839376  9569 consensus_queue.cc:260] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:42.840572  9569 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.844121 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8f83a10da7493282e02784080114a7" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:42.844799 10182 raft_consensus.cc:3060] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.775460 10520 consensus_queue.cc:260] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:42.846396 10520 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.856906 10182 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 4.
I20260709 13:05:42.856891  9569 raft_consensus.cc:2468] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 4.
I20260709 13:05:42.858490  9391 leader_election.cc:304] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:42.899858 10554 raft_consensus.cc:2804] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:42.901353 10554 raft_consensus.cc:697] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 4 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:42.902175 10554 consensus_queue.cc:237] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:42.919929 10569 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:42.925624 10569 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:42.929365  9248 catalog_manager.cc:5697] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 3 to 4, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.933722  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:42.934654  9423 raft_consensus.cc:2393] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 3: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:42.936466 10569 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:42.937739  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:42.938555  9570 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:42.940943  9464 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:42.941708 10569 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:42.942091 10569 raft_consensus.cc:493] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3b7aa42b8924e21bbeb620671e29bd0)
I20260709 13:05:42.942459 10569 raft_consensus.cc:3060] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:42.962548 10569 raft_consensus.cc:515] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:42.970120  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:42.972810  9423 raft_consensus.cc:2393] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2319bdfca4124710b4064192c524a068 in current term 3: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:42.977097 10569 leader_election.cc:290] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:42.978464  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0a254f4e734ae0878ae119cade4f15" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:42.986738  9570 raft_consensus.cc:2468] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:42.987977  9464 leader_election.cc:304] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:42.989184 10569 raft_consensus.cc:2804] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:42.989662 10569 raft_consensus.cc:697] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:42.990480 10569 consensus_queue.cc:237] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } }
I20260709 13:05:43.015775 10632 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:43.016489 10632 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.018409 10632 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.020354  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:43.021178  9493 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:43.020368 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:43.023613 10182 raft_consensus.cc:2393] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 3: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:43.022598  9392 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:43.024600 10632 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:43.025035 10632 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2319bdfca4124710b4064192c524a068)
I20260709 13:05:43.025415 10632 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:43.027252  9248 catalog_manager.cc:5697] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 3, leader changed from e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.038831 10632 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.041474 10632 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.042824  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:43.049391 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:43.050328 10182 raft_consensus.cc:2393] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35817eed7a6449bc913deabeec3a66a2 in current term 3: Already voted for candidate eae0fc1c2353497a889fdda2eda53679 in this term.
I20260709 13:05:43.054919  9492 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:43.056358  9392 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:43.057164 10632 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:43.057711 10632 raft_consensus.cc:697] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:43.058658 10632 consensus_queue.cc:237] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.074076  9248 catalog_manager.cc:5697] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 2 to 3, leader changed from 2319bdfca4124710b4064192c524a068 (127.0.107.195) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.295713  9570 raft_consensus.cc:1275] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:43.297544 10632 consensus_queue.cc:1048] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.317294 10182 raft_consensus.cc:1275] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:43.320762 10557 consensus_queue.cc:1048] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.472095  9570 raft_consensus.cc:1275] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:43.473912 10556 consensus_queue.cc:1048] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.510771 10572 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.511353 10572 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.514561  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:43.517287 10572 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.520581  9418 raft_consensus.cc:1275] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:43.522379 10569 consensus_queue.cc:1048] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.539543 10175 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:43.542299 10557 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.546437  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:43.547263  9493 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 3.
I20260709 13:05:43.549437 10129 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:43.552279 10398 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:43.552675 10398 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.553012 10398 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.565086 10398 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.566105 10175 raft_consensus.cc:1240] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Rejecting Update request from peer 35817eed7a6449bc913deabeec3a66a2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:43.571171  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:43.578437  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:43.576892 10398 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 election: Requested vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.579160  9492 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.587531  9492 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:43.588145 10554 consensus_queue.cc:1059] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.589294 10557 raft_consensus.cc:3055] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:43.589672 10557 raft_consensus.cc:740] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:43.590523 10557 consensus_queue.cc:260] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.591620 10557 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:43.613206   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:43.631058 10554 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.631866 10554 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.634732 10175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:43.634982  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:43.635917  9494 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 4.
I20260709 13:05:43.637187  9392 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:43.637991 10632 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:43.638444 10632 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.638847 10632 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.684924 10129 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 35817eed7a6449bc913deabeec3a66a2
I20260709 13:05:43.685927 10398 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:43.686415 10398 raft_consensus.cc:697] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:43.690838 10398 consensus_queue.cc:237] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.705973 10554 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.713333 10632 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.716971  9494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:43.717677  9494 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.732672 10632 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.814592  9494 raft_consensus.cc:2468] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 5.
I20260709 13:05:43.817001  9392 leader_election.cc:304] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:43.814448 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
W20260709 13:05:43.812541 10129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 54804.8us
I20260709 13:05:43.829691 10557 raft_consensus.cc:2804] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:43.830251 10557 raft_consensus.cc:697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 5 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:43.831094 10557 consensus_queue.cc:237] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.843672  9247 catalog_manager.cc:5697] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 3 to 4, leader changed from 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194) to eae0fc1c2353497a889fdda2eda53679 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.856664 10398 raft_consensus.cc:493] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35817eed7a6449bc913deabeec3a66a2)
I20260709 13:05:43.857340 10398 raft_consensus.cc:515] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:43.866189 10398 leader_election.cc:290] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:43.867440  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:43.868449  9493 raft_consensus.cc:2368] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 for earlier term 4. Current term is 5.
I20260709 13:05:43.869768 10129 leader_election.cc:400] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 for earlier term 4. Current term is 5.
I20260709 13:05:43.870134 10129 leader_election.cc:403] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:43.870429  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2379b986cb64c07ad870420d59e3e93" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:43.870847 10398 raft_consensus.cc:3060] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:43.898177 10398 raft_consensus.cc:2749] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eae0fc1c2353497a889fdda2eda53679 for earlier term 4. Current term is 5.
I20260709 13:05:43.906401  9248 catalog_manager.cc:5697] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.979410   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.062762 10178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2598613081aa46f793a217ccf880c19e"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:56498
I20260709 13:05:44.063431 10178 raft_consensus.cc:606] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:44.066859 10178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47b32e90e45f4c73a82822a137702764"
dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
mode: GRACEFUL
new_leader_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:56498
I20260709 13:05:44.067454 10178 raft_consensus.cc:606] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Received request to transfer leadership to TS 2319bdfca4124710b4064192c524a068
I20260709 13:05:44.068564   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:44.070443   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:44.082762 10398 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.083379 10398 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:44.086302  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:44.086423  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:44.087035  9493 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 4.
I20260709 13:05:44.088210 10398 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:44.090162 10129 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: e3b7aa42b8924e21bbeb620671e29bd0
I20260709 13:05:44.091004 10705 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.091378 10705 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.091706 10705 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.102376 10705 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:44.106832  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:44.107481  9493 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.120071 10705 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225)
I20260709 13:05:44.122078  9493 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae0fc1c2353497a889fdda2eda53679 in term 5.
I20260709 13:05:44.123694  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "eae0fc1c2353497a889fdda2eda53679" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:44.123936 10129 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:44.125028 10705 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:44.125834 10705 raft_consensus.cc:697] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Becoming Leader. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:44.126835 10705 consensus_queue.cc:237] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:44.135978  9425 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:44.136436  9425 pending_rounds.cc:85] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Aborting all ops after (but not including) 2
I20260709 13:05:44.136655  9425 pending_rounds.cc:107] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:44.136878  9425 raft_consensus.cc:2889] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:44.142544 10705 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.145700  9248 catalog_manager.cc:5697] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eae0fc1c2353497a889fdda2eda53679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.181813  9493 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:44.184877 10706 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.191799 10585 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:44.192413 10585 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:44.194568 10585 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:44.200918 10178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eae0fc1c2353497a889fdda2eda53679" is_pre_election: true
I20260709 13:05:44.218372  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:44.219401  9493 raft_consensus.cc:2368] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 4. Current term is 5.
I20260709 13:05:44.221153  9540 leader_election.cc:400] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 4. Current term is 5.
I20260709 13:05:44.221524  9540 leader_election.cc:403] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.222772 10698 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.233839 10698 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127) with higher term. Message: Invalid argument: T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 for earlier term 4. Current term is 5.
I20260709 13:05:44.270991 10182 raft_consensus.cc:1275] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:44.282796 10557 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.347772  9495 raft_consensus.cc:1275] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:44.349351 10699 consensus_queue.cc:1048] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.477164 10706 raft_consensus.cc:993] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:44.478967 10705 raft_consensus.cc:1081] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:44.480980  9493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2598613081aa46f793a217ccf880c19e"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:49706
I20260709 13:05:44.481628  9493 raft_consensus.cc:493] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.482024  9493 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.494192  9493 raft_consensus.cc:515] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.497263 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:44.497978 10182 raft_consensus.cc:3055] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.498323 10182 raft_consensus.cc:740] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:44.499230 10182 consensus_queue.cc:260] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.500528 10182 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.521590 10182 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:44.523386  9465 leader_election.cc:304] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:44.524338 10556 raft_consensus.cc:2804] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.524875 10556 raft_consensus.cc:697] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:44.525744 10556 consensus_queue.cc:237] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.531847  9493 leader_election.cc:290] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:44.541496  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2598613081aa46f793a217ccf880c19e" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:44.542246  9425 raft_consensus.cc:3060] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.555517  9425 raft_consensus.cc:2468] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:44.578109  9248 catalog_manager.cc:5697] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.597240  9572 raft_consensus.cc:1275] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:44.602664 10705 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.621325  9493 raft_consensus.cc:1275] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Refusing update from remote peer eae0fc1c2353497a889fdda2eda53679: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:44.623003 10705 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.677724 10707 raft_consensus.cc:993] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679: : Instructing follower 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:44.678259 10707 raft_consensus.cc:1081] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Signalling peer 2319bdfca4124710b4064192c524a068 to start an election
I20260709 13:05:44.687222  9495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47b32e90e45f4c73a82822a137702764"
dest_uuid: "2319bdfca4124710b4064192c524a068"
 from {username='slave'} at 127.0.0.1:49706
I20260709 13:05:44.687959  9495 raft_consensus.cc:493] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.689006  9495 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.754057  9495 raft_consensus.cc:515] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.757090 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eae0fc1c2353497a889fdda2eda53679"
I20260709 13:05:44.757683 10182 raft_consensus.cc:3055] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.758049 10182 raft_consensus.cc:740] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eae0fc1c2353497a889fdda2eda53679, State: Running, Role: LEADER
I20260709 13:05:44.758236  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b32e90e45f4c73a82822a137702764" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:44.758812  9425 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.758824 10182 consensus_queue.cc:260] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.760145 10182 raft_consensus.cc:3060] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.766360 10182 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:44.767823  9465 leader_election.cc:304] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679; no voters: 
I20260709 13:05:44.768625  9425 raft_consensus.cc:2468] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:44.769490  9495 leader_election.cc:290] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:44.770730 10556 raft_consensus.cc:2804] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.771565 10556 raft_consensus.cc:697] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:44.772571 10556 consensus_queue.cc:237] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:44.812203  9248 catalog_manager.cc:5697] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.004164  9425 raft_consensus.cc:1275] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.006341 10547 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.010561 10182 raft_consensus.cc:1275] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.012735 10569 consensus_queue.cc:1048] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.071502   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.174289   431 tablet_server.cc:179] TabletServer@127.0.107.193:33181 shutting down...
W20260709 13:05:45.202096  9465 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 18 similar messages]
W20260709 13:05:45.222007  9465 consensus_peers.cc:597] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.263942   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:45.266865  9539 consensus_peers.cc:597] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.265296   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:45.267544  9539 consensus_peers.cc:597] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.268229   431 raft_consensus.cc:2243] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.268924   431 raft_consensus.cc:2272] T 2f6cf54da48346c28143eaad060b9ccb P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.272166   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.274247   431 raft_consensus.cc:2243] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.274784   431 raft_consensus.cc:2272] T 867c2d023234405b9cf88b5b0812f09b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.277737   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:45.278029  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.278620   431 raft_consensus.cc:2243] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.279733   431 raft_consensus.cc:2272] T 85690a80dd3046bca704808f907ec24c P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.282747   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.283668   431 raft_consensus.cc:2243] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.286396   431 raft_consensus.cc:2272] T acc97c47c7054b42b01d2541e311211f P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.289544   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.290604   431 raft_consensus.cc:2243] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.291790   431 raft_consensus.cc:2272] T 8d5b44dd93e242a2972ad2926225583d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.295029   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.296151   431 raft_consensus.cc:2243] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.296769   431 raft_consensus.cc:2272] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.299762   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.300698   431 raft_consensus.cc:2243] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.301807   431 raft_consensus.cc:2272] T 59044d7cb08e42079f85266aaa548e2a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.304930   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.305750   431 raft_consensus.cc:2243] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.306265   431 raft_consensus.cc:2272] T c2379b986cb64c07ad870420d59e3e93 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.311342   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.312266   431 raft_consensus.cc:2243] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.315289   431 raft_consensus.cc:2272] T 8ae838928be04675a8741bd898683d34 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.318475   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.319389   431 raft_consensus.cc:2243] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.329392  9423 raft_consensus.cc:1275] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.329813   431 raft_consensus.cc:2272] T 9832319718e143058c54278ed4f330ae P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.331440 10556 consensus_queue.cc:1048] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:45.332929   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.333897   431 raft_consensus.cc:2243] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.334422   431 raft_consensus.cc:2272] T f812886de1104bf391487c26fbadfd1f P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.346248   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.347195   431 raft_consensus.cc:2243] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.347769   431 raft_consensus.cc:2272] T 191f9b27ce534ccba550f1ec90d42114 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.350036  9539 consensus_peers.cc:597] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.360051  9391 consensus_peers.cc:597] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.362779   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.363826   431 raft_consensus.cc:2243] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.364382   431 raft_consensus.cc:2272] T 776de67e897f4c53aab91cb04628fd1b P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.368181   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.369082   431 raft_consensus.cc:2243] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.370069   431 raft_consensus.cc:2272] T b3e8e061f8c943a98676c36322363053 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.372749   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:45.372869  9465 consensus_peers.cc:597] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.373538  9465 consensus_peers.cc:597] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.373538   431 raft_consensus.cc:2243] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.375793   431 raft_consensus.cc:2272] T 1786e708043842a3884b58092b23b91b P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.378557   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.379642   431 raft_consensus.cc:2243] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.380192   431 raft_consensus.cc:2272] T 47b32e90e45f4c73a82822a137702764 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.386166   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.387085   431 raft_consensus.cc:2243] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.388926   431 raft_consensus.cc:2272] T d1f556aa1381434c93d58d5e4827c8ef P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.391642   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.400256   431 raft_consensus.cc:2243] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.401348   431 raft_consensus.cc:2272] T a465b137da5e49fb9465b378d628cac9 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.403723  9539 consensus_peers.cc:597] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.404393   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.405336   431 raft_consensus.cc:2243] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.405884   431 raft_consensus.cc:2272] T 5f8e0525be1147f4827361f2bd94ff3b P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.413053   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.413980   431 raft_consensus.cc:2243] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.414568   431 raft_consensus.cc:2272] T 7191b50632234abe9017c3d7f8cd9879 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.417870   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.418737   431 raft_consensus.cc:2243] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.419323   431 raft_consensus.cc:2272] T 3258bebb55ec437b935b7b7e8f192ded P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.431279  9465 consensus_peers.cc:597] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.431890  9539 consensus_peers.cc:597] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.433320  9539 consensus_peers.cc:597] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.433812  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 73043.7us
I20260709 13:05:45.435022   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.435997   431 raft_consensus.cc:2243] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.436574   431 raft_consensus.cc:2272] T 5ee539e5ae0140c097952f76679d785d P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.439476   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.440349   431 raft_consensus.cc:2243] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.440923   431 raft_consensus.cc:2272] T 08ae14c90ac540308e971d9148ceb222 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.443905   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.444823   431 raft_consensus.cc:2243] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.445416   431 raft_consensus.cc:2272] T 6894e48d005e4cabb8a0482567ba71de P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.448689   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.453878   431 raft_consensus.cc:2243] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.454787   431 raft_consensus.cc:2272] T 852931ef972a4b4d835cf4238e0a194e P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.458287   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.459209   431 raft_consensus.cc:2243] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.459741   431 raft_consensus.cc:2272] T 50c24c026c7048d9847a58777efe8770 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.462879  9465 consensus_peers.cc:597] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.463240   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.464185   431 raft_consensus.cc:2243] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.464747   431 raft_consensus.cc:2272] T 9c5f31b62d11440182534d9ea52a469c P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.466637  9391 consensus_peers.cc:597] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.467583   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.468508   431 raft_consensus.cc:2243] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.469026   431 raft_consensus.cc:2272] T dd8f83a10da7493282e02784080114a7 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.469404  9391 consensus_peers.cc:597] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.471910   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.472879   431 raft_consensus.cc:2243] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.473392   431 raft_consensus.cc:2272] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.475682  9391 consensus_peers.cc:597] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.476460   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.477393   431 raft_consensus.cc:2243] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:45.477761  9391 consensus_peers.cc:597] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.477950   431 raft_consensus.cc:2272] T 676c09e0537147d886a1c9236674359a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.482280   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.483371   431 raft_consensus.cc:2243] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Raft consensus shutting down.
W20260709 13:05:45.484233  9391 consensus_peers.cc:597] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.484515   431 raft_consensus.cc:2272] T bf68916785184cb081d3032e1da7db46 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.487947   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.488898   431 raft_consensus.cc:2243] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.489449   431 raft_consensus.cc:2272] T eb3c57d630a44e97be12c1acca969da6 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.492681   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.493546   431 raft_consensus.cc:2243] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:05:45.494118  9391 consensus_peers.cc:597] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.494917   431 raft_consensus.cc:2272] T 8541dc1cb441446a86bd73a864b794e0 P eae0fc1c2353497a889fdda2eda53679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.497867   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:45.497848  9465 consensus_peers.cc:597] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.498896  9391 consensus_peers.cc:597] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.498980   431 raft_consensus.cc:2243] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.499835   431 raft_consensus.cc:2272] T ebd83b93312541268dff3bd7a85eec65 P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.505870   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.506621   431 raft_consensus.cc:2243] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.507109   431 raft_consensus.cc:2272] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.510035   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.510787   431 raft_consensus.cc:2243] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.511400   431 raft_consensus.cc:2272] T f607d360325242ad9ca1ce2b690f164a P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.515580   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.516408   431 raft_consensus.cc:2243] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.517596   431 raft_consensus.cc:2272] T e7b2ff13398e4613a307e29028dc5560 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.517725  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.520879   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.521842   431 raft_consensus.cc:2243] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.523188   431 raft_consensus.cc:2272] T 1f73ab9ca562450b8098926bae7ab820 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.526188   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.526993   431 raft_consensus.cc:2243] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:45.527133  9465 consensus_peers.cc:597] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.527592   431 raft_consensus.cc:2272] T 2598613081aa46f793a217ccf880c19e P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.532661   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.533423   431 raft_consensus.cc:2243] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.535422   431 raft_consensus.cc:2272] T fff33ba3467b4aa5ac7085e94405a30c P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.538319   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.539033   431 raft_consensus.cc:2243] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.540081   431 raft_consensus.cc:2272] T 55f160c0257440b5aae393b6a1d76f90 P eae0fc1c2353497a889fdda2eda53679 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.544226   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.545236   431 raft_consensus.cc:2243] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:45.545886  9391 consensus_peers.cc:597] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.546384   431 raft_consensus.cc:2272] T 301c8e3a2e3c4e10bea6d3bee8752338 P eae0fc1c2353497a889fdda2eda53679 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.546978  9465 consensus_peers.cc:597] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.549629   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.550510   431 raft_consensus.cc:2243] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:45.551649   431 raft_consensus.cc:2272] T d708b40047da45dba2adaacf9a0c4b30 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.554694   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.555244   431 raft_consensus.cc:2243] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.555728   431 raft_consensus.cc:2272] T 0aee84f299b340bbad1f7999d6bb35b7 P eae0fc1c2353497a889fdda2eda53679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:45.559615   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:45.560395   431 raft_consensus.cc:2243] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:45.562032   431 raft_consensus.cc:2272] T 3394a244b95c412a9b0d4a2db10fc64a P eae0fc1c2353497a889fdda2eda53679 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:45.571113  9391 consensus_peers.cc:597] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.664134  9465 consensus_peers.cc:597] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.707451  9465 consensus_peers.cc:597] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.714555  9465 consensus_peers.cc:597] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:45.770213  9539 consensus_peers.cc:597] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:46.078552  9390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44225, user_credentials={real_user=slave}} blocked reactor thread for 49655.7us
I20260709 13:05:46.376344 10585 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.376948 10585 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.386155 10632 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.386844 10632 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:46.395483  9391 leader_election.cc:336] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.402050 10585 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.404860  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.406519  9392 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.407404 10700 raft_consensus.cc:2749] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.408214 10632 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:46.412612  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:46.415899  9539 leader_election.cc:336] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.417281  9539 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.418733 10585 raft_consensus.cc:2749] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.461331 10700 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.461992 10700 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.465631  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.464233 10700 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:46.472169  9391 leader_election.cc:336] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.472668  9391 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.473467 10632 raft_consensus.cc:2749] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:46.533596 10700 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.534286 10700 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.536366 10569 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.538450 10569 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.543352  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.545430 10569 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.547741 10700 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:46.549474  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
W20260709 13:05:46.559932  9465 leader_election.cc:336] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.560647  9465 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.561581 10569 raft_consensus.cc:2749] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.564021 10569 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.564545 10569 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.566955 10569 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:46.570185  9391 leader_election.cc:336] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.570742  9391 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.579022 10700 raft_consensus.cc:2749] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.576596  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:46.577445 10585 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.581317  9425 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:46.581558 10585 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:46.584853  9465 leader_election.cc:336] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.585872  9465 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.586653 10569 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.587005 10569 raft_consensus.cc:493] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.587169 10556 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.587371 10569 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.587837 10556 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.590224 10556 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.590924 10556 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.591392 10556 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.594179  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.594367 10556 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.594828  9572 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:46.597342  9464 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:46.600107 10556 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.600544 10556 raft_consensus.cc:493] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.600947 10556 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.607437 10585 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.608319  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.615865  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:46.617285 10569 raft_consensus.cc:515] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:46.621732  9539 leader_election.cc:336] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.626243 10700 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.632300 10700 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:46.628126  9465 leader_election.cc:336] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.636929  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.638664 10700 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
W20260709 13:05:46.648471  9391 leader_election.cc:336] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.649052  9391 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.631621 10569 leader_election.cc:290] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:46.649653   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10205)
I20260709 13:05:46.651100 10632 raft_consensus.cc:2749] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.666962 10700 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.668432 10700 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.673650 10569 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.674314 10569 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.671195 10700 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.680815 10569 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:46.683633  9391 leader_election.cc:336] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.687758 10585 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.688496 10585 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.690948 10585 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.691810  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.693632 10585 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.693938  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.694438 10585 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.696520  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.697232  9572 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:46.699236 10585 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.709654  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.711933  9390 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.713565 10738 raft_consensus.cc:2804] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.714088 10738 raft_consensus.cc:493] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.714537 10738 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.635183  9465 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.730953 10569 raft_consensus.cc:2749] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.731168 10585 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.731918 10585 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:46.732144  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 104108us
W20260709 13:05:46.733273  9465 leader_election.cc:336] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.734685 10585 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.736084 10739 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.736786 10739 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.738711 10569 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.739167 10569 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.740895 10569 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.740793  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.744454  9495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.744979  9495 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:46.746024  9540 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
W20260709 13:05:46.746496  9391 leader_election.cc:336] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.746855 10702 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.747061  9391 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.747347 10702 raft_consensus.cc:493] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.747769 10702 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.747989 10739 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:46.748661 10700 raft_consensus.cc:2749] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:46.750839 10738 raft_consensus.cc:515] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.751909 10569 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.752417 10569 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.752801 10556 raft_consensus.cc:515] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.753985  9493 raft_consensus.cc:2393] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 3: Already voted for candidate 2319bdfca4124710b4064192c524a068 in this term.
I20260709 13:05:46.759158 10556 leader_election.cc:290] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.764254 10569 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.765597  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85690a80dd3046bca704808f907ec24c" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:46.766320  9425 raft_consensus.cc:3060] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.768008 10738 leader_election.cc:290] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.770493 10739 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.771176 10739 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.774219 10739 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:46.781334  9391 leader_election.cc:336] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.785780  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59044d7cb08e42079f85266aaa548e2a" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:46.786046  9570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.786437 10585 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.786604  9572 raft_consensus.cc:3060] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.786965 10585 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.789489 10585 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.790211 10569 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.790940 10569 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.795158  9572 raft_consensus.cc:2468] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:46.803429  9569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.804323  9540 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.804418  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
W20260709 13:05:46.801702  9539 leader_election.cc:336] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.805210  9568 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:46.805357  9539 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.806438  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5b44dd93e242a2972ad2926225583d" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:46.808125  9572 raft_consensus.cc:3060] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.811249 10726 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.812338 10726 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.814445 10726 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.815284 10698 raft_consensus.cc:2749] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:46.816440  9539 leader_election.cc:336] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.816870  9539 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 2319bdfca4124710b4064192c524a068, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.818212 10698 raft_consensus.cc:2749] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.820402  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:46.821120  9493 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 4.
I20260709 13:05:46.821208  9572 raft_consensus.cc:2468] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:46.797871 10569 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:46.821376  9465 leader_election.cc:336] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.822165 10585 raft_consensus.cc:2749] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:46.822562  9465 leader_election.cc:336] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.823020  9465 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
W20260709 13:05:46.823976  9465 leader_election.cc:336] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.824271 10726 raft_consensus.cc:2749] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.807688 10702 raft_consensus.cc:515] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.827675 10702 leader_election.cc:290] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.829129 10585 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.829905 10698 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.830276  9540 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:46.830451 10698 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.832929 10698 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.834074 10698 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.807448  9425 raft_consensus.cc:2468] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
W20260709 13:05:46.799901  9391 leader_election.cc:336] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:46.871632  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f556aa1381434c93d58d5e4827c8ef" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:46.833262 10585 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.873245  9493 raft_consensus.cc:3060] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.891219 10585 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.880872  9423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:46.867898 10700 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.892575  9423 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 2.
I20260709 13:05:46.892649 10700 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.882179  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:46.834365 10698 raft_consensus.cc:493] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.894156 10698 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.894340 10569 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.894224  9427 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:46.883975  9464 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:46.895219 10569 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.895589 10700 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.896653  9464 leader_election.cc:304] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:46.898746 10556 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:46.899348 10556 raft_consensus.cc:493] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.899813 10556 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.900377  9465 leader_election.cc:304] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.881852  9390 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.904237 10741 raft_consensus.cc:2804] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:46.904593  9540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 74284.5us
I20260709 13:05:46.904986 10741 raft_consensus.cc:697] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:46.897848 10569 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:46.906826 10741 consensus_queue.cc:237] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:46.873454  9391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 72757.3us
I20260709 13:05:46.910239  9390 leader_election.cc:304] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:46.912760 10726 raft_consensus.cc:2804] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.913623 10726 raft_consensus.cc:697] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:46.916568 10738 raft_consensus.cc:2804] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.916491 10726 consensus_queue.cc:237] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.917266 10738 raft_consensus.cc:697] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:46.918823 10738 consensus_queue.cc:237] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:46.923853  9493 raft_consensus.cc:2468] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
I20260709 13:05:46.934643  9540 leader_election.cc:304] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:46.908113 10700 raft_consensus.cc:2749] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.950578 10742 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.951686 10739 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.951561 10742 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.952775 10739 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.954521 10742 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.955205 10585 raft_consensus.cc:2804] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:46.955806 10585 raft_consensus.cc:697] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:46.957017 10739 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:46.957297 10585 consensus_queue.cc:237] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.958179 10743 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:46.959115 10743 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:46.961145  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:46.969923 10556 raft_consensus.cc:515] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:46.973359 10556 leader_election.cc:290] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:46.986120 10743 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:46.988349  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 88445.1us
I20260709 13:05:46.976049  9572 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 5.
I20260709 13:05:47.008023  9390 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.016558  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "301c8e3a2e3c4e10bea6d3bee8752338" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:47.017554  9568 raft_consensus.cc:3060] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.014060 10739 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:47.030766 10739 raft_consensus.cc:493] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.031284 10739 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.021750 10743 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.044520 10743 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.047447 10743 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:47.051301  9465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34067, user_credentials={real_user=slave}} blocked reactor thread for 59329.5us
I20260709 13:05:47.056843  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:47.057821  9492 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 2.
I20260709 13:05:47.058753  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068" is_pre_election: true
I20260709 13:05:47.059820  9493 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 2.
I20260709 13:05:47.064988  9392 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
W20260709 13:05:47.061295  9391 leader_election.cc:336] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.066253 10738 raft_consensus.cc:2804] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:47.066673  9391 leader_election.cc:336] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.067694  9572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" is_pre_election: true
I20260709 13:05:47.068802  9572 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 5.
I20260709 13:05:47.066756 10738 raft_consensus.cc:493] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.069761 10738 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.083920  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.084929 10569 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:47.085278 10569 raft_consensus.cc:493] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.085578 10569 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.086024 10738 raft_consensus.cc:515] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.086143 10739 raft_consensus.cc:515] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:47.088856 10738 leader_election.cc:290] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127)
I20260709 13:05:47.087338  9249 catalog_manager.cc:5697] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.094519 10569 raft_consensus.cc:515] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.094444  9250 catalog_manager.cc:5697] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.103601  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b2ff13398e4613a307e29028dc5560" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:47.105644  9540 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.105698  9492 raft_consensus.cc:3060] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.106662 10742 raft_consensus.cc:2804] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.107084 10742 raft_consensus.cc:493] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.107477 10742 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.108728 10569 leader_election.cc:290] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:47.113790  9575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f160c0257440b5aae393b6a1d76f90" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:47.114519  9575 raft_consensus.cc:3060] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.118014  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:47.118952  9427 raft_consensus.cc:2393] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b7aa42b8924e21bbeb620671e29bd0 in current term 6: Already voted for candidate 35817eed7a6449bc913deabeec3a66a2 in this term.
I20260709 13:05:47.120077 10739 leader_election.cc:290] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 election: Requested vote from peers e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196:44225), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
W20260709 13:05:47.121551  9539 leader_election.cc:336] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.122954 10742 raft_consensus.cc:515] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.142318  9575 raft_consensus.cc:2468] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 6.
I20260709 13:05:47.131278  9492 raft_consensus.cc:2468] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 3.
I20260709 13:05:47.142536 10742 leader_election.cc:290] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:47.155622  9427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
W20260709 13:05:47.156332  9391 leader_election.cc:336] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.156651  9427 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 5.
W20260709 13:05:47.160917  9391 leader_election.cc:336] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.162155  9392 leader_election.cc:304] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:47.163089 10738 raft_consensus.cc:2804] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.163570 10738 raft_consensus.cc:697] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:47.164665 10738 consensus_queue.cc:237] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.165797  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.054486 10698 raft_consensus.cc:515] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.171736 10698 leader_election.cc:290] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 election: Requested vote from peers 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127), eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181)
I20260709 13:05:47.171478  9248 catalog_manager.cc:5697] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.173652  9568 raft_consensus.cc:2468] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:47.175689  9465 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:47.175824  9464 leader_election.cc:304] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.177618 10753 raft_consensus.cc:2804] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:47.178185 10753 raft_consensus.cc:697] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 6 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.178966  9492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f73ab9ca562450b8098926bae7ab820" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:47.179698  9492 raft_consensus.cc:3060] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.179327 10753 consensus_queue.cc:237] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.181823  9465 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.185472 10569 raft_consensus.cc:2804] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:47.185891 10569 raft_consensus.cc:493] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.186285 10569 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.189630 10741 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.190119 10741 raft_consensus.cc:493] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.190508 10741 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.192335 10746 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:47.192865 10746 raft_consensus.cc:493] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.193282 10746 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.195238  9492 raft_consensus.cc:2468] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 3.
W20260709 13:05:47.196370  9465 leader_election.cc:336] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.192407  9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff33ba3467b4aa5ac7085e94405a30c" candidate_uuid: "35817eed7a6449bc913deabeec3a66a2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3b7aa42b8924e21bbeb620671e29bd0"
I20260709 13:05:47.198660  9568 raft_consensus.cc:3060] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:47.206787  9465 leader_election.cc:336] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.207424  9465 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2319bdfca4124710b4064192c524a068; no voters: e3b7aa42b8924e21bbeb620671e29bd0, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:47.210665 10569 raft_consensus.cc:515] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.213660 10751 raft_consensus.cc:2749] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:47.215422  9465 leader_election.cc:336] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.216645  9465 leader_election.cc:336] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.219643  9493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e8e061f8c943a98676c36322363053" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2319bdfca4124710b4064192c524a068"
I20260709 13:05:47.220554  9493 raft_consensus.cc:3060] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.224325  9464 leader_election.cc:304] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.229537 10754 raft_consensus.cc:2804] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.229364 10741 raft_consensus.cc:515] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.230227 10754 raft_consensus.cc:697] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.230229  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:47.231426 10754 consensus_queue.cc:237] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.232532  9418 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
I20260709 13:05:47.233975  9493 raft_consensus.cc:2468] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 5.
I20260709 13:05:47.237381  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2" is_pre_election: true
I20260709 13:05:47.238217  9419 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
W20260709 13:05:47.234822  9539 leader_election.cc:336] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.246351 10569 leader_election.cc:290] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:47.257786  9568 raft_consensus.cc:2468] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35817eed7a6449bc913deabeec3a66a2 in term 6.
I20260709 13:05:47.263236 10746 raft_consensus.cc:515] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:47.276540  9539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33181, user_credentials={real_user=slave}} blocked reactor thread for 57939.5us
I20260709 13:05:47.280287 10741 leader_election.cc:290] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:47.250010  9540 leader_election.cc:304] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.289656  9540 leader_election.cc:304] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
I20260709 13:05:47.291875 10747 raft_consensus.cc:2804] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.292579 10747 raft_consensus.cc:697] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:47.293802 10746 leader_election.cc:290] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:47.293627 10747 consensus_queue.cc:237] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
W20260709 13:05:47.288836  9539 leader_election.cc:336] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.301762  9539 leader_election.cc:336] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.302208  9539 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b7aa42b8924e21bbeb620671e29bd0; no voters: 35817eed7a6449bc913deabeec3a66a2, eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:47.306175  9390 leader_election.cc:304] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: eae0fc1c2353497a889fdda2eda53679
I20260709 13:05:47.307399 10738 raft_consensus.cc:2804] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:47.308158 10738 raft_consensus.cc:697] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 LEADER]: Becoming Leader. State: Replica: 35817eed7a6449bc913deabeec3a66a2, State: Running, Role: LEADER
I20260709 13:05:47.311167 10742 raft_consensus.cc:2749] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.311383 10738 consensus_queue.cc:237] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
I20260709 13:05:47.308900 10746 raft_consensus.cc:2804] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:47.326172  9391 consensus_peers.cc:597] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.321058 10746 raft_consensus.cc:697] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:47.331243 10746 consensus_queue.cc:237] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } }
I20260709 13:05:47.341441  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541dc1cb441446a86bd73a864b794e0" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:47.342082  9418 raft_consensus.cc:3060] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.342334  9465 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.343204  9465 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.344498  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9832319718e143058c54278ed4f330ae" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:47.345203  9419 raft_consensus.cc:3060] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.348330 10754 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.348873 10753 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:47.348886 10754 raft_consensus.cc:493] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.349293 10753 raft_consensus.cc:493] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eae0fc1c2353497a889fdda2eda53679)
I20260709 13:05:47.349926 10753 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.356191 10754 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.363066  9418 raft_consensus.cc:2468] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 5.
W20260709 13:05:47.378129  9465 leader_election.cc:336] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.379271  9465 leader_election.cc:336] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.375308 10753 raft_consensus.cc:515] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.383455  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf68916785184cb081d3032e1da7db46" candidate_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:47.388617  9425 raft_consensus.cc:3060] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.386533  9419 raft_consensus.cc:2468] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 3.
W20260709 13:05:47.391436  9539 leader_election.cc:336] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.393074 10753 leader_election.cc:290] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
W20260709 13:05:47.393988  9539 leader_election.cc:336] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.399339  9425 raft_consensus.cc:2468] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b7aa42b8924e21bbeb620671e29bd0 in term 6.
W20260709 13:05:47.401145  9539 leader_election.cc:336] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.407369 10754 raft_consensus.cc:515] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:47.408644  9465 leader_election.cc:336] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.409453  9465 leader_election.cc:336] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.409919  9539 leader_election.cc:304] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35817eed7a6449bc913deabeec3a66a2, e3b7aa42b8924e21bbeb620671e29bd0; no voters: 
W20260709 13:05:47.410396  9465 leader_election.cc:336] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.410789 10742 raft_consensus.cc:2804] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:47.411223 10742 raft_consensus.cc:697] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 LEADER]: Becoming Leader. State: Replica: e3b7aa42b8924e21bbeb620671e29bd0, State: Running, Role: LEADER
I20260709 13:05:47.414252 10754 leader_election.cc:290] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Requested vote from peers eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181), 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067)
I20260709 13:05:47.414137 10742 consensus_queue.cc:237] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } }
W20260709 13:05:47.419257  9539 leader_election.cc:336] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.419387  9425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465b137da5e49fb9465b378d628cac9" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
W20260709 13:05:47.420552  9539 leader_election.cc:336] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.420835  9425 raft_consensus.cc:3060] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.431062  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d708b40047da45dba2adaacf9a0c4b30" candidate_uuid: "2319bdfca4124710b4064192c524a068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35817eed7a6449bc913deabeec3a66a2"
I20260709 13:05:47.431773  9419 raft_consensus.cc:3060] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.435748  9570 raft_consensus.cc:1275] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.439652 10738 consensus_queue.cc:1048] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.447451  9425 raft_consensus.cc:2468] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
I20260709 13:05:47.468417  9465 leader_election.cc:304] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.469478  9465 leader_election.cc:304] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.470302  9465 leader_election.cc:304] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.470645 10726 raft_consensus.cc:2804] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:47.455848  9419 raft_consensus.cc:2468] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2319bdfca4124710b4064192c524a068 in term 4.
W20260709 13:05:47.474447  9465 leader_election.cc:336] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.475320  9465 leader_election.cc:336] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.476431  9465 consensus_peers.cc:597] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.477525 10569 raft_consensus.cc:2804] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.478193 10569 raft_consensus.cc:697] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.479118 10569 consensus_queue.cc:237] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.480206 10556 raft_consensus.cc:2804] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.480792 10556 raft_consensus.cc:697] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.481793 10556 consensus_queue.cc:237] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.484467 10726 raft_consensus.cc:697] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 5 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.484594  9465 leader_election.cc:304] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2319bdfca4124710b4064192c524a068, 35817eed7a6449bc913deabeec3a66a2; no voters: 
I20260709 13:05:47.485924 10726 consensus_queue.cc:237] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
I20260709 13:05:47.488234 10752 raft_consensus.cc:2804] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:47.489069 10752 raft_consensus.cc:697] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Becoming Leader. State: Replica: 2319bdfca4124710b4064192c524a068, State: Running, Role: LEADER
I20260709 13:05:47.493153 10752 consensus_queue.cc:237] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } }
W20260709 13:05:47.515117  9465 leader_election.cc:336] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
W20260709 13:05:47.516081  9465 leader_election.cc:336] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111)
I20260709 13:05:47.522595  9570 raft_consensus.cc:1275] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.526496 10751 consensus_queue.cc:1048] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:47.551724  9465 consensus_peers.cc:597] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.552291  9465 consensus_peers.cc:597] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.579645  9493 raft_consensus.cc:1275] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.577692  9250 catalog_manager.cc:5697] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.581238  9419 raft_consensus.cc:1275] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.586532 10751 consensus_queue.cc:1048] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.587419 10746 consensus_queue.cc:1048] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.582100  9250 catalog_manager.cc:5697] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 reported cstate change: term changed from 5 to 6, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "35817eed7a6449bc913deabeec3a66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:47.603434  9539 consensus_peers.cc:597] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.579231  9249 catalog_manager.cc:5697] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.614602  9249 catalog_manager.cc:5697] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 4 to 5, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.617568  9249 catalog_manager.cc:5697] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 5 to 6, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to e3b7aa42b8924e21bbeb620671e29bd0 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.625268  9493 raft_consensus.cc:1275] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:47.668498   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10205)
W20260709 13:05:47.660799  9392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34127, user_credentials={real_user=slave}} blocked reactor thread for 47975.3us
I20260709 13:05:47.685026  9575 raft_consensus.cc:1275] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.700244 10741 consensus_queue.cc:1048] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:05:47.724010  9465 consensus_peers.cc:597] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.744771  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:47.745368  9539 consensus_peers.cc:597] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:47.776600  9539 consensus_peers.cc:597] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:47.779764  9539 consensus_peers.cc:597] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.780337  9539 consensus_peers.cc:597] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.780217  9391 consensus_peers.cc:597] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:47.789932  9391 consensus_peers.cc:597] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.796782 10778 consensus_queue.cc:1048] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:05:47.805202  9249 catalog_manager.cc:5697] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } }
W20260709 13:05:47.809019  9391 consensus_peers.cc:597] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.831262  9569 raft_consensus.cc:1275] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:47.839473  9391 consensus_peers.cc:597] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.840438  9493 raft_consensus.cc:1275] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:47.842284 10752 consensus_queue.cc:1048] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:05:47.852120  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.861868  9248 catalog_manager.cc:5697] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } } }
I20260709 13:05:47.868435 10780 consensus_queue.cc:1048] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:05:47.873488  9391 consensus_peers.cc:597] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:47.874948  9493 raft_consensus.cc:1275] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:05:47.896430  9539 consensus_peers.cc:597] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.907317  9465 consensus_peers.cc:597] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:47.908499 10785 log.cc:927] Time spent T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:05:47.914144  9391 consensus_peers.cc:597] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.886615 10780 consensus_queue.cc:1048] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:05:47.907892  9465 consensus_peers.cc:597] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:47.930981  9465 consensus_peers.cc:597] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.932446  9570 raft_consensus.cc:1275] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Refusing update from remote peer 35817eed7a6449bc913deabeec3a66a2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:05:47.935707  9391 consensus_peers.cc:597] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.937829  9419 raft_consensus.cc:1275] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:47.939991  9391 consensus_peers.cc:597] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:47.949971 10741 consensus_queue.cc:1048] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.951563 10782 consensus_queue.cc:1048] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:47.951144  9248 catalog_manager.cc:5697] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 3 to 4, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.967679  9248 catalog_manager.cc:5697] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 2 to 3, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.969830  9248 catalog_manager.cc:5697] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 5 to 6, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b7aa42b8924e21bbeb620671e29bd0" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.972330  9248 catalog_manager.cc:5697] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 3 to 4, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.981853  9248 catalog_manager.cc:5697] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 reported cstate change: term changed from 4 to 5, leader changed from eae0fc1c2353497a889fdda2eda53679 (127.0.107.193) to 2319bdfca4124710b4064192c524a068 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "2319bdfca4124710b4064192c524a068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae0fc1c2353497a889fdda2eda53679" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2319bdfca4124710b4064192c524a068" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34127 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.025172  9419 raft_consensus.cc:1275] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Refusing update from remote peer e3b7aa42b8924e21bbeb620671e29bd0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:05:48.026571  9391 consensus_peers.cc:597] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.029356  9465 consensus_peers.cc:597] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:48.034202  9465 consensus_peers.cc:597] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:48.038844  9423 raft_consensus.cc:1275] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:48.041392 10726 consensus_queue.cc:1048] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.029403 10780 consensus_queue.cc:1048] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:05:48.065476  9539 consensus_peers.cc:597] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.065101  9465 consensus_peers.cc:597] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:48.117949  9465 consensus_peers.cc:597] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:48.119647  9465 consensus_peers.cc:597] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.120693  9391 consensus_peers.cc:597] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:48.122926  9423 raft_consensus.cc:1275] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:48.124936 10751 consensus_queue.cc:1048] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:48.154033  9539 consensus_peers.cc:597] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.154700  9539 consensus_peers.cc:597] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.165448  9391 consensus_peers.cc:597] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:48.178805  9419 raft_consensus.cc:1275] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Refusing update from remote peer 2319bdfca4124710b4064192c524a068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:48.182080  9465 consensus_peers.cc:597] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:48.184979 10741 consensus_queue.cc:1048] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35817eed7a6449bc913deabeec3a66a2" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:48.270740  9465 consensus_peers.cc:597] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.273437  9465 consensus_peers.cc:597] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.292249  9465 consensus_peers.cc:597] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.293329  9539 consensus_peers.cc:597] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.316381  9391 consensus_peers.cc:597] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.397946  9465 consensus_peers.cc:597] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.425403  9539 consensus_peers.cc:597] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.490715  9465 consensus_peers.cc:597] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.543226  9465 consensus_peers.cc:597] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:48.680780   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10205)
W20260709 13:05:49.681540   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10205)
W20260709 13:05:49.767693  9465 consensus_peers.cc:597] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:49.842203  9391 consensus_peers.cc:597] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:49.864382   431 tablet_server.cc:196] TabletServer@127.0.107.193:33181 shutdown complete.
W20260709 13:05:49.868223  9465 consensus_peers.cc:597] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:49.983719   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:05:50.003284  9539 consensus_peers.cc:597] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.020272  9465 consensus_peers.cc:597] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.032539  9465 consensus_peers.cc:597] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.038611  9539 consensus_peers.cc:597] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:50.046026  9465 consensus_peers.cc:597] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:50.049094  9391 consensus_peers.cc:597] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.050311   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.051280   431 tablet_replica.cc:333] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.052567   431 raft_consensus.cc:2243] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.053766   431 raft_consensus.cc:2272] T c2379b986cb64c07ad870420d59e3e93 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.055671  9465 consensus_peers.cc:597] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.056941   431 tablet_replica.cc:333] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.057767   431 raft_consensus.cc:2243] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.058336   431 raft_consensus.cc:2272] T 6a689cd004db4bbebd7fc4c6c5aecada P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.061339   431 tablet_replica.cc:333] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.062050   431 raft_consensus.cc:2243] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.062881   431 raft_consensus.cc:2272] T e7b2ff13398e4613a307e29028dc5560 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.065376   431 tablet_replica.cc:333] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.066056   431 raft_consensus.cc:2243] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.066942   431 raft_consensus.cc:2272] T dd8f83a10da7493282e02784080114a7 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.069535   431 tablet_replica.cc:333] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.070402   431 raft_consensus.cc:2243] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.070951   431 raft_consensus.cc:2272] T 2f6cf54da48346c28143eaad060b9ccb P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.073647   431 tablet_replica.cc:333] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.074405   431 raft_consensus.cc:2243] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.074946   431 raft_consensus.cc:2272] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.077603   431 tablet_replica.cc:333] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.079130   431 raft_consensus.cc:2243] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.079628   431 raft_consensus.cc:2272] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.082451   431 tablet_replica.cc:333] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.083434   431 raft_consensus.cc:2243] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.083956   431 raft_consensus.cc:2272] T bf68916785184cb081d3032e1da7db46 P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.086809   431 tablet_replica.cc:333] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.087596   431 raft_consensus.cc:2243] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.088217   431 raft_consensus.cc:2272] T 36b02f7bce11408e9641daf8a5ff79ed P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.091161   431 tablet_replica.cc:333] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.091967   431 raft_consensus.cc:2243] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.093282   431 raft_consensus.cc:2272] T f812886de1104bf391487c26fbadfd1f P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.098234   431 tablet_replica.cc:333] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
W20260709 13:05:50.098187  9539 consensus_peers.cc:597] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.099254   431 raft_consensus.cc:2243] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.099906   431 raft_consensus.cc:2272] T 776de67e897f4c53aab91cb04628fd1b P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.102501  9465 consensus_peers.cc:597] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.102648   431 tablet_replica.cc:333] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.104416   431 raft_consensus.cc:2243] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.104977   431 raft_consensus.cc:2272] T 405f4dfd2e604f208c69fcc85c065d0c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.107646  9539 consensus_peers.cc:597] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:50.107698   431 tablet_replica.cc:333] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.108722   431 raft_consensus.cc:2243] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.109630   431 raft_consensus.cc:2272] T 191f9b27ce534ccba550f1ec90d42114 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.111826   431 tablet_replica.cc:333] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.112455   431 raft_consensus.cc:2243] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.113328   431 raft_consensus.cc:2272] T 930e01c56898417191283e02b2ae37c9 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.115943   431 tablet_replica.cc:333] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
W20260709 13:05:50.116463  9465 consensus_peers.cc:597] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.116767   431 raft_consensus.cc:2243] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.117400   431 raft_consensus.cc:2272] T 9c5f31b62d11440182534d9ea52a469c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.119544  9539 consensus_peers.cc:597] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.120121   431 tablet_replica.cc:333] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.120759   431 raft_consensus.cc:2243] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.121212   431 raft_consensus.cc:2272] T 47b32e90e45f4c73a82822a137702764 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.123225   431 tablet_replica.cc:333] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.123940   431 raft_consensus.cc:2243] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.124541   431 raft_consensus.cc:2272] T 57bf6d31f0484d90903e72e4e463f5a0 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.127776   431 tablet_replica.cc:333] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.128609   431 raft_consensus.cc:2243] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:50.129403  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.129559   431 raft_consensus.cc:2272] T 3394a244b95c412a9b0d4a2db10fc64a P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.132221   431 tablet_replica.cc:333] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.132793   431 raft_consensus.cc:2243] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.133617   431 raft_consensus.cc:2272] T eb3c57d630a44e97be12c1acca969da6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.135655   431 tablet_replica.cc:333] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.136397   431 raft_consensus.cc:2243] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.136976   431 raft_consensus.cc:2272] T 8541dc1cb441446a86bd73a864b794e0 P 35817eed7a6449bc913deabeec3a66a2 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.138336  9539 consensus_peers.cc:597] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.139194   431 tablet_replica.cc:333] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.139819   431 raft_consensus.cc:2243] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.140340   431 raft_consensus.cc:2272] T af16b22a6c904b34aef360a0f7cd9e20 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.142199   431 tablet_replica.cc:333] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.142745   431 raft_consensus.cc:2243] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.143493   431 raft_consensus.cc:2272] T ebd83b93312541268dff3bd7a85eec65 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.145505   431 tablet_replica.cc:333] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.146063   431 raft_consensus.cc:2243] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.146816   431 raft_consensus.cc:2272] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.148828   431 tablet_replica.cc:333] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.149403   431 raft_consensus.cc:2243] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.149847   431 raft_consensus.cc:2272] T 2598613081aa46f793a217ccf880c19e P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.151595   431 tablet_replica.cc:333] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.152197   431 raft_consensus.cc:2243] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.152967   431 raft_consensus.cc:2272] T 7c5f2184d23f426b99f302ec643dbf6c P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.155411   431 tablet_replica.cc:333] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.155961   431 raft_consensus.cc:2243] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.156719   431 raft_consensus.cc:2272] T 0d601528765d4c458eac4ca0aa48f348 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.158545   431 tablet_replica.cc:333] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.159128   431 raft_consensus.cc:2243] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.159536   431 raft_consensus.cc:2272] T 22747041983e40adb9eafaae809e7651 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.161718   431 tablet_replica.cc:333] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.162356   431 raft_consensus.cc:2243] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.163039   431 raft_consensus.cc:2272] T 59044d7cb08e42079f85266aaa548e2a P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.165599   431 tablet_replica.cc:333] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.166313   431 raft_consensus.cc:2243] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.167342   431 raft_consensus.cc:2272] T acc97c47c7054b42b01d2541e311211f P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.170140   431 tablet_replica.cc:333] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.170928   431 raft_consensus.cc:2243] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.171977   431 raft_consensus.cc:2272] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.174746   431 tablet_replica.cc:333] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.175426   431 raft_consensus.cc:2243] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.175969   431 raft_consensus.cc:2272] T d708b40047da45dba2adaacf9a0c4b30 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.178248  9391 consensus_peers.cc:597] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.178486   431 tablet_replica.cc:333] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.179303   431 raft_consensus.cc:2243] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.180423   431 raft_consensus.cc:2272] T fff33ba3467b4aa5ac7085e94405a30c P 35817eed7a6449bc913deabeec3a66a2 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.182770   431 tablet_replica.cc:333] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.183384   431 raft_consensus.cc:2243] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.183744   431 raft_consensus.cc:2272] T 0aee84f299b340bbad1f7999d6bb35b7 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.185705   431 tablet_replica.cc:333] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.186251   431 raft_consensus.cc:2243] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.186676   431 raft_consensus.cc:2272] T 17b25e2626c84a989dd00de807fb51c6 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.188721   431 tablet_replica.cc:333] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.189298   431 raft_consensus.cc:2243] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.190068   431 raft_consensus.cc:2272] T bf0a254f4e734ae0878ae119cade4f15 P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.192423   431 tablet_replica.cc:333] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.192919   431 raft_consensus.cc:2243] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.193742   431 raft_consensus.cc:2272] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.195828   431 tablet_replica.cc:333] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.196398   431 raft_consensus.cc:2243] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.196862   431 raft_consensus.cc:2272] T a465b137da5e49fb9465b378d628cac9 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.199167   431 tablet_replica.cc:333] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.199858   431 raft_consensus.cc:2243] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.200464   431 raft_consensus.cc:2272] T 6b9cd875495e4489a7ae864416b8e233 P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.201411  9539 consensus_peers.cc:597] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.202109  9539 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 428 similar messages]
I20260709 13:05:50.203320   431 tablet_replica.cc:333] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.204169   431 raft_consensus.cc:2243] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:50.204411  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.204700   431 raft_consensus.cc:2272] T 6894e48d005e4cabb8a0482567ba71de P 35817eed7a6449bc913deabeec3a66a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.207630   431 tablet_replica.cc:333] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
W20260709 13:05:50.207594  9465 consensus_peers.cc:597] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.208691   431 raft_consensus.cc:2243] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.209136   431 raft_consensus.cc:2272] T 85690a80dd3046bca704808f907ec24c P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.211326   431 tablet_replica.cc:333] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.211926   431 raft_consensus.cc:2243] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.212533   431 raft_consensus.cc:2272] T 852931ef972a4b4d835cf4238e0a194e P 35817eed7a6449bc913deabeec3a66a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.215039   431 tablet_replica.cc:333] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
W20260709 13:05:50.215113  9539 consensus_peers.cc:597] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.215703   431 raft_consensus.cc:2243] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.216307   431 raft_consensus.cc:2272] T 5ee539e5ae0140c097952f76679d785d P 35817eed7a6449bc913deabeec3a66a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.218258   431 tablet_replica.cc:333] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.218753   431 raft_consensus.cc:2243] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.219596   431 raft_consensus.cc:2272] T 3258bebb55ec437b935b7b7e8f192ded P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.222014   431 tablet_replica.cc:333] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2: stopping tablet replica
I20260709 13:05:50.222576   431 raft_consensus.cc:2243] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.223034   431 raft_consensus.cc:2272] T 9832319718e143058c54278ed4f330ae P 35817eed7a6449bc913deabeec3a66a2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.223996  9465 consensus_peers.cc:597] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.243117  9465 consensus_peers.cc:597] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.246970  9539 consensus_peers.cc:597] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.261938  9465 consensus_peers.cc:597] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.290033  9465 consensus_peers.cc:597] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.294979  9539 consensus_peers.cc:597] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.300745   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:50.314718  9465 consensus_peers.cc:597] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.322623  9539 consensus_peers.cc:597] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:50.353704  9465 consensus_peers.cc:597] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:50.355922  9465 consensus_peers.cc:597] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.380300   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:05:50.393256  9539 consensus_peers.cc:597] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.398022  9465 consensus_peers.cc:597] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.398677  9465 consensus_peers.cc:597] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.409662  9539 consensus_peers.cc:597] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.427731  9539 consensus_peers.cc:597] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.429140  9465 consensus_peers.cc:597] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.437376  9539 consensus_peers.cc:597] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.440802  9465 consensus_peers.cc:597] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.445212  9465 consensus_peers.cc:597] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.450062   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.450977   431 tablet_replica.cc:333] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.451952   431 raft_consensus.cc:2243] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.452605   431 raft_consensus.cc:2272] T c2379b986cb64c07ad870420d59e3e93 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.456599   431 tablet_replica.cc:333] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.458262   431 raft_consensus.cc:2243] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.459077   431 raft_consensus.cc:2272] T 867c2d023234405b9cf88b5b0812f09b P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.462064   431 tablet_replica.cc:333] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.462873   431 raft_consensus.cc:2243] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.463331   431 raft_consensus.cc:2272] T 6a689cd004db4bbebd7fc4c6c5aecada P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.465240   431 tablet_replica.cc:333] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.465772   431 raft_consensus.cc:2243] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.466212   431 raft_consensus.cc:2272] T b3e8e061f8c943a98676c36322363053 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.467902   431 tablet_replica.cc:333] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.468493   431 raft_consensus.cc:2243] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.468904   431 raft_consensus.cc:2272] T 405f4dfd2e604f208c69fcc85c065d0c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.470912   431 tablet_replica.cc:333] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.471465   431 raft_consensus.cc:2243] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.472370   431 raft_consensus.cc:2272] T 56c2dcc9c8b6476bb6dfdbcf0db7abb4 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.474155   431 tablet_replica.cc:333] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.474687   431 raft_consensus.cc:2243] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.475625   431 raft_consensus.cc:2272] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.479290   431 tablet_replica.cc:333] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.480129   431 raft_consensus.cc:2243] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.481117   431 raft_consensus.cc:2272] T 08ae14c90ac540308e971d9148ceb222 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.483886   431 tablet_replica.cc:333] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.484663   431 raft_consensus.cc:2243] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.485718   431 raft_consensus.cc:2272] T 676c09e0537147d886a1c9236674359a P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.487914  9465 consensus_peers.cc:597] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.488775   431 tablet_replica.cc:333] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.489444   431 raft_consensus.cc:2243] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.489926   431 raft_consensus.cc:2272] T 36b02f7bce11408e9641daf8a5ff79ed P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.492729   431 tablet_replica.cc:333] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.493357   431 raft_consensus.cc:2243] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:05:50.493633  9465 consensus_peers.cc:597] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.494349   431 raft_consensus.cc:2272] T 9c5f31b62d11440182534d9ea52a469c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.496457   431 tablet_replica.cc:333] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.496960   431 raft_consensus.cc:2243] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.497671   431 raft_consensus.cc:2272] T 47b32e90e45f4c73a82822a137702764 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.499693   431 tablet_replica.cc:333] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.500353   431 raft_consensus.cc:2243] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.500779   431 raft_consensus.cc:2272] T 57bf6d31f0484d90903e72e4e463f5a0 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.502735   431 tablet_replica.cc:333] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.503506   431 raft_consensus.cc:2243] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.504024   431 raft_consensus.cc:2272] T 930e01c56898417191283e02b2ae37c9 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.506747   431 tablet_replica.cc:333] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068: stopping tablet replica
W20260709 13:05:50.506729  9540 consensus_peers.cc:597] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.507670   431 raft_consensus.cc:2243] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.508590   431 raft_consensus.cc:2272] T 8d5b44dd93e242a2972ad2926225583d P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.510715   431 tablet_replica.cc:333] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.511502   431 raft_consensus.cc:2243] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.512135   431 raft_consensus.cc:2272] T 8ae838928be04675a8741bd898683d34 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.514647   431 tablet_replica.cc:333] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.515269   431 raft_consensus.cc:2243] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.515690   431 raft_consensus.cc:2272] T 0d601528765d4c458eac4ca0aa48f348 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.517709   431 tablet_replica.cc:333] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.518252   431 raft_consensus.cc:2243] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.519075   431 raft_consensus.cc:2272] T 8541dc1cb441446a86bd73a864b794e0 P 2319bdfca4124710b4064192c524a068 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.521273   431 tablet_replica.cc:333] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.522037   431 raft_consensus.cc:2243] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.522934   431 raft_consensus.cc:2272] T af16b22a6c904b34aef360a0f7cd9e20 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.525991   431 tablet_replica.cc:333] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.526826   431 raft_consensus.cc:2243] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:50.527257  9465 consensus_peers.cc:597] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.527848   431 raft_consensus.cc:2272] T f607d360325242ad9ca1ce2b690f164a P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.530031   431 tablet_replica.cc:333] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.530625   431 raft_consensus.cc:2243] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.531073   431 raft_consensus.cc:2272] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.533218   431 tablet_replica.cc:333] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.533762   431 raft_consensus.cc:2243] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.534160   431 raft_consensus.cc:2272] T d1f556aa1381434c93d58d5e4827c8ef P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.536651   431 tablet_replica.cc:333] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.537416   431 raft_consensus.cc:2243] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.538455   431 raft_consensus.cc:2272] T a465b137da5e49fb9465b378d628cac9 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.541208   431 tablet_replica.cc:333] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.542018   431 raft_consensus.cc:2243] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.543069   431 raft_consensus.cc:2272] T 6b9cd875495e4489a7ae864416b8e233 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.545881   431 tablet_replica.cc:333] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.546473   431 raft_consensus.cc:2243] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.547354   431 raft_consensus.cc:2272] T 7191b50632234abe9017c3d7f8cd9879 P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.549592   431 tablet_replica.cc:333] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.550345   431 raft_consensus.cc:2243] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.550900   431 raft_consensus.cc:2272] T 5f8e0525be1147f4827361f2bd94ff3b P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.552561  9539 consensus_peers.cc:597] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 35817eed7a6449bc913deabeec3a66a2 (127.0.107.194:34067): Couldn't send request to peer 35817eed7a6449bc913deabeec3a66a2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.553766   431 tablet_replica.cc:333] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.554458   431 raft_consensus.cc:2243] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.555117   431 raft_consensus.cc:2272] T e7b2ff13398e4613a307e29028dc5560 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.557250   431 tablet_replica.cc:333] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.557788   431 raft_consensus.cc:2243] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.558493   431 raft_consensus.cc:2272] T 1f73ab9ca562450b8098926bae7ab820 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.561277   431 tablet_replica.cc:333] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.562093   431 raft_consensus.cc:2243] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.562767   431 raft_consensus.cc:2272] T acc97c47c7054b42b01d2541e311211f P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.565564   431 tablet_replica.cc:333] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.566360   431 raft_consensus.cc:2243] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.567426   431 raft_consensus.cc:2272] T 2598613081aa46f793a217ccf880c19e P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.570129   431 tablet_replica.cc:333] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.570876   431 raft_consensus.cc:2243] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.571311   431 raft_consensus.cc:2272] T 7c5f2184d23f426b99f302ec643dbf6c P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.573254   431 tablet_replica.cc:333] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.573812   431 raft_consensus.cc:2243] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.574597   431 raft_consensus.cc:2272] T bf0a254f4e734ae0878ae119cade4f15 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.576725   431 tablet_replica.cc:333] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.577190   431 raft_consensus.cc:2243] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.578019   431 raft_consensus.cc:2272] T 85690a80dd3046bca704808f907ec24c P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.580348   431 tablet_replica.cc:333] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.580943   431 raft_consensus.cc:2243] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.581420   431 raft_consensus.cc:2272] T 50c24c026c7048d9847a58777efe8770 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.583549   431 tablet_replica.cc:333] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.584194   431 raft_consensus.cc:2243] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.585021   431 raft_consensus.cc:2272] T 852931ef972a4b4d835cf4238e0a194e P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.587026   431 tablet_replica.cc:333] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.587579   431 raft_consensus.cc:2243] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.588551   431 raft_consensus.cc:2272] T 5ee539e5ae0140c097952f76679d785d P 2319bdfca4124710b4064192c524a068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.590658   431 tablet_replica.cc:333] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.591241   431 raft_consensus.cc:2243] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.591701   431 raft_consensus.cc:2272] T 3258bebb55ec437b935b7b7e8f192ded P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.593752   431 tablet_replica.cc:333] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.594306   431 raft_consensus.cc:2243] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.595125   431 raft_consensus.cc:2272] T 301c8e3a2e3c4e10bea6d3bee8752338 P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.597095   431 tablet_replica.cc:333] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.597620   431 raft_consensus.cc:2243] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.598434   431 raft_consensus.cc:2272] T 55f160c0257440b5aae393b6a1d76f90 P 2319bdfca4124710b4064192c524a068 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.600404   431 tablet_replica.cc:333] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.600917   431 raft_consensus.cc:2243] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.601712   431 raft_consensus.cc:2272] T d708b40047da45dba2adaacf9a0c4b30 P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.603650   431 tablet_replica.cc:333] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.604221   431 raft_consensus.cc:2243] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.604645   431 raft_consensus.cc:2272] T 17b25e2626c84a989dd00de807fb51c6 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.606529   431 tablet_replica.cc:333] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.607055   431 raft_consensus.cc:2243] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.607503   431 raft_consensus.cc:2272] T 1786e708043842a3884b58092b23b91b P 2319bdfca4124710b4064192c524a068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.609524   431 tablet_replica.cc:333] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068: stopping tablet replica
I20260709 13:05:50.610069   431 raft_consensus.cc:2243] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.611100   431 raft_consensus.cc:2272] T 9832319718e143058c54278ed4f330ae P 2319bdfca4124710b4064192c524a068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.613682   431 tablet_replica.cc:333] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068: stopping tablet replica
W20260709 13:05:50.613636  9539 consensus_peers.cc:597] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:50.614593   431 raft_consensus.cc:2243] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.615018   431 raft_consensus.cc:2272] T 22747041983e40adb9eafaae809e7651 P 2319bdfca4124710b4064192c524a068 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.641178  9539 consensus_peers.cc:597] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.645176  9539 consensus_peers.cc:597] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.654798  9540 consensus_peers.cc:597] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.683686  9539 consensus_peers.cc:597] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.692667  9540 consensus_peers.cc:597] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.694931   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:05:50.703485  9540 consensus_peers.cc:597] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.714279  9540 consensus_peers.cc:597] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.719527  9539 consensus_peers.cc:597] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.731374  9540 consensus_peers.cc:597] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.748114  9540 consensus_peers.cc:597] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.761242  9540 consensus_peers.cc:597] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.777418   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:05:50.791313  9540 consensus_peers.cc:597] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.806116  9540 consensus_peers.cc:597] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.806253  9539 consensus_peers.cc:597] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:50.817154  9540 consensus_peers.cc:597] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer 2319bdfca4124710b4064192c524a068 (127.0.107.195:34127): Couldn't send request to peer 2319bdfca4124710b4064192c524a068. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.829972   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:50.830937   431 tablet_replica.cc:333] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.831664   431 raft_consensus.cc:2243] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.832592   431 raft_consensus.cc:2272] T 6a689cd004db4bbebd7fc4c6c5aecada P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.834721   431 tablet_replica.cc:333] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.835294   431 raft_consensus.cc:2243] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.835716   431 raft_consensus.cc:2272] T 867c2d023234405b9cf88b5b0812f09b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.837589   431 tablet_replica.cc:333] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.838151   431 raft_consensus.cc:2243] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.838570   431 raft_consensus.cc:2272] T dd8f83a10da7493282e02784080114a7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.840553   431 tablet_replica.cc:333] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.841085   431 raft_consensus.cc:2243] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.841500   431 raft_consensus.cc:2272] T 5ba7c03f3c344aeab4dd32e9f4b13fc1 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.843532   431 tablet_replica.cc:333] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.844236   431 raft_consensus.cc:2243] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.845048   431 raft_consensus.cc:2272] T 36b02f7bce11408e9641daf8a5ff79ed P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.847474   431 tablet_replica.cc:333] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.848173   431 raft_consensus.cc:2243] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.848542   431 raft_consensus.cc:2272] T 08ae14c90ac540308e971d9148ceb222 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.850267   431 tablet_replica.cc:333] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.850757   431 raft_consensus.cc:2243] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.851431   431 raft_consensus.cc:2272] T 2f6cf54da48346c28143eaad060b9ccb P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.853293   431 tablet_replica.cc:333] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.853825   431 raft_consensus.cc:2243] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.854347   431 raft_consensus.cc:2272] T 676c09e0537147d886a1c9236674359a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.856531   431 tablet_replica.cc:333] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.857105   431 raft_consensus.cc:2243] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.857879   431 raft_consensus.cc:2272] T bf68916785184cb081d3032e1da7db46 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.859721   431 tablet_replica.cc:333] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.860373   431 raft_consensus.cc:2243] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.861142   431 raft_consensus.cc:2272] T 57bf6d31f0484d90903e72e4e463f5a0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.863008   431 tablet_replica.cc:333] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.863708   431 raft_consensus.cc:2243] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.864574   431 raft_consensus.cc:2272] T f812886de1104bf391487c26fbadfd1f P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.866595   431 tablet_replica.cc:333] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.867159   431 raft_consensus.cc:2243] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.867978   431 raft_consensus.cc:2272] T b3e8e061f8c943a98676c36322363053 P e3b7aa42b8924e21bbeb620671e29bd0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.870132   431 tablet_replica.cc:333] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.870688   431 raft_consensus.cc:2243] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.871433   431 raft_consensus.cc:2272] T 405f4dfd2e604f208c69fcc85c065d0c P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:50.871635  9539 consensus_peers.cc:597] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 -> Peer eae0fc1c2353497a889fdda2eda53679 (127.0.107.193:33181): Couldn't send request to peer eae0fc1c2353497a889fdda2eda53679. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:50.873564   431 tablet_replica.cc:333] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.874183   431 raft_consensus.cc:2243] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.874858   431 raft_consensus.cc:2272] T 776de67e897f4c53aab91cb04628fd1b P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.876655   431 tablet_replica.cc:333] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.877178   431 raft_consensus.cc:2243] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.877523   431 raft_consensus.cc:2272] T 191f9b27ce534ccba550f1ec90d42114 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.879323   431 tablet_replica.cc:333] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.879784   431 raft_consensus.cc:2243] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.880537   431 raft_consensus.cc:2272] T 50c24c026c7048d9847a58777efe8770 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.882328   431 tablet_replica.cc:333] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.882777   431 raft_consensus.cc:2243] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.883118   431 raft_consensus.cc:2272] T 3394a244b95c412a9b0d4a2db10fc64a P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.884928   431 tablet_replica.cc:333] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.885463   431 raft_consensus.cc:2243] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.886206   431 raft_consensus.cc:2272] T 8ae838928be04675a8741bd898683d34 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.888098   431 tablet_replica.cc:333] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.888612   431 raft_consensus.cc:2243] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.889008   431 raft_consensus.cc:2272] T eb3c57d630a44e97be12c1acca969da6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.890825   431 tablet_replica.cc:333] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.891357   431 raft_consensus.cc:2243] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.891782   431 raft_consensus.cc:2272] T af16b22a6c904b34aef360a0f7cd9e20 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.893707   431 tablet_replica.cc:333] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.894385   431 raft_consensus.cc:2243] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.894876   431 raft_consensus.cc:2272] T ebd83b93312541268dff3bd7a85eec65 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.896876   431 tablet_replica.cc:333] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.897393   431 raft_consensus.cc:2243] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.897821   431 raft_consensus.cc:2272] T 301c8e3a2e3c4e10bea6d3bee8752338 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.899634   431 tablet_replica.cc:333] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.900168   431 raft_consensus.cc:2243] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.900579   431 raft_consensus.cc:2272] T 55f160c0257440b5aae393b6a1d76f90 P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.902320   431 tablet_replica.cc:333] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.902899   431 raft_consensus.cc:2243] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.903957   431 raft_consensus.cc:2272] T 17b25e2626c84a989dd00de807fb51c6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.905963   431 tablet_replica.cc:333] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.906467   431 raft_consensus.cc:2243] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.907199   431 raft_consensus.cc:2272] T 0aee84f299b340bbad1f7999d6bb35b7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.909237   431 tablet_replica.cc:333] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.909788   431 raft_consensus.cc:2243] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.910231   431 raft_consensus.cc:2272] T fff33ba3467b4aa5ac7085e94405a30c P e3b7aa42b8924e21bbeb620671e29bd0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.912142   431 tablet_replica.cc:333] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.912650   431 raft_consensus.cc:2243] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.913380   431 raft_consensus.cc:2272] T 1f73ab9ca562450b8098926bae7ab820 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.915256   431 tablet_replica.cc:333] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.915788   431 raft_consensus.cc:2243] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.916222   431 raft_consensus.cc:2272] T 7c5f2184d23f426b99f302ec643dbf6c P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.918009   431 tablet_replica.cc:333] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.918545   431 raft_consensus.cc:2243] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.918980   431 raft_consensus.cc:2272] T 930e01c56898417191283e02b2ae37c9 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.920910   431 tablet_replica.cc:333] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.921442   431 raft_consensus.cc:2243] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.921903   431 raft_consensus.cc:2272] T 8d5b44dd93e242a2972ad2926225583d P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.923605   431 tablet_replica.cc:333] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.924167   431 raft_consensus.cc:2243] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.924518   431 raft_consensus.cc:2272] T 58e05a12bacf4f7fa5e42fa62b7c03c0 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.926373   431 tablet_replica.cc:333] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.926854   431 raft_consensus.cc:2243] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.927254   431 raft_consensus.cc:2272] T bf0a254f4e734ae0878ae119cade4f15 P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.929045   431 tablet_replica.cc:333] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.929502   431 raft_consensus.cc:2243] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.929876   431 raft_consensus.cc:2272] T 0d601528765d4c458eac4ca0aa48f348 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.931631   431 tablet_replica.cc:333] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.932126   431 raft_consensus.cc:2243] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.932576   431 raft_consensus.cc:2272] T f607d360325242ad9ca1ce2b690f164a P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.934365   431 tablet_replica.cc:333] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.934823   431 raft_consensus.cc:2243] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.935554   431 raft_consensus.cc:2272] T 22747041983e40adb9eafaae809e7651 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.937496   431 tablet_replica.cc:333] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.937963   431 raft_consensus.cc:2243] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.938341   431 raft_consensus.cc:2272] T 59044d7cb08e42079f85266aaa548e2a P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.940169   431 tablet_replica.cc:333] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.940634   431 raft_consensus.cc:2243] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.941066   431 raft_consensus.cc:2272] T 7a09b02e9a184cb1bdbec1c0c7eb8ed7 P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.942842   431 tablet_replica.cc:333] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.943324   431 raft_consensus.cc:2243] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.944145   431 raft_consensus.cc:2272] T 5f8e0525be1147f4827361f2bd94ff3b P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.945958   431 tablet_replica.cc:333] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.946439   431 raft_consensus.cc:2243] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.946866   431 raft_consensus.cc:2272] T 6b9cd875495e4489a7ae864416b8e233 P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.948740   431 tablet_replica.cc:333] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.949229   431 raft_consensus.cc:2243] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.950009   431 raft_consensus.cc:2272] T d1f556aa1381434c93d58d5e4827c8ef P e3b7aa42b8924e21bbeb620671e29bd0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.951958   431 tablet_replica.cc:333] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.952493   431 raft_consensus.cc:2243] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.952899   431 raft_consensus.cc:2272] T 7191b50632234abe9017c3d7f8cd9879 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.954685   431 tablet_replica.cc:333] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.955180   431 raft_consensus.cc:2243] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.955960   431 raft_consensus.cc:2272] T 1786e708043842a3884b58092b23b91b P e3b7aa42b8924e21bbeb620671e29bd0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.957881   431 tablet_replica.cc:333] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.958336   431 raft_consensus.cc:2243] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:50.958746   431 raft_consensus.cc:2272] T 4cc8e68c8d8f4c6380be2ffc0070d2b6 P e3b7aa42b8924e21bbeb620671e29bd0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:50.960649   431 tablet_replica.cc:333] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0: stopping tablet replica
I20260709 13:05:50.961082   431 raft_consensus.cc:2243] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:50.961825   431 raft_consensus.cc:2272] T 6894e48d005e4cabb8a0482567ba71de P e3b7aa42b8924e21bbeb620671e29bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.050823   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:05:51.119135   431 master.cc:562] Master@127.0.107.254:46283 shutting down...
I20260709 13:05:51.157223   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.157836   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.158155   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d7d8389dff34b7188c99f171c636387: stopping tablet replica
I20260709 13:05:51.182590   431 master.cc:584] Master@127.0.107.254:46283 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (44779 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:05:51.279209   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37389
I20260709 13:05:51.280383   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.286759 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.286857 10808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.287447 10805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.288420   431 server_base.cc:1061] running on GCE node
I20260709 13:05:51.289767   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.289973   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.290166   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602351290149 us; error 0 us; skew 500 ppm
I20260709 13:05:51.290750   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.293913   431 webserver.cc:533] Webserver started at http://127.0.107.254:35331/ using document root <none> and password file <none>
I20260709 13:05:51.294512   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.294688   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.295017   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.296250   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "8da14c19eb60471f8fbcd854048b522b"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.300953   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:51.304689 10813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.305523   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:05:51.305842   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "8da14c19eb60471f8fbcd854048b522b"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.306182   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.325300   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.326566   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.365106   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37389
I20260709 13:05:51.365226 10864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37389 every 8 connection(s)
I20260709 13:05:51.369099 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.380157 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b: Bootstrap starting.
I20260709 13:05:51.385390 10865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.390089 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b: No bootstrap required, opened a new log
I20260709 13:05:51.392493 10865 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER }
I20260709 13:05:51.392902 10865 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.393091 10865 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da14c19eb60471f8fbcd854048b522b, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.393733 10865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER }
I20260709 13:05:51.394174 10865 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:51.394388 10865 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:51.394613 10865 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.399451 10865 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER }
I20260709 13:05:51.399974 10865 leader_election.cc:304] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8da14c19eb60471f8fbcd854048b522b; no voters: 
I20260709 13:05:51.401253 10865 leader_election.cc:290] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:51.401657 10868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.403098 10868 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 1 LEADER]: Becoming Leader. State: Replica: 8da14c19eb60471f8fbcd854048b522b, State: Running, Role: LEADER
I20260709 13:05:51.403803 10868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER }
I20260709 13:05:51.404611 10865 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:51.408934 10869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8da14c19eb60471f8fbcd854048b522b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER } }
I20260709 13:05:51.409267 10870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8da14c19eb60471f8fbcd854048b522b. Latest consensus state: current_term: 1 leader_uuid: "8da14c19eb60471f8fbcd854048b522b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da14c19eb60471f8fbcd854048b522b" member_type: VOTER } }
I20260709 13:05:51.409893 10869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:51.409940 10870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:51.413465 10876 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:51.422353 10876 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:51.423496   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:51.431720 10876 catalog_manager.cc:1383] Generated new cluster ID: c1a1a55c43524fca940295defb98a048
I20260709 13:05:51.432037 10876 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:51.456161 10876 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:51.457443 10876 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:51.472432 10876 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b: Generated new TSK 0
I20260709 13:05:51.473030 10876 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:51.490149   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.496677 10886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.497489 10887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.500881 10889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.502388   431 server_base.cc:1061] running on GCE node
I20260709 13:05:51.503417   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.503677   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.503804   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602351503793 us; error 0 us; skew 500 ppm
I20260709 13:05:51.504360   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.506592   431 webserver.cc:533] Webserver started at http://127.0.107.193:44401/ using document root <none> and password file <none>
I20260709 13:05:51.507035   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.507184   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.507391   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.508704   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "3e77260a8a934c6890170e2460f0db1c"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.513152   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:05:51.516665 10894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.517446   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:51.517738   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "3e77260a8a934c6890170e2460f0db1c"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.517997   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.538385   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.539574   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.541044   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.543512   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.543749   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.544006   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.544224   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:51.587167   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43827
I20260709 13:05:51.587224 10956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43827 every 8 connection(s)
I20260709 13:05:51.594393   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.602478 10961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.604269 10962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.607671   431 server_base.cc:1061] running on GCE node
W20260709 13:05:51.607770 10964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.609429   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.609647   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.609886   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602351609848 us; error 0 us; skew 500 ppm
I20260709 13:05:51.610486   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.612870 10957 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37389
I20260709 13:05:51.613308 10957 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:51.613593   431 webserver.cc:533] Webserver started at http://127.0.107.194:44063/ using document root <none> and password file <none>
I20260709 13:05:51.614084 10957 heartbeater.cc:507] Master 127.0.107.254:37389 requested a full tablet report, sending...
I20260709 13:05:51.614221   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.614584   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.614873   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.616328   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "825676b5b65144199f32bfbefc4b546b"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.616678 10830 ts_manager.cc:194] Registered new tserver with Master: 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827)
I20260709 13:05:51.618731 10830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56676
I20260709 13:05:51.621977   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:05:51.625748 10969 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.626572   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:51.626902   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "825676b5b65144199f32bfbefc4b546b"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.627199   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.642550   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.643766   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.645419   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.647682   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.647914   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.648191   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.648371   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.689122   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43363
I20260709 13:05:51.689302 11031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43363 every 8 connection(s)
I20260709 13:05:51.693972   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:51.701267 11035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:51.705278 11036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.709448   431 server_base.cc:1061] running on GCE node
I20260709 13:05:51.710376 11032 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37389
I20260709 13:05:51.710872 11032 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:51.711493 11038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:51.711721 11032 heartbeater.cc:507] Master 127.0.107.254:37389 requested a full tablet report, sending...
I20260709 13:05:51.712601   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:51.712963   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:51.713222   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602351713203 us; error 0 us; skew 500 ppm
I20260709 13:05:51.714044   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:51.714227 10830 ts_manager.cc:194] Registered new tserver with Master: 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:51.716531 10830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56682
I20260709 13:05:51.717151   431 webserver.cc:533] Webserver started at http://127.0.107.195:36831/ using document root <none> and password file <none>
I20260709 13:05:51.717963   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:51.718266   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:51.718658   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:51.720629   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "788149cd7a814d59abcebb55d9667a7e"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.726104   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:51.730211 11043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.731186   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260709 13:05:51.731545   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "788149cd7a814d59abcebb55d9667a7e"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:51.731884   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:51.760969   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:51.762281   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:51.763931   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:51.766292   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:51.766527   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.766767   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:51.766937   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:51.808786   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42623
I20260709 13:05:51.808897 11105 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42623 every 8 connection(s)
I20260709 13:05:51.823865 11106 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37389
I20260709 13:05:51.824414 11106 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:51.825174 11106 heartbeater.cc:507] Master 127.0.107.254:37389 requested a full tablet report, sending...
I20260709 13:05:51.827191 10830 ts_manager.cc:194] Registered new tserver with Master: 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:51.827911   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016058756s
I20260709 13:05:51.828783 10830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56688
I20260709 13:05:51.854882 10830 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56690:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:51.857805 10830 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:51.933422 11071 tablet_service.cc:1511] Processing CreateTablet for tablet 8215c846dc75432eafceeca695c689f1 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.933741 11070 tablet_service.cc:1511] Processing CreateTablet for tablet d13796b4cdf64141a736219a69766304 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.935003 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8215c846dc75432eafceeca695c689f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.935770 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 11acc923d5ac4765add520238d112379 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.937623 11070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13796b4cdf64141a736219a69766304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.938323 10921 tablet_service.cc:1511] Processing CreateTablet for tablet d13796b4cdf64141a736219a69766304 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.939774 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13796b4cdf64141a736219a69766304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.941177 10922 tablet_service.cc:1511] Processing CreateTablet for tablet 8215c846dc75432eafceeca695c689f1 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.941881 10997 tablet_service.cc:1511] Processing CreateTablet for tablet 8215c846dc75432eafceeca695c689f1 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:51.942330 10920 tablet_service.cc:1511] Processing CreateTablet for tablet 11acc923d5ac4765add520238d112379 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.943230 10997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8215c846dc75432eafceeca695c689f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.943270 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11acc923d5ac4765add520238d112379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.943710 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11acc923d5ac4765add520238d112379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.944798 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8215c846dc75432eafceeca695c689f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.949273 10996 tablet_service.cc:1511] Processing CreateTablet for tablet d13796b4cdf64141a736219a69766304 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:51.950721 10996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13796b4cdf64141a736219a69766304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.953207 10995 tablet_service.cc:1511] Processing CreateTablet for tablet 11acc923d5ac4765add520238d112379 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:51.954558 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11acc923d5ac4765add520238d112379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.957839 10919 tablet_service.cc:1511] Processing CreateTablet for tablet a66d06e9c7a24e168171e2c9799d6daa (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.959236 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66d06e9c7a24e168171e2c9799d6daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.959280 10994 tablet_service.cc:1511] Processing CreateTablet for tablet a66d06e9c7a24e168171e2c9799d6daa (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.960800 10994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66d06e9c7a24e168171e2c9799d6daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.971714 11068 tablet_service.cc:1511] Processing CreateTablet for tablet a66d06e9c7a24e168171e2c9799d6daa (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:51.973202 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66d06e9c7a24e168171e2c9799d6daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.977638 10993 tablet_service.cc:1511] Processing CreateTablet for tablet f879bb12486144b9a6560134ad435561 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.977806 10918 tablet_service.cc:1511] Processing CreateTablet for tablet f879bb12486144b9a6560134ad435561 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.978488 11067 tablet_service.cc:1511] Processing CreateTablet for tablet f879bb12486144b9a6560134ad435561 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:51.979110 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f879bb12486144b9a6560134ad435561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.979197 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f879bb12486144b9a6560134ad435561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.979839 11067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f879bb12486144b9a6560134ad435561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.994103 10917 tablet_service.cc:1511] Processing CreateTablet for tablet 62f398b478284572b805124f1a36f63e (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:51.995586 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f398b478284572b805124f1a36f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.996011 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 62f398b478284572b805124f1a36f63e (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:51.997367 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f398b478284572b805124f1a36f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.000736 11122 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.010728 11122 tablet_bootstrap.cc:654] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.012993 11071 tablet_service.cc:1511] Processing CreateTablet for tablet 62f398b478284572b805124f1a36f63e (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:52.014416 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f398b478284572b805124f1a36f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.015542 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 860ba08c2b704988aab1d239911d0aa8 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:52.017292 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860ba08c2b704988aab1d239911d0aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.029139 11069 tablet_service.cc:1511] Processing CreateTablet for tablet 860ba08c2b704988aab1d239911d0aa8 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:52.030614 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860ba08c2b704988aab1d239911d0aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.029247 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 860ba08c2b704988aab1d239911d0aa8 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:52.033365 11121 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.034350 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860ba08c2b704988aab1d239911d0aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.040515 10990 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4c5a3b70e4823b4f315b6a21f495a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:52.042018 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4c5a3b70e4823b4f315b6a21f495a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.057221 11123 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.060604 11068 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4c5a3b70e4823b4f315b6a21f495a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:52.061028 10920 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4c5a3b70e4823b4f315b6a21f495a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:52.062265 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4c5a3b70e4823b4f315b6a21f495a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.062304 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4c5a3b70e4823b4f315b6a21f495a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.069204 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 9255ab3c5e0845178fc0ed059d1e75f3 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:52.070521 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255ab3c5e0845178fc0ed059d1e75f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.069065 10921 tablet_service.cc:1511] Processing CreateTablet for tablet 9255ab3c5e0845178fc0ed059d1e75f3 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:52.071943 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255ab3c5e0845178fc0ed059d1e75f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.074790 11121 tablet_bootstrap.cc:654] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.078789 11122 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.079900 11122 ts_tablet_manager.cc:1403] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.007s
I20260709 13:05:52.083968 11123 tablet_bootstrap.cc:654] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.091050 11071 tablet_service.cc:1511] Processing CreateTablet for tablet 9255ab3c5e0845178fc0ed059d1e75f3 (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:52.094352 11071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255ab3c5e0845178fc0ed059d1e75f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.092480 11122 raft_consensus.cc:359] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.095052 11122 raft_consensus.cc:385] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.095393 11122 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.097607 10916 tablet_service.cc:1511] Processing CreateTablet for tablet bbc7f1cef7f14b93b2cd0979da38430a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:52.098915 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc7f1cef7f14b93b2cd0979da38430a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.100750 11069 tablet_service.cc:1511] Processing CreateTablet for tablet bbc7f1cef7f14b93b2cd0979da38430a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:52.102241 11069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc7f1cef7f14b93b2cd0979da38430a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.102697 11121 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.103222 11121 ts_tablet_manager.cc:1403] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.008s
I20260709 13:05:52.106245 11121 raft_consensus.cc:359] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.111505 11121 raft_consensus.cc:385] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.111826 11121 raft_consensus.cc:740] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.112083 10991 tablet_service.cc:1511] Processing CreateTablet for tablet bbc7f1cef7f14b93b2cd0979da38430a (DEFAULT_TABLE table=test-workload [id=eb35c577b07742aba82f357b47337904]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:52.112354 11122 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.112622 11121 consensus_queue.cc:260] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.113785 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc7f1cef7f14b93b2cd0979da38430a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.116837 11123 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.117570 11123 ts_tablet_manager.cc:1403] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.061s	user 0.001s	sys 0.015s
I20260709 13:05:52.121655 11123 raft_consensus.cc:359] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.122660 11123 raft_consensus.cc:385] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.123054 11123 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.124400 11123 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.126190 11122 ts_tablet_manager.cc:1434] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.001s
I20260709 13:05:52.127144 10957 heartbeater.cc:499] Master 127.0.107.254:37389 was elected leader, sending a full tablet report...
I20260709 13:05:52.137817 11032 heartbeater.cc:499] Master 127.0.107.254:37389 was elected leader, sending a full tablet report...
I20260709 13:05:52.148690 11122 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.149904 11123 ts_tablet_manager.cc:1434] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 13:05:52.151441 11123 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.160424 11122 tablet_bootstrap.cc:654] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.167501 11123 tablet_bootstrap.cc:654] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.173553 11106 heartbeater.cc:499] Master 127.0.107.254:37389 was elected leader, sending a full tablet report...
I20260709 13:05:52.177052 11121 ts_tablet_manager.cc:1434] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.074s	user 0.029s	sys 0.033s
I20260709 13:05:52.179052 11121 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.179929 11123 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.177963 11122 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.180485 11123 ts_tablet_manager.cc:1403] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.009s
I20260709 13:05:52.180682 11122 ts_tablet_manager.cc:1403] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.011s
I20260709 13:05:52.183671 11129 raft_consensus.cc:493] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.183804 11123 raft_consensus.cc:359] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.184765 11123 raft_consensus.cc:385] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.184333 11129 raft_consensus.cc:515] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.185102 11123 raft_consensus.cc:740] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.186064 11123 consensus_queue.cc:260] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.191946 11121 tablet_bootstrap.cc:654] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.183985 11122 raft_consensus.cc:359] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.192953 11122 raft_consensus.cc:385] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.193337 11122 raft_consensus.cc:740] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
W20260709 13:05:52.194557 11033 tablet.cc:2406] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:52.194173 11122 consensus_queue.cc:260] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.196276 11123 ts_tablet_manager.cc:1434] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 13:05:52.196677 11122 ts_tablet_manager.cc:1434] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:05:52.197279 11123 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.204013 11122 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.200712 11129 leader_election.cc:290] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.216249 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.217113 10932 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.217788 11122 tablet_bootstrap.cc:654] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.220479 10971 leader_election.cc:304] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.221671 11129 raft_consensus.cc:2804] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.222054 11129 raft_consensus.cc:493] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.222380 11129 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.227167 11123 tablet_bootstrap.cc:654] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.230741 11129 raft_consensus.cc:515] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.233942 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
W20260709 13:05:52.242276 10971 leader_election.cc:343] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.247501 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.248358 10932 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.261898 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.244879 11129 leader_election.cc:290] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
W20260709 13:05:52.264994 10971 leader_election.cc:343] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.267308 10932 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.269291 10971 leader_election.cc:304] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:52.270252 11121 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.270895 11121 ts_tablet_manager.cc:1403] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.092s	user 0.033s	sys 0.026s
I20260709 13:05:52.270828 11129 raft_consensus.cc:2804] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.271342 11122 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.271590 11123 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.271938 11122 ts_tablet_manager.cc:1403] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.029s
I20260709 13:05:52.272082 11123 ts_tablet_manager.cc:1403] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.025s
I20260709 13:05:52.272682 11129 raft_consensus.cc:697] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:52.273736 11129 consensus_queue.cc:237] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.274506 11121 raft_consensus.cc:359] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.274977 11123 raft_consensus.cc:359] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.275357 11121 raft_consensus.cc:385] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.275206 11122 raft_consensus.cc:359] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.275777 11123 raft_consensus.cc:385] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.275996 11122 raft_consensus.cc:385] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.275854 11121 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.276235 11123 raft_consensus.cc:740] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.276533 11122 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.277194 11123 consensus_queue.cc:260] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.277276 11122 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.277534 11121 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.279557 11122 ts_tablet_manager.cc:1434] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:52.280138 11121 ts_tablet_manager.cc:1434] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:05:52.280653 11122 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.281247 11121 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.285048 11123 ts_tablet_manager.cc:1434] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:52.287642 11122 tablet_bootstrap.cc:654] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.295425 11121 tablet_bootstrap.cc:654] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.295709 11123 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.305511 11123 tablet_bootstrap.cc:654] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.309794 10830 catalog_manager.cc:5697] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.312194 11121 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.312858 11121 ts_tablet_manager.cc:1403] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.008s
I20260709 13:05:52.313438 11122 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.314133 11122 ts_tablet_manager.cc:1403] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.017s
I20260709 13:05:52.316562 11121 raft_consensus.cc:359] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.317529 11121 raft_consensus.cc:385] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.317873 11121 raft_consensus.cc:740] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.317914 11122 raft_consensus.cc:359] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.318979 11122 raft_consensus.cc:385] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.319511 11122 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.319051 11121 consensus_queue.cc:260] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.320802 11122 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.323583 11122 ts_tablet_manager.cc:1434] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:52.324856 11122 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.332381 11122 tablet_bootstrap.cc:654] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.333657 11128 raft_consensus.cc:493] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.334340 11128 raft_consensus.cc:515] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.342783 11128 leader_election.cc:290] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:52.340188 11121 ts_tablet_manager.cc:1434] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 13:05:52.342809 11123 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.350937 11123 ts_tablet_manager.cc:1403] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.016s
I20260709 13:05:52.353796 11122 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.354398 11122 ts_tablet_manager.cc:1403] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 13:05:52.354303 11123 raft_consensus.cc:359] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.355311 11123 raft_consensus.cc:385] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.355655 11123 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.356622 11123 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.357758 11122 raft_consensus.cc:359] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.358652 11122 raft_consensus.cc:385] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.359011 11122 raft_consensus.cc:740] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.359069 11123 ts_tablet_manager.cc:1434] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:52.360363 11123 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.360003 11122 consensus_queue.cc:260] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.362023 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.362838 10932 raft_consensus.cc:2393] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 788149cd7a814d59abcebb55d9667a7e in current term 1: Already voted for candidate 825676b5b65144199f32bfbefc4b546b in this term.
I20260709 13:05:52.365372 11122 ts_tablet_manager.cc:1434] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:05:52.366664 11122 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.369346 11123 tablet_bootstrap.cc:654] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.355798 11121 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.373889 11122 tablet_bootstrap.cc:654] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.376686 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.378960 11046 leader_election.cc:304] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e; no voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:52.380324 11128 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.388571 11123 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.389004 11128 raft_consensus.cc:2749] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.389258 11123 ts_tablet_manager.cc:1403] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:05:52.391731 11123 raft_consensus.cc:359] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.392400 11123 raft_consensus.cc:385] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.392653 11123 raft_consensus.cc:740] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.393297 11123 consensus_queue.cc:260] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.393735 11121 tablet_bootstrap.cc:654] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.395627 11123 ts_tablet_manager.cc:1434] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:05:52.396752 11123 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.401162 11122 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.401926 11122 ts_tablet_manager.cc:1403] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.011s
I20260709 13:05:52.403293 11123 tablet_bootstrap.cc:654] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.405992 11122 raft_consensus.cc:359] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.407191 11122 raft_consensus.cc:385] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.407675 11122 raft_consensus.cc:740] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.408864 11122 consensus_queue.cc:260] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.411631 11122 ts_tablet_manager.cc:1434] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:52.412700 11122 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.413185 11123 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.413733 11123 ts_tablet_manager.cc:1403] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:05:52.414529 11121 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.415143 11121 ts_tablet_manager.cc:1403] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.015s
I20260709 13:05:52.416909 11123 raft_consensus.cc:359] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.417701 11123 raft_consensus.cc:385] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.417977 11123 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.418202 11121 raft_consensus.cc:359] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.419114 11121 raft_consensus.cc:385] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.418797 11123 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.419449 11121 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.420552 11122 tablet_bootstrap.cc:654] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.420519 11121 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
W20260709 13:05:52.421643 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:52.423233 11121 ts_tablet_manager.cc:1434] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:52.423420 11123 ts_tablet_manager.cc:1434] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:52.424608 11128 raft_consensus.cc:493] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.424633 11123 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.425127 11128 raft_consensus.cc:515] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.429137 11121 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.432885 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.433669 10932 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 0.
I20260709 13:05:52.435346 11123 tablet_bootstrap.cc:654] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.435472 11045 leader_election.cc:304] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:05:52.438159 11121 tablet_bootstrap.cc:654] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.438253 11129 raft_consensus.cc:493] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.438511 11127 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.438846 11129 raft_consensus.cc:515] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.439062 11127 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.441387 11129 leader_election.cc:290] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623), 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827)
I20260709 13:05:52.441787 11127 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.441973 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.442978 11122 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.453890 11122 ts_tablet_manager.cc:1403] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.008s
I20260709 13:05:52.453779 11081 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.455653 10971 leader_election.cc:304] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.456851 11129 raft_consensus.cc:2804] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.457322 11129 raft_consensus.cc:493] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.457764 11129 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.458045 11122 raft_consensus.cc:359] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.459082 11122 raft_consensus.cc:385] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.459455 11122 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.444213 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.448583 11128 leader_election.cc:290] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:52.447433 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.465312 10932 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.440686 11132 raft_consensus.cc:493] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.468593 11132 raft_consensus.cc:515] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.469983 11007 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 0.
I20260709 13:05:52.451272 11149 raft_consensus.cc:2804] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.473776 11149 raft_consensus.cc:493] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.473820 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.475399 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.471632 11132 leader_election.cc:290] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.476188 10932 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.476542 11132 raft_consensus.cc:493] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.477391 10971 leader_election.cc:304] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.474382 11149 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.477147 11132 raft_consensus.cc:515] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.491793 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.492753 10932 raft_consensus.cc:2468] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.494378 11122 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.494849 10971 leader_election.cc:304] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.497977 11122 ts_tablet_manager.cc:1434] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.004s
I20260709 13:05:52.499078 11122 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.500525 11132 leader_election.cc:290] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.501291 11132 raft_consensus.cc:2804] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.501714 11132 raft_consensus.cc:493] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.502115 11132 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.505502 11122 tablet_bootstrap.cc:654] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.509073 11129 raft_consensus.cc:515] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.512903 11149 raft_consensus.cc:515] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.526057 11081 raft_consensus.cc:2393] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 825676b5b65144199f32bfbefc4b546b in current term 1: Already voted for candidate 788149cd7a814d59abcebb55d9667a7e in this term.
I20260709 13:05:52.527045 11123 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.525697 11155 raft_consensus.cc:493] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.527814 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.528215 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.528574 10932 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.528434 11155 raft_consensus.cc:515] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.529163 11080 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 0.
I20260709 13:05:52.530731 10896 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:05:52.531620 11127 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.527712 11123 ts_tablet_manager.cc:1403] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.024s
I20260709 13:05:52.531978 11127 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.532516 11127 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.536222 10932 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 1.
I20260709 13:05:52.537552 11045 leader_election.cc:304] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:05:52.537700 11121 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.538437 11128 raft_consensus.cc:2804] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.536252 11123 raft_consensus.cc:359] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.540196 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.541137 11123 raft_consensus.cc:385] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.542187 11121 ts_tablet_manager.cc:1403] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.032s
I20260709 13:05:52.541010 11149 leader_election.cc:290] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
W20260709 13:05:52.542529 10971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43827, user_credentials={real_user=slave}} blocked reactor thread for 47803.9us
I20260709 13:05:52.543401 11007 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 0.
I20260709 13:05:52.545300 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:52.545861 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.544235 11123 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.551739 11128 raft_consensus.cc:697] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:52.552352 11154 raft_consensus.cc:2804] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.541913 11127 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.552906 11128 consensus_queue.cc:237] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.552819 11123 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.555481 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:52.553651 11155 leader_election.cc:290] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.551563 11129 leader_election.cc:290] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623), 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827)
I20260709 13:05:52.557190 11121 raft_consensus.cc:359] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.560076 11122 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.561463 11007 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.565959 11122 ts_tablet_manager.cc:1403] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.008s
I20260709 13:05:52.568571 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
W20260709 13:05:52.560469 10971 leader_election.cc:343] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.562911 11121 raft_consensus.cc:385] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.552814 11154 raft_consensus.cc:493] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.569538 10932 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.569928 11154 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.557466 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.571231 11080 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.555823 11123 ts_tablet_manager.cc:1434] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:05:52.572312 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.573465 11123 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.569545 11121 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.574786 11121 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.575822 11081 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.579559 11121 ts_tablet_manager.cc:1434] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:05:52.580996 11121 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.581169 11123 tablet_bootstrap.cc:654] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.582020 10971 leader_election.cc:304] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.588753 10932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.585649 11122 raft_consensus.cc:359] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.606189 11122 raft_consensus.cc:385] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.606573 11122 raft_consensus.cc:740] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.593209 11154 raft_consensus.cc:515] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.607313 11122 consensus_queue.cc:260] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.609124 11132 raft_consensus.cc:515] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.609773 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.610250 11154 leader_election.cc:290] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.610704 10931 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.606365 10932 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.611649 11007 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 1.
I20260709 13:05:52.612303 11132 leader_election.cc:290] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.604761 11121 tablet_bootstrap.cc:654] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.605440 11127 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Requested vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.615254 11078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.606343 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.617301 11081 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.622189 11006 raft_consensus.cc:2393] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 788149cd7a814d59abcebb55d9667a7e in current term 1: Already voted for candidate 825676b5b65144199f32bfbefc4b546b in this term.
I20260709 13:05:52.599910 11156 raft_consensus.cc:2804] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.613526 10897 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.610718 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.630052 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.630957 10930 raft_consensus.cc:2393] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 825676b5b65144199f32bfbefc4b546b in current term 1: Already voted for candidate 788149cd7a814d59abcebb55d9667a7e in this term.
I20260709 13:05:52.631975 11127 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.632756 11127 raft_consensus.cc:697] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Becoming Leader. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Running, Role: LEADER
I20260709 13:05:52.633916 11127 consensus_queue.cc:237] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.626387 11156 raft_consensus.cc:493] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.635516 11156 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.641777 10829 catalog_manager.cc:5697] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.648965 10971 leader_election.cc:304] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 825676b5b65144199f32bfbefc4b546b; no voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e
W20260709 13:05:52.651087 10971 leader_election.cc:343] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.655975 11132 raft_consensus.cc:2749] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.625591 11080 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.659688 11122 ts_tablet_manager.cc:1434] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.093s	user 0.024s	sys 0.023s
I20260709 13:05:52.661422 10971 leader_election.cc:304] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.661804 10931 raft_consensus.cc:2468] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.662426 11122 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.665874 11123 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.666445 11123 ts_tablet_manager.cc:1403] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.093s	user 0.037s	sys 0.032s
I20260709 13:05:52.666944 11081 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 1.
I20260709 13:05:52.668292 11132 raft_consensus.cc:2804] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.669044 11132 raft_consensus.cc:697] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:52.668955 10971 leader_election.cc:304] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:52.669941 11155 raft_consensus.cc:2804] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.670492 11155 raft_consensus.cc:697] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:52.670089 11132 consensus_queue.cc:237] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:52.671378 11155 consensus_queue.cc:237] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.673265 11123 raft_consensus.cc:359] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.674013 11123 raft_consensus.cc:385] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.674328 11123 raft_consensus.cc:740] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.675050 11123 consensus_queue.cc:260] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.668354 11122 tablet_bootstrap.cc:654] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.677428 11123 ts_tablet_manager.cc:1434] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:52.678534 11123 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.683564 10829 catalog_manager.cc:5697] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e77260a8a934c6890170e2460f0db1c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3e77260a8a934c6890170e2460f0db1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.689217 11123 tablet_bootstrap.cc:654] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.691246 11156 raft_consensus.cc:515] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.698293 11127 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.698925 11132 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.703323 11127 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.703804 11122 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.704430 11122 ts_tablet_manager.cc:1403] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.002s
I20260709 13:05:52.705610 11127 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.706277 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.706907 11006 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 0.
I20260709 13:05:52.707190 11081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.701363 11121 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.699242 10828 catalog_manager.cc:5697] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.708168 10897 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
W20260709 13:05:52.709127 10896 leader_election.cc:343] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.709172 11127 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.711712 11127 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.712105 11127 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.712598 10930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.707212 11122 raft_consensus.cc:359] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.713114 11121 ts_tablet_manager.cc:1403] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.009s
I20260709 13:05:52.713342 11122 raft_consensus.cc:385] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.713637 11122 raft_consensus.cc:740] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.714349 11122 consensus_queue.cc:260] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.716390 11122 ts_tablet_manager.cc:1434] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:52.716293 11121 raft_consensus.cc:359] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.717164 11121 raft_consensus.cc:385] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.702301 11123 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.717480 11122 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:52.717803 11123 ts_tablet_manager.cc:1403] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.005s
I20260709 13:05:52.718325 11132 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.702517 10932 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.720845 11123 raft_consensus.cc:359] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.721895 11123 raft_consensus.cc:385] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.722354 11123 raft_consensus.cc:740] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.722132 11127 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.723472 11123 consensus_queue.cc:260] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.717504 10930 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.725595 11156 leader_election.cc:290] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.732874 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:52.717496 11121 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.735245 11127 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Requested vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.732978 10930 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.736968 10971 leader_election.cc:304] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.737124 11121 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.737248 10828 catalog_manager.cc:5697] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.733731 11006 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.740332 11121 ts_tablet_manager.cc:1434] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:05:52.741690 11121 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.734450 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.742918 11080 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.734231 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.744347 11079 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.744887 11156 raft_consensus.cc:2804] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.745609 11156 raft_consensus.cc:697] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:52.745945 11123 ts_tablet_manager.cc:1434] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:52.746951 11123 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: Bootstrap starting.
I20260709 13:05:52.746469 11156 consensus_queue.cc:237] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.754231 11123 tablet_bootstrap.cc:654] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.757663 11006 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 1.
I20260709 13:05:52.760293 11121 tablet_bootstrap.cc:654] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.761104 10897 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.764245 11080 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.765447 11079 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 1.
I20260709 13:05:52.772676 11127 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.773478 11127 raft_consensus.cc:697] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Becoming Leader. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Running, Role: LEADER
I20260709 13:05:52.785820 11122 tablet_bootstrap.cc:654] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.785696 11127 consensus_queue.cc:237] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.788089 11123 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: No bootstrap required, opened a new log
I20260709 13:05:52.788619 11123 ts_tablet_manager.cc:1403] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.004s
I20260709 13:05:52.787292 10829 catalog_manager.cc:5697] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.795238 11123 raft_consensus.cc:359] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.796084 11123 raft_consensus.cc:385] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.796386 11123 raft_consensus.cc:740] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.798197 11122 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: No bootstrap required, opened a new log
I20260709 13:05:52.798745 11122 ts_tablet_manager.cc:1403] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.001s
I20260709 13:05:52.799468 11121 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.800071 11121 ts_tablet_manager.cc:1403] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.059s	user 0.004s	sys 0.011s
I20260709 13:05:52.801657 11122 raft_consensus.cc:359] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.802445 11122 raft_consensus.cc:385] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.802717 11122 raft_consensus.cc:740] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.802893 11121 raft_consensus.cc:359] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.803834 11122 consensus_queue.cc:260] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.804127 11123 consensus_queue.cc:260] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.806336 11122 ts_tablet_manager.cc:1434] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:05:52.803828 11121 raft_consensus.cc:385] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.807096 11121 raft_consensus.cc:740] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.808149 11121 consensus_queue.cc:260] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.810663 10830 catalog_manager.cc:5697] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e77260a8a934c6890170e2460f0db1c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3e77260a8a934c6890170e2460f0db1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.811731 11121 ts_tablet_manager.cc:1434] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:52.813052 11121 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.813082 11123 ts_tablet_manager.cc:1434] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:05:52.820714 11121 tablet_bootstrap.cc:654] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.825927 11121 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.826460 11121 ts_tablet_manager.cc:1403] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:05:52.829048 11127 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.829667 11127 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.829586 11121 raft_consensus.cc:359] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.830608 11121 raft_consensus.cc:385] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.830920 11121 raft_consensus.cc:740] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.831832 11121 consensus_queue.cc:260] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.832808 11127 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.833185 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.833904 11006 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 0.
I20260709 13:05:52.834107 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.834728 11121 ts_tablet_manager.cc:1434] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:52.835657 11121 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.835381 10897 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
W20260709 13:05:52.836405 10896 leader_election.cc:343] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.836464 11127 raft_consensus.cc:2804] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.837000 11127 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.837343 11127 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.842555 11121 tablet_bootstrap.cc:654] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.846007 11127 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.847525 11121 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.848084 11121 ts_tablet_manager.cc:1403] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:05:52.848237 11127 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Requested vote from peers 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.849107 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:52.849556 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "3e77260a8a934c6890170e2460f0db1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.849701 11006 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:52.850874 10896 leader_election.cc:343] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.852963 11128 raft_consensus.cc:493] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.853510 11121 raft_consensus.cc:359] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.853516 11128 raft_consensus.cc:515] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.854507 11121 raft_consensus.cc:385] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.854810 11121 raft_consensus.cc:740] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.855541 11121 consensus_queue.cc:260] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.857272 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.856081 11128 leader_election.cc:290] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:52.857951 11006 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e77260a8a934c6890170e2460f0db1c in term 1.
I20260709 13:05:52.858289 10931 raft_consensus.cc:2393] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 788149cd7a814d59abcebb55d9667a7e in current term 1: Already voted for candidate 825676b5b65144199f32bfbefc4b546b in this term.
I20260709 13:05:52.859223 10897 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:52.857649 11121 ts_tablet_manager.cc:1434] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:52.857372 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:52.860837 11121 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: Bootstrap starting.
I20260709 13:05:52.860064 11127 raft_consensus.cc:2804] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.861179 11046 leader_election.cc:304] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e; no voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:52.862370 11127 raft_consensus.cc:697] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Becoming Leader. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Running, Role: LEADER
I20260709 13:05:52.862450 11128 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.863306 11127 consensus_queue.cc:237] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.867830 11121 tablet_bootstrap.cc:654] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.871197 11128 raft_consensus.cc:2749] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.874682 11121 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: No bootstrap required, opened a new log
I20260709 13:05:52.875258 11121 ts_tablet_manager.cc:1403] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:05:52.877656 11121 raft_consensus.cc:359] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.878167 11121 raft_consensus.cc:385] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.878425 11121 raft_consensus.cc:740] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.879021 11121 consensus_queue.cc:260] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.880890 11121 ts_tablet_manager.cc:1434] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:52.880775 10827 catalog_manager.cc:5697] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e77260a8a934c6890170e2460f0db1c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3e77260a8a934c6890170e2460f0db1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.893575 11156 raft_consensus.cc:493] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.894110 11156 raft_consensus.cc:515] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.895762 11156 leader_election.cc:290] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.896533 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:52.896733 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:52.897135 10931 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.897393 11079 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:52.898149 10971 leader_election.cc:304] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.898872 11156 raft_consensus.cc:2804] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.899160 11156 raft_consensus.cc:493] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.899398 11156 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.904258 11156 raft_consensus.cc:515] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.905833 11156 leader_election.cc:290] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:52.906703 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:52.906908 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:52.907269 10931 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.907474 11079 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.912904 11079 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.912907 10931 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:52.914114 10971 leader_election.cc:304] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:52.914870 11156 raft_consensus.cc:2804] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.915354 11156 raft_consensus.cc:697] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:52.916225 11156 consensus_queue.cc:237] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:52.923775 10827 catalog_manager.cc:5697] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.968134 11128 consensus_queue.cc:1048] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.979525 11158 consensus_queue.cc:1048] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.007376 11158 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.007843 11158 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:53.009636 11158 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:53.010527 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:53.010651 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:53.011395 11007 raft_consensus.cc:2393] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 788149cd7a814d59abcebb55d9667a7e in current term 1: Already voted for candidate 3e77260a8a934c6890170e2460f0db1c in this term.
I20260709 13:05:53.012282 11046 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e; no voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:53.012921 11158 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.018872 11158 raft_consensus.cc:2749] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.077478 11156 raft_consensus.cc:493] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.078060 11156 raft_consensus.cc:515] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:53.079950 11156 leader_election.cc:290] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:53.080767 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c" is_pre_election: true
I20260709 13:05:53.080971 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:53.081441 10931 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:53.081617 11079 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 0.
I20260709 13:05:53.082427 10971 leader_election.cc:304] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:53.083055 11156 raft_consensus.cc:2804] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.083360 11156 raft_consensus.cc:493] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.083642 11156 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.088925 11156 raft_consensus.cc:515] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:53.090871 11156 leader_election.cc:290] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:53.091509 10931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:53.091727 11079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:53.092131 10931 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.092370 11079 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.097517 11079 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:53.097841 10931 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:53.098634 10971 leader_election.cc:304] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:53.099349 11156 raft_consensus.cc:2804] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.099865 11156 raft_consensus.cc:697] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:53.100680 11156 consensus_queue.cc:237] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:53.109181 10830 catalog_manager.cc:5697] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 0 to 1, leader changed from <none> to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.120529 11156 consensus_queue.cc:1048] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.130940 11156 consensus_queue.cc:1048] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.142264 11161 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.142927 11127 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.235255 11156 consensus_queue.cc:1048] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.247200 11129 consensus_queue.cc:1048] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.255940 11129 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.269423 11132 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.272936 11161 consensus_queue.cc:1048] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.285977 11190 consensus_queue.cc:1048] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.302477 11132 consensus_queue.cc:1048] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.315096 11129 consensus_queue.cc:1048] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.335829 11190 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.346284 11161 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.363392   431 ts_manager.cc:295] Set tserver state for 3e77260a8a934c6890170e2460f0db1c to MAINTENANCE_MODE
I20260709 13:05:53.364444   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:53.385000 10971 consensus_peers.cc:597] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.393544   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:53.394376   431 tablet_replica.cc:333] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.394974   431 raft_consensus.cc:2243] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.395792   431 raft_consensus.cc:2272] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.397939   431 tablet_replica.cc:333] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.398510   431 raft_consensus.cc:2243] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.398901   431 raft_consensus.cc:2272] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.400789   431 tablet_replica.cc:333] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.401324   431 raft_consensus.cc:2243] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.402139   431 raft_consensus.cc:2272] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.404595   431 tablet_replica.cc:333] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.405170   431 raft_consensus.cc:2243] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.405591   431 raft_consensus.cc:2272] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.408169   431 tablet_replica.cc:333] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.408720   431 raft_consensus.cc:2243] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.409145   431 raft_consensus.cc:2272] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.411322   431 tablet_replica.cc:333] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.411881   431 raft_consensus.cc:2243] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.412802   431 raft_consensus.cc:2272] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.414907   431 tablet_replica.cc:333] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.415457   431 raft_consensus.cc:2243] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.415911   431 raft_consensus.cc:2272] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.418270   431 tablet_replica.cc:333] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.418753   431 raft_consensus.cc:2243] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.419111   431 raft_consensus.cc:2272] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.421489   431 tablet_replica.cc:333] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.421998   431 raft_consensus.cc:2243] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.422482   431 raft_consensus.cc:2272] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.422719 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:53.425124   431 tablet_replica.cc:333] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: stopping tablet replica
I20260709 13:05:53.425674   431 raft_consensus.cc:2243] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.426093   431 raft_consensus.cc:2272] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.457367   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:53.467559 11045 consensus_peers.cc:597] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:53.602939 10971 consensus_peers.cc:597] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.663587 11129 consensus_queue.cc:1048] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:53.695490 10971 consensus_peers.cc:597] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:53.729547 10971 consensus_peers.cc:597] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:53.833174 10971 consensus_peers.cc:597] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:53.883232 10971 consensus_peers.cc:597] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:54.423813 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:54.655582 11207 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.656208 11207 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.658046 11207 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:54.659160 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
W20260709 13:05:54.661520 11045 leader_election.cc:336] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.661900 11045 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e; no voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:54.662514 11207 raft_consensus.cc:2749] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.666483 11129 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.666965 11129 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.668668 11129 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:54.670352 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:54.671130 11080 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:54.672159 10971 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:54.672843 11129 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:54.672940 10971 leader_election.cc:336] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.673233 11129 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.673640 11129 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.678737 11129 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.680473 11129 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:54.681982 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:54.682649 11080 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:54.684080 10971 leader_election.cc:336] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.687466 11080 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 2.
I20260709 13:05:54.688645 10971 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 3e77260a8a934c6890170e2460f0db1c
I20260709 13:05:54.689342 11129 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.689736 11129 raft_consensus.cc:697] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:54.690374 11129 consensus_queue.cc:237] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.697163 10827 catalog_manager.cc:5697] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 1 to 2, leader changed from 3e77260a8a934c6890170e2460f0db1c (127.0.107.193) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 2 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.787819 11207 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.788462 11207 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.790256 11129 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.790552 11207 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:54.790879 11129 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.791875 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:54.792645 11007 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 1.
I20260709 13:05:54.792999 11129 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:54.793852 11046 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:54.794938 11207 raft_consensus.cc:2804] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:54.795086 11045 leader_election.cc:336] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.795637 11207 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.795778 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:54.796164 11207 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:54.797925 10971 leader_election.cc:336] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.802286 11207 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.803601 11080 raft_consensus.cc:2393] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 825676b5b65144199f32bfbefc4b546b in current term 2: Already voted for candidate 788149cd7a814d59abcebb55d9667a7e in this term.
I20260709 13:05:54.805122 11207 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:54.805521 10971 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 825676b5b65144199f32bfbefc4b546b; no voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:54.806245 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:54.806453 11129 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:54.809952 11045 leader_election.cc:336] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.812634 11129 raft_consensus.cc:2749] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.818126 11007 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:54.819705 11046 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 3e77260a8a934c6890170e2460f0db1c
I20260709 13:05:54.820511 11207 raft_consensus.cc:2804] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.821628 11207 raft_consensus.cc:697] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:54.822463 11207 consensus_queue.cc:237] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.830302 10827 catalog_manager.cc:5697] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 3e77260a8a934c6890170e2460f0db1c (127.0.107.193) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.846812 11129 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.847378 11129 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.849134 11129 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:54.849822 11207 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
I20260709 13:05:54.850409 11207 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.850847 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e" is_pre_election: true
I20260709 13:05:54.851523 11080 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 1.
I20260709 13:05:54.853243 10971 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:54.854221 11129 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:54.854653 11129 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e77260a8a934c6890170e2460f0db1c)
W20260709 13:05:54.855036 10971 leader_election.cc:336] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.854949 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "825676b5b65144199f32bfbefc4b546b" is_pre_election: true
I20260709 13:05:54.855767 11207 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:54.855095 11129 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:54.856706 11045 leader_election.cc:336] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.861902 11129 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.863052 11007 raft_consensus.cc:2393] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 788149cd7a814d59abcebb55d9667a7e in current term 2: Already voted for candidate 825676b5b65144199f32bfbefc4b546b in this term.
I20260709 13:05:54.864128 11129 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:54.865065 11046 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e; no voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:54.866007 11207 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.866971 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
W20260709 13:05:54.868402 10971 leader_election.cc:336] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111)
I20260709 13:05:54.871376 11207 raft_consensus.cc:2749] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.876376 11080 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 2.
I20260709 13:05:54.877794 10971 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 3e77260a8a934c6890170e2460f0db1c
I20260709 13:05:54.878475 11129 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:54.878929 11129 raft_consensus.cc:697] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:54.879817 11129 consensus_queue.cc:237] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:54.887245 10827 catalog_manager.cc:5697] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 1 to 2, leader changed from 3e77260a8a934c6890170e2460f0db1c (127.0.107.193) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 2 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:55.207463 10971 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111) [suppressed 104 similar messages]
I20260709 13:05:55.224538 11080 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.225891 11132 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:55.241572 10971 consensus_peers.cc:597] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:55.276345 10971 consensus_peers.cc:597] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:55.317260 11045 consensus_peers.cc:597] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.383343 11007 raft_consensus.cc:1275] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.384819 11207 consensus_queue.cc:1048] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:55.424932 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:55.427744 11080 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.429553 11222 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:56.027133 10971 consensus_peers.cc:597] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.158368 10971 consensus_peers.cc:597] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.185544 11045 consensus_peers.cc:597] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.288554 10971 consensus_peers.cc:597] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.399241 10971 consensus_peers.cc:597] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.425916 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:56.551285 10971 consensus_peers.cc:597] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:56.572570 10971 consensus_peers.cc:597] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:57.427277 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:57.804227 10971 consensus_peers.cc:597] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:57.901441 10971 consensus_peers.cc:597] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:57.935824 11045 consensus_peers.cc:597] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:58.406680 10971 consensus_peers.cc:597] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:58.428740 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:58.479364   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:58.488018 11230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:58.488587 11231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:58.489763 11233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:58.494231   431 server_base.cc:1061] running on GCE node
I20260709 13:05:58.496461   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:58.496702   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:58.496929   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602358496909 us; error 0 us; skew 500 ppm
I20260709 13:05:58.497588   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:58.500547   431 webserver.cc:533] Webserver started at http://127.0.107.193:44401/ using document root <none> and password file <none>
I20260709 13:05:58.501125   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:58.501320   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:58.505736   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:58.510564 11238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:58.511590   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:05:58.512085   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "3e77260a8a934c6890170e2460f0db1c"
format_stamp: "Formatted at 2026-07-09 13:05:51 on dist-test-slave-rrf3"
I20260709 13:05:58.512565   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:58.540452   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:58.541932   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:58.543469   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:58.548780 11246 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:05:58.606343   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:05:58.606753   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:05:58.607019   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:05:58.613152 11246 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.630512 11246 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.631384 11246 tablet_bootstrap.cc:492] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.632073 11246 ts_tablet_manager.cc:1403] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:05:58.634838 11246 raft_consensus.cc:359] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.635715 11246 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.636540 11246 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.639361 11246 ts_tablet_manager.cc:1434] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:58.640180 11246 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.655491 11246 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.656386 11246 tablet_bootstrap.cc:492] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.656898   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:05:58.656958 11246 ts_tablet_manager.cc:1403] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:58.657265   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.050s	user 0.046s	sys 0.003s
I20260709 13:05:58.659751 11246 raft_consensus.cc:359] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.660374 11246 raft_consensus.cc:740] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.661163 11246 consensus_queue.cc:260] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.663199 11246 ts_tablet_manager.cc:1434] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:58.664019 11246 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
W20260709 13:05:58.664707 10971 consensus_peers.cc:597] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:58.680568 11045 consensus_peers.cc:597] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:58.683065 11246 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.684438 11246 tablet_bootstrap.cc:492] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.685339 11246 ts_tablet_manager.cc:1403] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:05:58.688966 11246 raft_consensus.cc:359] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:58.689863 11246 raft_consensus.cc:740] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.690833 11246 consensus_queue.cc:260] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:05:58.693385 11246 ts_tablet_manager.cc:1434] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:58.694361 11246 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.713640 11246 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.715046 11246 tablet_bootstrap.cc:492] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.715960 11246 ts_tablet_manager.cc:1403] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:05:58.717777   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43827
I20260709 13:05:58.717887 11307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43827 every 8 connection(s)
I20260709 13:05:58.719144 11246 raft_consensus.cc:359] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.719928 11246 raft_consensus.cc:740] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.720678 11246 consensus_queue.cc:260] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.723030 11246 ts_tablet_manager.cc:1434] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:58.724071 11246 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.724160   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.745388 11308 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37389
I20260709 13:05:58.745865 11308 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:58.747457 11308 heartbeater.cc:507] Master 127.0.107.254:37389 requested a full tablet report, sending...
I20260709 13:05:58.751688 11246 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.752811 11246 tablet_bootstrap.cc:492] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.753521 11246 ts_tablet_manager.cc:1403] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 13:05:58.755905 11246 raft_consensus.cc:359] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.756330 10827 ts_manager.cc:194] Re-registered known tserver with Master: 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827)
I20260709 13:05:58.756646 11246 raft_consensus.cc:740] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.757501 11246 consensus_queue.cc:260] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.759545 11246 ts_tablet_manager.cc:1434] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:58.760442 11246 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.763038 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11acc923d5ac4765add520238d112379"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:05:58.763938 11007 raft_consensus.cc:606] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:58.767436 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:05:58.767525 10827 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45746
I20260709 13:05:58.768077 11007 raft_consensus.cc:606] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:58.771166 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f398b478284572b805124f1a36f63e"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:05:58.771840 11007 raft_consensus.cc:606] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:58.772367 11308 heartbeater.cc:499] Master 127.0.107.254:37389 was elected leader, sending a full tablet report...
I20260709 13:05:58.782248 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:05:58.783049 11007 raft_consensus.cc:606] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:58.783529 11246 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.785404   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:58.785562 11246 tablet_bootstrap.cc:492] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.786476   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:58.786865 11246 ts_tablet_manager.cc:1403] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:05:58.787818   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.789904 11246 raft_consensus.cc:359] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.790771 11246 raft_consensus.cc:740] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.791706 11246 consensus_queue.cc:260] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.795305 11246 ts_tablet_manager.cc:1434] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:58.796267 11246 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.811669 11246 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.812523 11246 tablet_bootstrap.cc:492] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.813081 11246 ts_tablet_manager.cc:1403] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:05:58.815068 11246 raft_consensus.cc:359] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.815723 11246 raft_consensus.cc:740] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.816431 11246 consensus_queue.cc:260] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.818397 11246 ts_tablet_manager.cc:1434] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 13:05:58.818902 10971 consensus_peers.cc:597] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:58.819272 11246 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.835584 11246 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.836390 11246 tablet_bootstrap.cc:492] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.836982 11246 ts_tablet_manager.cc:1403] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:05:58.839146 11246 raft_consensus.cc:359] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.839682 11246 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.840344 11246 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.841923 11246 ts_tablet_manager.cc:1434] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:58.842783 11246 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.855723 11246 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.856688 11246 tablet_bootstrap.cc:492] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.857307 11246 ts_tablet_manager.cc:1403] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:05:58.859261 11246 raft_consensus.cc:359] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.859823 11246 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.860450 11246 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.862069 11246 ts_tablet_manager.cc:1434] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:58.863010 11246 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Bootstrap starting.
I20260709 13:05:58.876470 11246 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:58.877532 11246 tablet_bootstrap.cc:492] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Bootstrap complete.
I20260709 13:05:58.878182 11246 ts_tablet_manager.cc:1403] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 13:05:58.879812 11243 raft_consensus.cc:993] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.880997 11246 raft_consensus.cc:359] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.881650 11132 raft_consensus.cc:1081] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.881973 11243 raft_consensus.cc:993] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.882019 11246 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e77260a8a934c6890170e2460f0db1c, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.882650 11243 raft_consensus.cc:1081] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.883062 11246 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.883703 11079 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11acc923d5ac4765add520238d112379"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:05:58.884416 11079 raft_consensus.cc:493] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.884524 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62f398b478284572b805124f1a36f63e"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:05:58.884877 11079 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.885154 11080 raft_consensus.cc:493] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.885329 11246 ts_tablet_manager.cc:1434] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:05:58.885620 11080 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.894901 11080 raft_consensus.cc:515] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.894879 11079 raft_consensus.cc:515] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.899096 11079 leader_election.cc:290] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:58.901016 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:58.901844 11007 raft_consensus.cc:3055] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.902176 11007 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:58.903075 11007 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.904595 11007 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.903326 11080 leader_election.cc:290] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:58.904806 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:58.905558 11006 raft_consensus.cc:3055] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.905872 11006 raft_consensus.cc:740] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:58.906903 11006 consensus_queue.cc:260] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.908672 11006 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.911461 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f398b478284572b805124f1a36f63e" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:58.911854 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:58.912303 11282 raft_consensus.cc:3060] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.912611 11281 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.913846 11007 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:58.915586 11046 leader_election.cc:304] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:58.916702 11226 raft_consensus.cc:2804] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.917822 11006 raft_consensus.cc:2468] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:58.919283 11046 leader_election.cc:304] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 788149cd7a814d59abcebb55d9667a7e, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:58.920238 11282 raft_consensus.cc:2468] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:58.925748 11324 raft_consensus.cc:2804] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.926079 11281 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:58.926880 11324 raft_consensus.cc:697] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:58.928261 11226 raft_consensus.cc:697] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:58.928539 11324 consensus_queue.cc:237] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.929531 11226 consensus_queue.cc:237] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.937605 11281 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.940688 10827 catalog_manager.cc:5697] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.948076 11243 raft_consensus.cc:993] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.948743 11243 raft_consensus.cc:1081] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:58.951083 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:05:58.951658 11080 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.952015 11080 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.959869 11080 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.963956 11080 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 3 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:58.964754 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:58.965456 11281 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.965727 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:58.966367 11006 raft_consensus.cc:3055] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:58.966665 11006 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:58.967533 11006 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.967978 10830 catalog_manager.cc:5697] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.968950 11006 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.971213 11281 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 3.
I20260709 13:05:58.972704 11045 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:05:58.973637 11226 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:58.974115 11226 raft_consensus.cc:697] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:58.975034 11226 consensus_queue.cc:237] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:58.976541 11006 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 3.
I20260709 13:05:58.985855 10830 catalog_manager.cc:5697] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 2 to 3, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.028644 11281 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.186350 11243 raft_consensus.cc:993] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:59.186895 11243 raft_consensus.cc:1081] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:05:59.188563 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:05:59.189056 11080 raft_consensus.cc:493] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.189316 11080 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.194588 11080 raft_consensus.cc:515] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.196321 11080 leader_election.cc:290] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:05:59.197324 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:05:59.197351 11281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4c5a3b70e4823b4f315b6a21f495a" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:59.198139 11281 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.198114 11006 raft_consensus.cc:3055] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.198706 11006 raft_consensus.cc:740] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:59.199556 11006 consensus_queue.cc:260] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.200704 11006 raft_consensus.cc:3060] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.204380 11281 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:59.205765 11045 leader_election.cc:304] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:05:59.207016 11226 raft_consensus.cc:2804] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.207665 11226 raft_consensus.cc:697] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:59.209450 11226 consensus_queue.cc:237] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.211467 11006 raft_consensus.cc:2468] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:05:59.219743 10830 catalog_manager.cc:5697] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.320981 11281 raft_consensus.cc:1275] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.322368 11226 consensus_queue.cc:1048] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.334779 11006 raft_consensus.cc:1275] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.336563 11226 consensus_queue.cc:1048] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:59.429951 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:59.482033 11006 raft_consensus.cc:1275] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.483490 11323 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.491380 11281 raft_consensus.cc:1275] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.493196 11226 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.515026 11281 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.516534 11226 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.525879 11006 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:59.527663 11323 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:59.713573 11281 raft_consensus.cc:1275] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.715050 11323 consensus_queue.cc:1048] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.724177 11006 raft_consensus.cc:1275] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.725926 11226 consensus_queue.cc:1048] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.805274   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.822575 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11acc923d5ac4765add520238d112379"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:05:59.823174 11080 raft_consensus.cc:606] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:59.825866 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:05:59.826409 11080 raft_consensus.cc:606] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:05:59.829025 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:05:59.829567 11006 raft_consensus.cc:606] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:05:59.830808   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:59.831265   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:59.831789   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:59.913920 11324 raft_consensus.cc:993] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:05:59.914420 11226 raft_consensus.cc:1081] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:05:59.916353 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11acc923d5ac4765add520238d112379"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:05:59.916947 11006 raft_consensus.cc:493] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.917256 11006 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.922483 11006 raft_consensus.cc:515] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.924278 11006 leader_election.cc:290] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:05:59.925209 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:05:59.925465 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11acc923d5ac4765add520238d112379" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:05:59.925830 11282 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.926095 11080 raft_consensus.cc:3055] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.926560 11080 raft_consensus.cc:740] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:05:59.927229 11080 consensus_queue.cc:260] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.928244 11080 raft_consensus.cc:3060] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.931820 11282 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:05:59.933087 10971 leader_election.cc:304] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:05:59.933228 11080 raft_consensus.cc:2468] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:05:59.933943 11132 raft_consensus.cc:2804] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.934478 11132 raft_consensus.cc:697] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:05:59.935202 11132 consensus_queue.cc:237] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:05:59.941344 10829 catalog_manager.cc:5697] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 2 to 3, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.001224 11321 raft_consensus.cc:993] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:00.001730 11132 raft_consensus.cc:1081] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:00.003237 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:00.003701 11080 raft_consensus.cc:493] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.003993 11080 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.008778 11080 raft_consensus.cc:515] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.010753 11080 leader_election.cc:290] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:00.011651 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:00.011812 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255ab3c5e0845178fc0ed059d1e75f3" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:00.012686 11282 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.012831 11006 raft_consensus.cc:3055] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.013418 11006 raft_consensus.cc:740] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:00.014391 11006 consensus_queue.cc:260] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.015951 11006 raft_consensus.cc:3060] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.019059 11282 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:00.020475 11045 leader_election.cc:304] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:00.021669 11226 raft_consensus.cc:2804] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.021874 11006 raft_consensus.cc:2468] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:00.022367 11226 raft_consensus.cc:697] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:00.023610 11226 consensus_queue.cc:237] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.031580 10829 catalog_manager.cc:5697] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.138576 11324 raft_consensus.cc:993] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:00.139181 11226 raft_consensus.cc:1081] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:00.140986 11006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:06:00.141593 11006 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.141938 11006 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.147217 11006 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.149194 11006 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 4 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:06:00.150053 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:00.150233 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:06:00.150785 11282 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.150846 11080 raft_consensus.cc:3055] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.151346 11080 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:00.151997 11080 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.152921 11080 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.156126 11282 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 4.
I20260709 13:06:00.157235 10971 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:06:00.157843 11080 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 4.
I20260709 13:06:00.158043 11132 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:00.158627 11132 raft_consensus.cc:697] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:00.159354 11132 consensus_queue.cc:237] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.165009 10829 catalog_manager.cc:5697] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 3 to 4, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.314162 11282 raft_consensus.cc:1275] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.315526 11132 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.329746 11080 raft_consensus.cc:1275] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.331313 11355 consensus_queue.cc:1048] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.404388 11006 raft_consensus.cc:1275] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.406133 11324 consensus_queue.cc:1048] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.416468 11282 raft_consensus.cc:1275] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.418102 11226 consensus_queue.cc:1048] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:00.431107 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:00.666754 11282 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.668126 11355 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.678324 11080 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:00.680883 11355 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:00.841427   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.851325 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:06:00.851989 11006 raft_consensus.cc:606] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:06:00.854749 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:06:00.855302 11080 raft_consensus.cc:606] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:06:00.857978 11006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:06:00.858597 11006 raft_consensus.cc:606] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:06:00.859634   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:00.860185   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:00.860797   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.876596 11132 raft_consensus.cc:993] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:00.877214 11355 raft_consensus.cc:1081] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:00.878712 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:00.879212 11080 raft_consensus.cc:493] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.879567 11080 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.884341 11080 raft_consensus.cc:515] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.885910 11080 leader_election.cc:290] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:00.886859 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:00.886879 11006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:00.887629 11282 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.887670 11006 raft_consensus.cc:3055] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.888193 11006 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:00.888970 11006 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.890022 11006 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.894320 11282 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:00.894990 11324 raft_consensus.cc:993] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:00.895552 11045 leader_election.cc:304] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:00.895604 11226 raft_consensus.cc:1081] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:00.896476 11324 raft_consensus.cc:2804] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.896935 11324 raft_consensus.cc:697] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:00.897354 11006 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:00.897840 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:06:00.898532 11007 raft_consensus.cc:493] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.898913 11007 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.897948 11324 consensus_queue.cc:237] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.906245 11007 raft_consensus.cc:515] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.908001 11007 leader_election.cc:290] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:06:00.907323 10829 catalog_manager.cc:5697] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.908721 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:00.909440 11282 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.909674 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc7f1cef7f14b93b2cd0979da38430a" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:06:00.910207 11080 raft_consensus.cc:3055] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.910430 11080 raft_consensus.cc:740] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:00.911031 11080 consensus_queue.cc:260] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.912087 11080 raft_consensus.cc:3060] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.916006 11282 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:06:00.917503 10971 leader_election.cc:304] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:06:00.918183 11080 raft_consensus.cc:2468] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:06:00.918530 11355 raft_consensus.cc:2804] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.919050 11355 raft_consensus.cc:697] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:00.919916 11355 consensus_queue.cc:237] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:00.928633 10827 catalog_manager.cc:5697] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 2 to 3, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.308766 11321 raft_consensus.cc:993] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:01.309326 11355 raft_consensus.cc:1081] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:01.310824 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:01.311281 11080 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:01.311573 11080 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.316445 11080 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.317894 11080 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 3 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:01.318755 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:01.318835 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:01.319411 11282 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.319598 11007 raft_consensus.cc:3055] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.320005 11007 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:01.320799 11007 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.321806 11007 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.326776 11282 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 3.
I20260709 13:06:01.328007 11007 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 3.
I20260709 13:06:01.328212 11045 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:01.329226 11324 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:01.329651 11324 raft_consensus.cc:697] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:01.330514 11324 consensus_queue.cc:237] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.337651 10827 catalog_manager.cc:5697] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 2 to 3, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.377195 11282 raft_consensus.cc:1275] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.378464 11324 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.388736 11007 raft_consensus.cc:1275] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.390435 11324 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.407171 11080 raft_consensus.cc:1275] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:01.408464 11355 consensus_queue.cc:1048] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.420171 11282 raft_consensus.cc:1275] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:01.421834 11355 consensus_queue.cc:1048] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:01.432241 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:01.725625 11281 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:01.727371 11324 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.740162 11007 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:01.741475 11324 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.867611   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:01.876390 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8215c846dc75432eafceeca695c689f1"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:06:01.877009 11007 raft_consensus.cc:606] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:06:01.880067 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d13796b4cdf64141a736219a69766304"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:06:01.880566 11080 raft_consensus.cc:606] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:06:01.883244 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:06:01.883750 11080 raft_consensus.cc:606] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:06:01.884939 11376 raft_consensus.cc:993] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:01.885010   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:01.885524 11324 raft_consensus.cc:1081] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:01.885844   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:01.886545   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:01.887040 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d13796b4cdf64141a736219a69766304"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:06:01.887565 11007 raft_consensus.cc:493] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:01.887863 11007 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.893110 11007 raft_consensus.cc:515] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.894752 11007 leader_election.cc:290] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:06:01.895694 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:01.896095 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13796b4cdf64141a736219a69766304" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:06:01.896507 11282 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.896708 11080 raft_consensus.cc:3055] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.897100 11080 raft_consensus.cc:740] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:01.898217 11080 consensus_queue.cc:260] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.899554 11080 raft_consensus.cc:3060] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.904484 11282 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 2.
I20260709 13:06:01.905934 10971 leader_election.cc:304] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:06:01.906505 11080 raft_consensus.cc:2468] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 2.
I20260709 13:06:01.906800 11132 raft_consensus.cc:2804] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:01.907409 11132 raft_consensus.cc:697] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:01.908195 11132 consensus_queue.cc:237] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:01.914719 10829 catalog_manager.cc:5697] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 1 to 2, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 2 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.241472 11376 raft_consensus.cc:993] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:02.241955 11226 raft_consensus.cc:1081] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:02.243664 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:06:02.244313 11007 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.244681 11007 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.250200 11007 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.251909 11007 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 4 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:06:02.252900 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:02.252995 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:06:02.253732 11282 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.253825 11080 raft_consensus.cc:3055] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:02.254290 11080 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:02.254927 11080 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.255757 11080 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.259364 11282 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 4.
I20260709 13:06:02.260246 11080 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 4.
I20260709 13:06:02.260703 10971 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:06:02.261788 11132 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:02.262275 11132 raft_consensus.cc:697] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:02.262929 11132 consensus_queue.cc:237] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.269003 10829 catalog_manager.cc:5697] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 3 to 4, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.325002 11282 raft_consensus.cc:1275] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.326349 11132 consensus_queue.cc:1048] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.337080 11080 raft_consensus.cc:1275] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:02.338727 11132 consensus_queue.cc:1048] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:02.433197 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:02.439566 11355 raft_consensus.cc:993] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:02.440196 11132 raft_consensus.cc:1081] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:02.441673 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8215c846dc75432eafceeca695c689f1"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:02.442193 11080 raft_consensus.cc:493] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.442477 11080 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.446957 11080 raft_consensus.cc:515] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:06:02.448668 11080 leader_election.cc:290] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:02.450069 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:02.450680 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8215c846dc75432eafceeca695c689f1" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:02.450760 11282 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.451464 11007 raft_consensus.cc:3055] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:02.451872 11007 raft_consensus.cc:740] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:02.452582 11007 consensus_queue.cc:260] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:06:02.453503 11007 raft_consensus.cc:3060] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.456756 11282 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:02.457932 11045 leader_election.cc:304] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:02.458037 11007 raft_consensus.cc:2468] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 2.
I20260709 13:06:02.458737 11226 raft_consensus.cc:2804] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.459225 11226 raft_consensus.cc:697] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:02.460172 11226 consensus_queue.cc:237] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } }
I20260709 13:06:02.469105 10827 catalog_manager.cc:5697] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 1 to 2, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.676268 11080 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:02.677572 11132 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:02.684964 11282 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:02.687227 11355 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:02.893874   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:02.901473 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:06:02.902017 11007 raft_consensus.cc:606] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:06:02.904500 11080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
mode: GRACEFUL
new_leader_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:06:02.905103 11080 raft_consensus.cc:606] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Received request to transfer leadership to TS 825676b5b65144199f32bfbefc4b546b
I20260709 13:06:02.907758 11007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
mode: GRACEFUL
new_leader_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:52316
I20260709 13:06:02.908407 11007 raft_consensus.cc:606] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Received request to transfer leadership to TS 788149cd7a814d59abcebb55d9667a7e
I20260709 13:06:02.909442   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:02.909957   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:02.910634   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:02.940766 11321 raft_consensus.cc:993] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:02.941290 11355 raft_consensus.cc:1081] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:02.942929 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:02.943403 11080 raft_consensus.cc:493] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:02.943655 11080 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.948385 11080 raft_consensus.cc:515] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.949885 11080 leader_election.cc:290] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 5 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:02.950920 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:02.950898 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860ba08c2b704988aab1d239911d0aa8" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:02.951684 11007 raft_consensus.cc:3055] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:02.951735 11282 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.952121 11007 raft_consensus.cc:740] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:02.952872 11007 consensus_queue.cc:260] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.954037 11007 raft_consensus.cc:3060] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.958365 11282 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 5.
I20260709 13:06:02.959676 11045 leader_election.cc:304] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:02.960100 11007 raft_consensus.cc:2468] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 5.
I20260709 13:06:02.960542 11226 raft_consensus.cc:2804] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:02.961113 11226 raft_consensus.cc:697] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 5 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:02.961951 11226 consensus_queue.cc:237] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:02.968456 10829 catalog_manager.cc:5697] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 4 to 5, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.046551 11376 raft_consensus.cc:993] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: : Instructing follower 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:03.047190 11226 raft_consensus.cc:1081] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Signalling peer 825676b5b65144199f32bfbefc4b546b to start an election
I20260709 13:06:03.048965 11007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa"
dest_uuid: "825676b5b65144199f32bfbefc4b546b"
 from {username='slave'} at 127.0.0.1:52900
I20260709 13:06:03.049438 11007 raft_consensus.cc:493] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.049723 11007 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.052438 11281 raft_consensus.cc:1275] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.054133 11226 consensus_queue.cc:1048] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.055227 11007 raft_consensus.cc:515] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.057109 11007 leader_election.cc:290] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 788149cd7a814d59abcebb55d9667a7e (127.0.107.195:42623)
I20260709 13:06:03.058109 11080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
I20260709 13:06:03.058760 11080 raft_consensus.cc:3055] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.059300 11080 raft_consensus.cc:740] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:03.058745 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66d06e9c7a24e168171e2c9799d6daa" candidate_uuid: "825676b5b65144199f32bfbefc4b546b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:03.060062 11282 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.060196 11080 consensus_queue.cc:260] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.061558 11080 raft_consensus.cc:3060] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.068828 11282 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:06:03.070385 10971 leader_election.cc:304] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 825676b5b65144199f32bfbefc4b546b; no voters: 
I20260709 13:06:03.071228 11355 raft_consensus.cc:2804] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:03.071643 11007 raft_consensus.cc:1275] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.071748 11355 raft_consensus.cc:697] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Becoming Leader. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:03.072880 11355 consensus_queue.cc:237] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.073985 11226 consensus_queue.cc:1048] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.074379 11080 raft_consensus.cc:2468] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 825676b5b65144199f32bfbefc4b546b in term 3.
I20260709 13:06:03.082379 10827 catalog_manager.cc:5697] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b reported cstate change: term changed from 2 to 3, leader changed from 788149cd7a814d59abcebb55d9667a7e (127.0.107.195) to 825676b5b65144199f32bfbefc4b546b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "825676b5b65144199f32bfbefc4b546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.242259 11355 raft_consensus.cc:993] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: : Instructing follower 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:03.242816 11132 raft_consensus.cc:1081] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Signalling peer 788149cd7a814d59abcebb55d9667a7e to start an election
I20260709 13:06:03.244421 11080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f879bb12486144b9a6560134ad435561"
dest_uuid: "788149cd7a814d59abcebb55d9667a7e"
 from {username='slave'} at 127.0.0.1:35642
I20260709 13:06:03.244961 11080 raft_consensus.cc:493] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.245381 11080 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.250682 11080 raft_consensus.cc:515] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.252518 11080 leader_election.cc:290] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 5 election: Requested vote from peers 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827), 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363)
I20260709 13:06:03.253324 11282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3e77260a8a934c6890170e2460f0db1c"
I20260709 13:06:03.253580 11007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f879bb12486144b9a6560134ad435561" candidate_uuid: "788149cd7a814d59abcebb55d9667a7e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "825676b5b65144199f32bfbefc4b546b"
I20260709 13:06:03.253945 11282 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.254170 11007 raft_consensus.cc:3055] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:03.254534 11007 raft_consensus.cc:740] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 825676b5b65144199f32bfbefc4b546b, State: Running, Role: LEADER
I20260709 13:06:03.255465 11007 consensus_queue.cc:260] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.256424 11007 raft_consensus.cc:3060] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.258982 11282 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 5.
I20260709 13:06:03.260128 11045 leader_election.cc:304] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e77260a8a934c6890170e2460f0db1c, 788149cd7a814d59abcebb55d9667a7e; no voters: 
I20260709 13:06:03.261014 11376 raft_consensus.cc:2804] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:03.261298 11007 raft_consensus.cc:2468] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 788149cd7a814d59abcebb55d9667a7e in term 5.
I20260709 13:06:03.261478 11376 raft_consensus.cc:697] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 5 LEADER]: Becoming Leader. State: Replica: 788149cd7a814d59abcebb55d9667a7e, State: Running, Role: LEADER
I20260709 13:06:03.262421 11376 consensus_queue.cc:237] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } }
I20260709 13:06:03.269291 10827 catalog_manager.cc:5697] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e reported cstate change: term changed from 4 to 5, leader changed from 825676b5b65144199f32bfbefc4b546b (127.0.107.194) to 788149cd7a814d59abcebb55d9667a7e (127.0.107.195). New cstate: current_term: 5 leader_uuid: "788149cd7a814d59abcebb55d9667a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.354120 11282 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:03.355655 11376 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:03.367251 11007 raft_consensus.cc:1275] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:03.370153 11394 consensus_queue.cc:1048] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:03.434309 10878 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:06:03.469089 11282 raft_consensus.cc:1275] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:03.470723 11132 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.471915 11080 raft_consensus.cc:1275] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Refusing update from remote peer 825676b5b65144199f32bfbefc4b546b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:03.473415 11132 consensus_queue.cc:1048] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "788149cd7a814d59abcebb55d9667a7e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.686218 11007 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:03.687496 11226 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "825676b5b65144199f32bfbefc4b546b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:03.697379 11282 raft_consensus.cc:1275] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Refusing update from remote peer 788149cd7a814d59abcebb55d9667a7e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:03.698999 11376 consensus_queue.cc:1048] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e77260a8a934c6890170e2460f0db1c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:03.920343   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:03.951697   431 tablet_server.cc:179] TabletServer@127.0.107.193:43827 shutting down...
W20260709 13:06:03.968206 11045 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 70 similar messages]
W20260709 13:06:03.971468 11045 consensus_peers.cc:597] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.976629   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:03.977494   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.978255   431 raft_consensus.cc:2243] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.978767   431 raft_consensus.cc:2272] T f879bb12486144b9a6560134ad435561 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.981933   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.982544   431 raft_consensus.cc:2243] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.983000   431 raft_consensus.cc:2272] T bbc7f1cef7f14b93b2cd0979da38430a P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.984939   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.985486   431 raft_consensus.cc:2243] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.985972   431 raft_consensus.cc:2272] T 860ba08c2b704988aab1d239911d0aa8 P 3e77260a8a934c6890170e2460f0db1c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.988983   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.992632   431 raft_consensus.cc:2243] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.993294   431 raft_consensus.cc:2272] T 44d4c5a3b70e4823b4f315b6a21f495a P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:03.993745 10971 consensus_peers.cc:597] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.995292   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.995968   431 raft_consensus.cc:2243] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.996495   431 raft_consensus.cc:2272] T d13796b4cdf64141a736219a69766304 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.998430   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:03.998988   431 raft_consensus.cc:2243] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.999351   431 raft_consensus.cc:2272] T 62f398b478284572b805124f1a36f63e P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.001231   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:04.001721   431 raft_consensus.cc:2243] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.002079   431 raft_consensus.cc:2272] T a66d06e9c7a24e168171e2c9799d6daa P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.004673   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:04.005172   431 raft_consensus.cc:2243] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.005524   431 raft_consensus.cc:2272] T 8215c846dc75432eafceeca695c689f1 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.007828   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:04.008507   431 raft_consensus.cc:2243] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.008879   431 raft_consensus.cc:2272] T 9255ab3c5e0845178fc0ed059d1e75f3 P 3e77260a8a934c6890170e2460f0db1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.010596   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:06:04.011021   431 raft_consensus.cc:2243] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.011384   431 raft_consensus.cc:2272] T 11acc923d5ac4765add520238d112379 P 3e77260a8a934c6890170e2460f0db1c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:04.032398 11045 consensus_peers.cc:597] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.040972   431 tablet_server.cc:196] TabletServer@127.0.107.193:43827 shutdown complete.
I20260709 13:06:04.060922   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:06:04.085242   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:04.086035   431 tablet_replica.cc:333] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.086841   431 raft_consensus.cc:2243] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.087630   431 raft_consensus.cc:2272] T bbc7f1cef7f14b93b2cd0979da38430a P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.089756   431 tablet_replica.cc:333] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.090334   431 raft_consensus.cc:2243] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.090766   431 raft_consensus.cc:2272] T 44d4c5a3b70e4823b4f315b6a21f495a P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.092774   431 tablet_replica.cc:333] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.093359   431 raft_consensus.cc:2243] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.093768   431 raft_consensus.cc:2272] T 860ba08c2b704988aab1d239911d0aa8 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.096383   431 tablet_replica.cc:333] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.096923   431 raft_consensus.cc:2243] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.097333   431 raft_consensus.cc:2272] T f879bb12486144b9a6560134ad435561 P 825676b5b65144199f32bfbefc4b546b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.099836   431 tablet_replica.cc:333] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.100454   431 raft_consensus.cc:2243] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.101174   431 raft_consensus.cc:2272] T d13796b4cdf64141a736219a69766304 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.103125   431 tablet_replica.cc:333] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.103631   431 raft_consensus.cc:2243] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.104067   431 raft_consensus.cc:2272] T 9255ab3c5e0845178fc0ed059d1e75f3 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.106113   431 tablet_replica.cc:333] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.106582   431 raft_consensus.cc:2243] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.107306   431 raft_consensus.cc:2272] T 11acc923d5ac4765add520238d112379 P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.109414   431 tablet_replica.cc:333] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.109966   431 raft_consensus.cc:2243] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.110721   431 raft_consensus.cc:2272] T a66d06e9c7a24e168171e2c9799d6daa P 825676b5b65144199f32bfbefc4b546b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.113071   431 tablet_replica.cc:333] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.113588   431 raft_consensus.cc:2243] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.114013   431 raft_consensus.cc:2272] T 8215c846dc75432eafceeca695c689f1 P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.115800   431 tablet_replica.cc:333] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b: stopping tablet replica
I20260709 13:06:04.116357   431 raft_consensus.cc:2243] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.116763   431 raft_consensus.cc:2272] T 62f398b478284572b805124f1a36f63e P 825676b5b65144199f32bfbefc4b546b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:04.146478 11046 consensus_peers.cc:597] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e -> Peer 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363): Couldn't send request to peer 825676b5b65144199f32bfbefc4b546b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.148540   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:06:04.166003 11045 consensus_peers.cc:597] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e -> Peer 3e77260a8a934c6890170e2460f0db1c (127.0.107.193:43827): Couldn't send request to peer 3e77260a8a934c6890170e2460f0db1c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:04.168174 11046 consensus_peers.cc:597] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e -> Peer 825676b5b65144199f32bfbefc4b546b (127.0.107.194:43363): Couldn't send request to peer 825676b5b65144199f32bfbefc4b546b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.177985   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:06:04.204196   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:04.205320   431 tablet_replica.cc:333] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.206200   431 raft_consensus.cc:2243] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.206709   431 raft_consensus.cc:2272] T bbc7f1cef7f14b93b2cd0979da38430a P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.209105   431 tablet_replica.cc:333] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.209750   431 raft_consensus.cc:2243] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.210531   431 raft_consensus.cc:2272] T 62f398b478284572b805124f1a36f63e P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.212637   431 tablet_replica.cc:333] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.213249   431 raft_consensus.cc:2243] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.214023   431 raft_consensus.cc:2272] T 44d4c5a3b70e4823b4f315b6a21f495a P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.216094   431 tablet_replica.cc:333] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.216696   431 raft_consensus.cc:2243] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.217464   431 raft_consensus.cc:2272] T 860ba08c2b704988aab1d239911d0aa8 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.220679   431 tablet_replica.cc:333] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.221292   431 raft_consensus.cc:2243] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.222060   431 raft_consensus.cc:2272] T 9255ab3c5e0845178fc0ed059d1e75f3 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.224575   431 tablet_replica.cc:333] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.225135   431 raft_consensus.cc:2243] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.225883   431 raft_consensus.cc:2272] T 8215c846dc75432eafceeca695c689f1 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.227895   431 tablet_replica.cc:333] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.228508   431 raft_consensus.cc:2243] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.228957   431 raft_consensus.cc:2272] T a66d06e9c7a24e168171e2c9799d6daa P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.231662   431 tablet_replica.cc:333] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.232261   431 raft_consensus.cc:2243] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.232753   431 raft_consensus.cc:2272] T 11acc923d5ac4765add520238d112379 P 788149cd7a814d59abcebb55d9667a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.234983   431 tablet_replica.cc:333] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.235468   431 raft_consensus.cc:2243] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.236291   431 raft_consensus.cc:2272] T f879bb12486144b9a6560134ad435561 P 788149cd7a814d59abcebb55d9667a7e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.238677   431 tablet_replica.cc:333] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e: stopping tablet replica
I20260709 13:06:04.239184   431 raft_consensus.cc:2243] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.239624   431 raft_consensus.cc:2272] T d13796b4cdf64141a736219a69766304 P 788149cd7a814d59abcebb55d9667a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.274123   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:06:04.300148   431 master.cc:562] Master@127.0.107.254:37389 shutting down...
I20260709 13:06:04.324295   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.324832   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.325119   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8da14c19eb60471f8fbcd854048b522b: stopping tablet replica
I20260709 13:06:04.346225   431 master.cc:584] Master@127.0.107.254:37389 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13112 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:06:04.391376   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45681
I20260709 13:06:04.392783   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:04.398696 11407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.398743 11408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.399734 11410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.400135   431 server_base.cc:1061] running on GCE node
I20260709 13:06:04.401147   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:04.401317   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:04.401446   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602364401434 us; error 0 us; skew 500 ppm
I20260709 13:06:04.401904   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:04.404604   431 webserver.cc:533] Webserver started at http://127.0.107.254:37321/ using document root <none> and password file <none>
I20260709 13:06:04.405093   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:04.405246   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:04.405584   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:04.406783   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "186aa2b2432941679f4016e7c55ebf62"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.411893   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260709 13:06:04.415469 11415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.416417   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:04.416726   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "186aa2b2432941679f4016e7c55ebf62"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.417027   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:04.443760   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:04.444996   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:04.484683   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45681
I20260709 13:06:04.484786 11466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45681 every 8 connection(s)
I20260709 13:06:04.488708 11467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:04.501403 11467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62: Bootstrap starting.
I20260709 13:06:04.506235 11467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:04.510783 11467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62: No bootstrap required, opened a new log
I20260709 13:06:04.513054 11467 raft_consensus.cc:359] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER }
I20260709 13:06:04.513453 11467 raft_consensus.cc:385] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:04.513732 11467 raft_consensus.cc:740] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 186aa2b2432941679f4016e7c55ebf62, State: Initialized, Role: FOLLOWER
I20260709 13:06:04.514398 11467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER }
I20260709 13:06:04.514869 11467 raft_consensus.cc:399] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:04.515089 11467 raft_consensus.cc:493] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:04.515334 11467 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:04.520637 11467 raft_consensus.cc:515] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER }
I20260709 13:06:04.521191 11467 leader_election.cc:304] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 186aa2b2432941679f4016e7c55ebf62; no voters: 
I20260709 13:06:04.522351 11467 leader_election.cc:290] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:04.522746 11470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:04.524245 11470 raft_consensus.cc:697] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 1 LEADER]: Becoming Leader. State: Replica: 186aa2b2432941679f4016e7c55ebf62, State: Running, Role: LEADER
I20260709 13:06:04.524964 11470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER }
I20260709 13:06:04.525354 11467 sys_catalog.cc:565] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:04.528007 11471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "186aa2b2432941679f4016e7c55ebf62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER } }
I20260709 13:06:04.528015 11472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 186aa2b2432941679f4016e7c55ebf62. Latest consensus state: current_term: 1 leader_uuid: "186aa2b2432941679f4016e7c55ebf62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "186aa2b2432941679f4016e7c55ebf62" member_type: VOTER } }
I20260709 13:06:04.529251 11471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:04.529405 11472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:04.533311 11475 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:04.540480 11475 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:04.541666   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:04.549748 11475 catalog_manager.cc:1383] Generated new cluster ID: 9b462914c1554532adfce9d8d96b67c4
I20260709 13:06:04.550062 11475 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:04.569288 11475 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:04.570727 11475 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:04.590242 11475 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62: Generated new TSK 0
I20260709 13:06:04.590906 11475 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:04.609227   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:04.615712 11488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.616899 11489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.620144   431 server_base.cc:1061] running on GCE node
W20260709 13:06:04.620525 11491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.622282   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:04.622502   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:04.622752   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602364622730 us; error 0 us; skew 500 ppm
I20260709 13:06:04.623347   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:04.626693   431 webserver.cc:533] Webserver started at http://127.0.107.193:42361/ using document root <none> and password file <none>
I20260709 13:06:04.627390   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:04.627576   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:04.627945   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:04.629576   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "67060dd1288243f280fea6ade55d8080"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.634423   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:04.638154 11496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.639088   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:04.639418   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "67060dd1288243f280fea6ade55d8080"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.639705   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:04.658855   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:04.660218   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:04.661811   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:04.664304   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:04.664547   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.664868   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:04.665036   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.706660   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40879
I20260709 13:06:04.706779 11558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40879 every 8 connection(s)
I20260709 13:06:04.711772   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:04.719425 11563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.719843 11564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.723084 11566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.724289   431 server_base.cc:1061] running on GCE node
I20260709 13:06:04.725602   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:04.725863   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:04.726074   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602364726041 us; error 0 us; skew 500 ppm
I20260709 13:06:04.726797   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:04.726852 11559 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45681
I20260709 13:06:04.727283 11559 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:04.728283 11559 heartbeater.cc:507] Master 127.0.107.254:45681 requested a full tablet report, sending...
I20260709 13:06:04.729907   431 webserver.cc:533] Webserver started at http://127.0.107.194:38399/ using document root <none> and password file <none>
I20260709 13:06:04.730595   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:04.730842   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:04.730820 11432 ts_manager.cc:194] Registered new tserver with Master: 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879)
I20260709 13:06:04.731317   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:04.732496   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.732955 11432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47984
I20260709 13:06:04.737699   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:06:04.741410 11571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.742195   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:04.742513   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.742816   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:04.756999   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:04.758245   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:04.759758   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:04.762095   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:04.762319   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.762571   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:04.762742   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.808442   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43021
I20260709 13:06:04.808547 11633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43021 every 8 connection(s)
I20260709 13:06:04.813704   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:04.821578 11637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:04.823110 11638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.826427   431 server_base.cc:1061] running on GCE node
I20260709 13:06:04.827499 11634 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45681
I20260709 13:06:04.827986 11634 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:04.828308 11640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:04.828960 11634 heartbeater.cc:507] Master 127.0.107.254:45681 requested a full tablet report, sending...
I20260709 13:06:04.829445   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:04.829744   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:04.829959   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602364829938 us; error 0 us; skew 500 ppm
I20260709 13:06:04.830605   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:04.831435 11432 ts_manager.cc:194] Registered new tserver with Master: 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:04.833158 11432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47988
I20260709 13:06:04.833410   431 webserver.cc:533] Webserver started at http://127.0.107.195:32889/ using document root <none> and password file <none>
I20260709 13:06:04.833997   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:04.834215   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:04.834497   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:04.835898   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "37082af638174239ad44e4bd87106a13"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.840502   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:04.844199 11645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.845160   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:06:04.845502   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "37082af638174239ad44e4bd87106a13"
format_stamp: "Formatted at 2026-07-09 13:06:04 on dist-test-slave-rrf3"
I20260709 13:06:04.845813   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:04.873338   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:04.874619   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:04.876309   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:04.878551   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:04.878791   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.879052   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:04.879232   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:04.922447   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34315
I20260709 13:06:04.922564 11707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34315 every 8 connection(s)
I20260709 13:06:04.938969 11708 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45681
I20260709 13:06:04.939486 11708 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:04.940356 11708 heartbeater.cc:507] Master 127.0.107.254:45681 requested a full tablet report, sending...
I20260709 13:06:04.942521 11432 ts_manager.cc:194] Registered new tserver with Master: 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:04.943257   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017525897s
I20260709 13:06:04.944016 11432 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48004
I20260709 13:06:04.973963 11432 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48006:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:04.976305 11432 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:05.038672 11599 tablet_service.cc:1511] Processing CreateTablet for tablet cb46eb4cb53e44339135ad74f08fee78 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.040835 11672 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6432a578be4da5b0de856d3335181d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.041098 11598 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6432a578be4da5b0de856d3335181d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.040838 11673 tablet_service.cc:1511] Processing CreateTablet for tablet cb46eb4cb53e44339135ad74f08fee78 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.042379 11672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6432a578be4da5b0de856d3335181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.042439 11599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb46eb4cb53e44339135ad74f08fee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.043399 11598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6432a578be4da5b0de856d3335181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.044823 11673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb46eb4cb53e44339135ad74f08fee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.057863 11524 tablet_service.cc:1511] Processing CreateTablet for tablet cb46eb4cb53e44339135ad74f08fee78 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.059341 11524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb46eb4cb53e44339135ad74f08fee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.063387 11523 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6432a578be4da5b0de856d3335181d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32c5db77ea96478eb765e1e876214646]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.064842 11523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6432a578be4da5b0de856d3335181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.085299 11723 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: Bootstrap starting.
I20260709 13:06:05.093318 11724 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: Bootstrap starting.
I20260709 13:06:05.097635 11725 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: Bootstrap starting.
I20260709 13:06:05.097841 11723 tablet_bootstrap.cc:654] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.102469 11724 tablet_bootstrap.cc:654] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.102981 11723 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: No bootstrap required, opened a new log
I20260709 13:06:05.103442 11723 ts_tablet_manager.cc:1403] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:06:05.105322 11725 tablet_bootstrap.cc:654] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.105948 11723 raft_consensus.cc:359] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.106920 11723 raft_consensus.cc:385] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.107221 11723 raft_consensus.cc:740] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f30d79bbdf9413f9c0326e36cdd98a5, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.108502 11724 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: No bootstrap required, opened a new log
I20260709 13:06:05.108009 11723 consensus_queue.cc:260] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.109107 11724 ts_tablet_manager.cc:1403] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:06:05.113317 11724 raft_consensus.cc:359] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.114045 11724 raft_consensus.cc:385] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.114336 11724 raft_consensus.cc:740] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.114346 11723 ts_tablet_manager.cc:1434] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.009s
I20260709 13:06:05.114739 11725 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: No bootstrap required, opened a new log
I20260709 13:06:05.115315 11725 ts_tablet_manager.cc:1403] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:06:05.115327 11634 heartbeater.cc:499] Master 127.0.107.254:45681 was elected leader, sending a full tablet report...
I20260709 13:06:05.115185 11724 consensus_queue.cc:260] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.115927 11723 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: Bootstrap starting.
I20260709 13:06:05.118671 11725 raft_consensus.cc:359] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.119449 11725 raft_consensus.cc:385] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.119831 11725 raft_consensus.cc:740] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.121075 11725 consensus_queue.cc:260] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.124778 11723 tablet_bootstrap.cc:654] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.127840 11725 ts_tablet_manager.cc:1434] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:06:05.128731 11559 heartbeater.cc:499] Master 127.0.107.254:45681 was elected leader, sending a full tablet report...
I20260709 13:06:05.133107 11725 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: Bootstrap starting.
I20260709 13:06:05.137866 11708 heartbeater.cc:499] Master 127.0.107.254:45681 was elected leader, sending a full tablet report...
I20260709 13:06:05.138290 11724 ts_tablet_manager.cc:1434] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: Time spent starting tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:06:05.139734 11724 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: Bootstrap starting.
I20260709 13:06:05.146176 11725 tablet_bootstrap.cc:654] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.148952 11724 tablet_bootstrap.cc:654] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.156495 11723 tablet_bootstrap.cc:492] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: No bootstrap required, opened a new log
I20260709 13:06:05.157325 11723 ts_tablet_manager.cc:1403] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.031s
I20260709 13:06:05.161465 11723 raft_consensus.cc:359] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.162582 11723 raft_consensus.cc:385] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.162976 11723 raft_consensus.cc:740] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f30d79bbdf9413f9c0326e36cdd98a5, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.163880 11723 consensus_queue.cc:260] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.164917 11725 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: No bootstrap required, opened a new log
I20260709 13:06:05.165449 11725 ts_tablet_manager.cc:1403] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.011s
I20260709 13:06:05.165470 11724 tablet_bootstrap.cc:492] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: No bootstrap required, opened a new log
I20260709 13:06:05.166184 11724 ts_tablet_manager.cc:1403] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.013s
I20260709 13:06:05.166882 11723 ts_tablet_manager.cc:1434] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:05.168598 11725 raft_consensus.cc:359] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.169232 11725 raft_consensus.cc:385] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.169019 11724 raft_consensus.cc:359] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.169530 11725 raft_consensus.cc:740] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.169895 11724 raft_consensus.cc:385] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.170277 11724 raft_consensus.cc:740] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.170357 11725 consensus_queue.cc:260] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.171058 11724 consensus_queue.cc:260] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.173238 11724 ts_tablet_manager.cc:1434] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:06:05.174888 11725 ts_tablet_manager.cc:1434] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:06:05.182425 11730 raft_consensus.cc:493] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.182953 11730 raft_consensus.cc:515] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.185573 11730 leader_election.cc:290] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.195897 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6432a578be4da5b0de856d3335181d" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080" is_pre_election: true
I20260709 13:06:05.196789 11534 raft_consensus.cc:2468] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.197507 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6432a578be4da5b0de856d3335181d" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" is_pre_election: true
I20260709 13:06:05.197916 11648 leader_election.cc:304] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.198222 11609 raft_consensus.cc:2468] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.198805 11730 raft_consensus.cc:2804] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.199167 11730 raft_consensus.cc:493] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.199448 11730 raft_consensus.cc:3060] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.204820 11730 raft_consensus.cc:515] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.206492 11730 leader_election.cc:290] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Requested vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.207424 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6432a578be4da5b0de856d3335181d" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080"
I20260709 13:06:05.207831 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6432a578be4da5b0de856d3335181d" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:05.208159 11534 raft_consensus.cc:3060] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.208462 11609 raft_consensus.cc:3060] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.216086 11609 raft_consensus.cc:2468] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.216090 11534 raft_consensus.cc:2468] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.217496 11648 leader_election.cc:304] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.218245 11730 raft_consensus.cc:2804] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.219477 11730 raft_consensus.cc:697] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Becoming Leader. State: Replica: 37082af638174239ad44e4bd87106a13, State: Running, Role: LEADER
I20260709 13:06:05.220311 11730 consensus_queue.cc:237] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.227397 11429 catalog_manager.cc:5697] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37082af638174239ad44e4bd87106a13 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "37082af638174239ad44e4bd87106a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.342677 11731 raft_consensus.cc:493] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.343360 11731 raft_consensus.cc:515] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.345902 11731 leader_election.cc:290] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021), 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:05.356341 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb46eb4cb53e44339135ad74f08fee78" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" is_pre_election: true
I20260709 13:06:05.357249 11609 raft_consensus.cc:2468] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 0.
I20260709 13:06:05.358410 11499 leader_election.cc:304] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f30d79bbdf9413f9c0326e36cdd98a5, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.359164 11731 raft_consensus.cc:2804] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.359513 11731 raft_consensus.cc:493] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.359306 11683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb46eb4cb53e44339135ad74f08fee78" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37082af638174239ad44e4bd87106a13" is_pre_election: true
I20260709 13:06:05.359999 11731 raft_consensus.cc:3060] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.360232 11683 raft_consensus.cc:2468] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 0.
I20260709 13:06:05.366248 11731 raft_consensus.cc:515] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.368063 11731 leader_election.cc:290] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 1 election: Requested vote from peers 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021), 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:05.369042 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb46eb4cb53e44339135ad74f08fee78" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:05.369117 11683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb46eb4cb53e44339135ad74f08fee78" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37082af638174239ad44e4bd87106a13"
I20260709 13:06:05.369716 11609 raft_consensus.cc:3060] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.369794 11683 raft_consensus.cc:3060] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.374933 11609 raft_consensus.cc:2468] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 1.
I20260709 13:06:05.375375 11683 raft_consensus.cc:2468] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 1.
I20260709 13:06:05.376128 11499 leader_election.cc:304] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f30d79bbdf9413f9c0326e36cdd98a5, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.377079 11731 raft_consensus.cc:2804] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.378171 11731 raft_consensus.cc:697] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 1 LEADER]: Becoming Leader. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Running, Role: LEADER
I20260709 13:06:05.378985 11731 consensus_queue.cc:237] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } }
I20260709 13:06:05.385821 11429 catalog_manager.cc:5697] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67060dd1288243f280fea6ade55d8080 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "67060dd1288243f280fea6ade55d8080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.459319 11429 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48008:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:05.461397 11429 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:05.485041 11524 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.486338 11524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.486210 11598 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.487515 11598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.488699 11673 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:06:05.489415 11523 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.489941 11673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4ad9cd83524e83a13ea0b3ba1b6348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.490598 11523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.502775 11725 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: Bootstrap starting.
I20260709 13:06:05.508598 11723 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Bootstrap starting.
I20260709 13:06:05.509317 11724 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: Bootstrap starting.
I20260709 13:06:05.509207 11598 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.510581 11598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.510931 11672 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb6acf78e5be48d0970adfe17c45251d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:06:05.512171 11672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1a7e0a86bb49ca94cbc93ba63545f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.516268 11723 tablet_bootstrap.cc:654] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.516564 11724 tablet_bootstrap.cc:654] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.517788 11725 tablet_bootstrap.cc:654] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.530563 11725 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: No bootstrap required, opened a new log
I20260709 13:06:05.531070 11725 ts_tablet_manager.cc:1403] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 13:06:05.531317 11724 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: No bootstrap required, opened a new log
I20260709 13:06:05.531847 11724 ts_tablet_manager.cc:1403] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:06:05.532789 11723 tablet_bootstrap.cc:492] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: No bootstrap required, opened a new log
I20260709 13:06:05.533301 11723 ts_tablet_manager.cc:1403] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:06:05.534093 11725 raft_consensus.cc:359] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.534863 11725 raft_consensus.cc:385] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.535144 11725 raft_consensus.cc:740] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Initialized, Role: FOLLOWER
W20260709 13:06:05.536279 11480 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:05.536057 11725 consensus_queue.cc:260] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.536643 11724 raft_consensus.cc:359] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.536342 11723 raft_consensus.cc:359] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.537453 11724 raft_consensus.cc:385] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.537817 11724 raft_consensus.cc:740] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.538951 11725 ts_tablet_manager.cc:1434] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:05.538609 11724 consensus_queue.cc:260] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.540079 11725 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Bootstrap starting.
I20260709 13:06:05.540208 11723 raft_consensus.cc:385] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.540623 11723 raft_consensus.cc:740] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f30d79bbdf9413f9c0326e36cdd98a5, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.541391 11723 consensus_queue.cc:260] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.544188 11723 ts_tablet_manager.cc:1434] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:05.545154 11723 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: Bootstrap starting.
I20260709 13:06:05.547238 11724 ts_tablet_manager.cc:1434] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:05.552667 11724 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: Bootstrap starting.
I20260709 13:06:05.554965 11723 tablet_bootstrap.cc:654] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.557677 11725 tablet_bootstrap.cc:654] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.559540 11724 tablet_bootstrap.cc:654] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:05.570922 11725 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: No bootstrap required, opened a new log
I20260709 13:06:05.571219 11724 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: No bootstrap required, opened a new log
I20260709 13:06:05.571462 11725 ts_tablet_manager.cc:1403] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 13:06:05.571748 11723 tablet_bootstrap.cc:492] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: No bootstrap required, opened a new log
I20260709 13:06:05.571781 11724 ts_tablet_manager.cc:1403] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 13:06:05.572469 11723 ts_tablet_manager.cc:1403] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 13:06:05.574909 11724 raft_consensus.cc:359] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.574790 11725 raft_consensus.cc:359] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.575459 11723 raft_consensus.cc:359] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.575814 11724 raft_consensus.cc:385] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.575856 11725 raft_consensus.cc:385] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.576236 11723 raft_consensus.cc:385] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:05.576314 11724 raft_consensus.cc:740] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.576385 11725 raft_consensus.cc:740] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.576776 11723 raft_consensus.cc:740] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f30d79bbdf9413f9c0326e36cdd98a5, State: Initialized, Role: FOLLOWER
I20260709 13:06:05.577512 11724 consensus_queue.cc:260] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.577634 11723 consensus_queue.cc:260] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.580061 11723 ts_tablet_manager.cc:1434] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:05.578186 11725 consensus_queue.cc:260] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.582226 11724 ts_tablet_manager.cc:1434] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:05.582996 11725 ts_tablet_manager.cc:1434] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:06:05.607118 11730 raft_consensus.cc:493] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.607786 11730 raft_consensus.cc:515] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.609684 11730 leader_election.cc:290] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.610635 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080" is_pre_election: true
I20260709 13:06:05.611032 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" is_pre_election: true
I20260709 13:06:05.611434 11534 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.611706 11609 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.612797 11648 leader_election.cc:304] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 4f30d79bbdf9413f9c0326e36cdd98a5; no voters: 
I20260709 13:06:05.613572 11730 raft_consensus.cc:2804] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.614022 11730 raft_consensus.cc:493] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.614459 11730 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.620275 11730 raft_consensus.cc:515] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.621956 11730 leader_election.cc:290] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Requested vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.622949 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080"
I20260709 13:06:05.623162 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:05.623826 11534 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.623842 11609 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.631239 11609 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.631239 11534 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.632748 11648 leader_election.cc:304] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.633586 11730 raft_consensus.cc:2804] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.634218 11730 raft_consensus.cc:697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Becoming Leader. State: Replica: 37082af638174239ad44e4bd87106a13, State: Running, Role: LEADER
I20260709 13:06:05.634917 11730 consensus_queue.cc:237] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.642194 11429 catalog_manager.cc:5697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37082af638174239ad44e4bd87106a13 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "37082af638174239ad44e4bd87106a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.740550 11730 raft_consensus.cc:493] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.741210 11730 raft_consensus.cc:515] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.743047 11730 leader_election.cc:290] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.744083 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080" is_pre_election: true
I20260709 13:06:05.744216 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" is_pre_election: true
I20260709 13:06:05.744737 11534 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.744947 11609 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 0.
I20260709 13:06:05.745805 11648 leader_election.cc:304] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.746475 11730 raft_consensus.cc:2804] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:05.746857 11730 raft_consensus.cc:493] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.747149 11730 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.752368 11730 raft_consensus.cc:515] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.753968 11730 leader_election.cc:290] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Requested vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021)
I20260709 13:06:05.755002 11534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67060dd1288243f280fea6ade55d8080"
I20260709 13:06:05.755203 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "37082af638174239ad44e4bd87106a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:05.755611 11534 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.755870 11609 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:05.757514 11736 consensus_queue.cc:1048] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.761965 11736 consensus_queue.cc:1048] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:05.763581 11534 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.764143 11609 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37082af638174239ad44e4bd87106a13 in term 1.
I20260709 13:06:05.765640 11648 leader_election.cc:304] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:05.766597 11736 raft_consensus.cc:2804] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:05.767501 11736 raft_consensus.cc:697] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Becoming Leader. State: Replica: 37082af638174239ad44e4bd87106a13, State: Running, Role: LEADER
I20260709 13:06:05.772406 11736 consensus_queue.cc:237] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:05.788133 11429 catalog_manager.cc:5697] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37082af638174239ad44e4bd87106a13 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "37082af638174239ad44e4bd87106a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.859638 11683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348"
dest_uuid: "37082af638174239ad44e4bd87106a13"
mode: GRACEFUL
new_leader_uuid: "67060dd1288243f280fea6ade55d8080"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:06:05.860211 11683 raft_consensus.cc:606] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Received request to transfer leadership to TS 67060dd1288243f280fea6ade55d8080
I20260709 13:06:05.861114 11731 consensus_queue.cc:1048] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:05.867178 11683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0"
dest_uuid: "37082af638174239ad44e4bd87106a13"
mode: GRACEFUL
new_leader_uuid: "67060dd1288243f280fea6ade55d8080"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:06:05.867826 11683 raft_consensus.cc:606] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Received request to transfer leadership to TS 67060dd1288243f280fea6ade55d8080
I20260709 13:06:05.878539 11740 consensus_queue.cc:1048] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.024014 11736 consensus_queue.cc:1048] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.031828 11730 raft_consensus.cc:993] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: : Instructing follower 67060dd1288243f280fea6ade55d8080 to start an election
I20260709 13:06:06.032353 11730 raft_consensus.cc:1081] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Signalling peer 67060dd1288243f280fea6ade55d8080 to start an election
I20260709 13:06:06.034216 11534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348"
dest_uuid: "67060dd1288243f280fea6ade55d8080"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:06:06.034889 11534 raft_consensus.cc:493] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.035323 11534 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.038250 11730 consensus_queue.cc:1048] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.043310 11534 raft_consensus.cc:515] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.044876 11533 raft_consensus.cc:1240] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Rejecting Update request from peer 37082af638174239ad44e4bd87106a13 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:06.048650 11534 leader_election.cc:290] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 2 election: Requested vote from peers 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021), 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:06.049701 11609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:06.049911 11683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37082af638174239ad44e4bd87106a13"
I20260709 13:06:06.050683 11683 raft_consensus.cc:3055] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.051105 11683 raft_consensus.cc:740] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Running, Role: LEADER
I20260709 13:06:06.051787 11683 consensus_queue.cc:260] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.052886 11730 consensus_queue.cc:1059] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.050640 11609 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.053974 11683 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.063910 11683 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 2.
I20260709 13:06:06.064414 11609 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 2.
I20260709 13:06:06.065680 11498 leader_election.cc:304] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:06.067045 11731 raft_consensus.cc:2804] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.067526 11731 raft_consensus.cc:697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Becoming Leader. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Running, Role: LEADER
I20260709 13:06:06.068397 11731 consensus_queue.cc:237] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.077490 11431 catalog_manager.cc:5697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 reported cstate change: term changed from 1 to 2, leader changed from 37082af638174239ad44e4bd87106a13 (127.0.107.195) to 67060dd1288243f280fea6ade55d8080 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "67060dd1288243f280fea6ade55d8080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.176209 11730 consensus_queue.cc:1048] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.183787 11736 raft_consensus.cc:993] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: : Instructing follower 67060dd1288243f280fea6ade55d8080 to start an election
I20260709 13:06:06.184326 11756 raft_consensus.cc:1081] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Signalling peer 67060dd1288243f280fea6ade55d8080 to start an election
I20260709 13:06:06.186141 11533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0"
dest_uuid: "67060dd1288243f280fea6ade55d8080"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:06:06.186728 11533 raft_consensus.cc:493] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.187117 11533 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.191138 11736 consensus_queue.cc:1048] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:06.194615 11533 raft_consensus.cc:515] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.195672 11534 raft_consensus.cc:1240] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Rejecting Update request from peer 37082af638174239ad44e4bd87106a13 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:06.198407 11736 consensus_queue.cc:1059] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:06.199656 11736 raft_consensus.cc:3055] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.200078 11736 raft_consensus.cc:740] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37082af638174239ad44e4bd87106a13, State: Running, Role: LEADER
I20260709 13:06:06.200165 11608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
I20260709 13:06:06.200908 11608 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.201700 11533 leader_election.cc:290] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 2 election: Requested vote from peers 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194:43021), 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:06.201068 11736 consensus_queue.cc:260] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
W20260709 13:06:06.202644 11756 consensus_queue.cc:1175] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:06:06.202663 11736 raft_consensus.cc:3060] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.200171 11683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1a7e0a86bb49ca94cbc93ba63545f0" candidate_uuid: "67060dd1288243f280fea6ade55d8080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37082af638174239ad44e4bd87106a13"
I20260709 13:06:06.207927 11608 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 2.
I20260709 13:06:06.209340 11499 leader_election.cc:304] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f30d79bbdf9413f9c0326e36cdd98a5, 67060dd1288243f280fea6ade55d8080; no voters: 
I20260709 13:06:06.210213 11731 raft_consensus.cc:2804] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.210829 11731 raft_consensus.cc:697] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Becoming Leader. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Running, Role: LEADER
I20260709 13:06:06.211735 11731 consensus_queue.cc:237] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.219296 11683 raft_consensus.cc:2468] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67060dd1288243f280fea6ade55d8080 in term 2.
I20260709 13:06:06.219506 11431 catalog_manager.cc:5697] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 reported cstate change: term changed from 1 to 2, leader changed from 37082af638174239ad44e4bd87106a13 (127.0.107.195) to 67060dd1288243f280fea6ade55d8080 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "67060dd1288243f280fea6ade55d8080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.328639   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:06:06.330273   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:06:06.330690   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:06:06.344022 11533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348"
dest_uuid: "67060dd1288243f280fea6ade55d8080"
mode: GRACEFUL
new_leader_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
 from {username='slave'} at 127.0.0.1:52632
I20260709 13:06:06.344755 11533 raft_consensus.cc:606] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Received request to transfer leadership to TS 4f30d79bbdf9413f9c0326e36cdd98a5
I20260709 13:06:06.346163   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:06:06.456002 11608 raft_consensus.cc:1275] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Refusing update from remote peer 67060dd1288243f280fea6ade55d8080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:06.457612 11731 consensus_queue.cc:1048] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.462750 11740 raft_consensus.cc:993] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: : Instructing follower 4f30d79bbdf9413f9c0326e36cdd98a5 to start an election
I20260709 13:06:06.463649 11731 raft_consensus.cc:1081] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Signalling peer 4f30d79bbdf9413f9c0326e36cdd98a5 to start an election
I20260709 13:06:06.465535 11609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348"
dest_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5"
 from {username='slave'} at 127.0.0.1:33140
I20260709 13:06:06.466115 11609 raft_consensus.cc:493] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.466491 11609 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.473631 11683 raft_consensus.cc:1275] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Refusing update from remote peer 67060dd1288243f280fea6ade55d8080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:06.474582 11609 raft_consensus.cc:515] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.475436 11772 consensus_queue.cc:1048] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.478464 11609 leader_election.cc:290] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [CANDIDATE]: Term 3 election: Requested vote from peers 67060dd1288243f280fea6ade55d8080 (127.0.107.193:40879), 37082af638174239ad44e4bd87106a13 (127.0.107.195:34315)
I20260709 13:06:06.507413 11533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67060dd1288243f280fea6ade55d8080"
I20260709 13:06:06.507580 11682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4ad9cd83524e83a13ea0b3ba1b6348" candidate_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37082af638174239ad44e4bd87106a13"
I20260709 13:06:06.508258 11533 raft_consensus.cc:3055] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.508258 11682 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.508795 11533 raft_consensus.cc:740] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67060dd1288243f280fea6ade55d8080, State: Running, Role: LEADER
I20260709 13:06:06.509691 11533 consensus_queue.cc:260] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.511076 11533 raft_consensus.cc:3060] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.516848 11682 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f30d79bbdf9413f9c0326e36cdd98a5 in term 3.
I20260709 13:06:06.518414 11573 leader_election.cc:304] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37082af638174239ad44e4bd87106a13, 4f30d79bbdf9413f9c0326e36cdd98a5; no voters: 
I20260709 13:06:06.518533 11533 raft_consensus.cc:2468] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f30d79bbdf9413f9c0326e36cdd98a5 in term 3.
I20260709 13:06:06.519430 11729 raft_consensus.cc:2804] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:06.520782 11729 raft_consensus.cc:697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 LEADER]: Becoming Leader. State: Replica: 4f30d79bbdf9413f9c0326e36cdd98a5, State: Running, Role: LEADER
I20260709 13:06:06.521596 11729 consensus_queue.cc:237] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } }
I20260709 13:06:06.527999 11432 catalog_manager.cc:5697] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 reported cstate change: term changed from 2 to 3, leader changed from 67060dd1288243f280fea6ade55d8080 (127.0.107.193) to 4f30d79bbdf9413f9c0326e36cdd98a5 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67060dd1288243f280fea6ade55d8080" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f30d79bbdf9413f9c0326e36cdd98a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37082af638174239ad44e4bd87106a13" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.577200   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:06:06.598497   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:06.599170   431 tablet_replica.cc:333] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: stopping tablet replica
I20260709 13:06:06.599747   431 raft_consensus.cc:2243] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.600551   431 pending_rounds.cc:70] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Trying to abort 2 pending ops.
I20260709 13:06:06.600730   431 pending_rounds.cc:77] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635292013281280 op_type: NO_OP noop_request { }
I20260709 13:06:06.601073   431 raft_consensus.cc:2889] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.601292   431 pending_rounds.cc:77] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635290241757184 op_type: NO_OP noop_request { }
I20260709 13:06:06.601544   431 raft_consensus.cc:2889] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.601814   431 raft_consensus.cc:2272] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 67060dd1288243f280fea6ade55d8080 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.604206   431 tablet_replica.cc:333] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080: stopping tablet replica
I20260709 13:06:06.604746   431 raft_consensus.cc:2243] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.605172   431 raft_consensus.cc:2272] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 67060dd1288243f280fea6ade55d8080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.607652   431 tablet_replica.cc:333] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080: stopping tablet replica
I20260709 13:06:06.608242   431 raft_consensus.cc:2243] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.608666   431 raft_consensus.cc:2272] T 6e6432a578be4da5b0de856d3335181d P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.611025   431 tablet_replica.cc:333] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080: stopping tablet replica
I20260709 13:06:06.611531   431 raft_consensus.cc:2243] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.612386   431 raft_consensus.cc:2272] T cb46eb4cb53e44339135ad74f08fee78 P 67060dd1288243f280fea6ade55d8080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.638751   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:06:06.651419   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:06:06.670625   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:06.671303   431 tablet_replica.cc:333] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5: stopping tablet replica
I20260709 13:06:06.671871   431 raft_consensus.cc:2243] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.672389   431 raft_consensus.cc:2272] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.675232   431 tablet_replica.cc:333] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: stopping tablet replica
I20260709 13:06:06.675836   431 raft_consensus.cc:2243] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.676596   431 pending_rounds.cc:70] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Trying to abort 1 pending ops.
I20260709 13:06:06.676808   431 pending_rounds.cc:77] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635293280141312 op_type: NO_OP noop_request { }
I20260709 13:06:06.677096   431 raft_consensus.cc:2889] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.677377   431 raft_consensus.cc:2272] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.680255   431 tablet_replica.cc:333] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5: stopping tablet replica
I20260709 13:06:06.680800   431 raft_consensus.cc:2243] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.681272   431 raft_consensus.cc:2272] T cb46eb4cb53e44339135ad74f08fee78 P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.683632   431 tablet_replica.cc:333] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5: stopping tablet replica
I20260709 13:06:06.684269   431 raft_consensus.cc:2243] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.684724   431 raft_consensus.cc:2272] T 6e6432a578be4da5b0de856d3335181d P 4f30d79bbdf9413f9c0326e36cdd98a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.709053   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:06:06.721434   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:06:06.739181   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:06.740007   431 tablet_replica.cc:333] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13: stopping tablet replica
I20260709 13:06:06.740615   431 raft_consensus.cc:2243] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.741086   431 raft_consensus.cc:2272] T 8b1a7e0a86bb49ca94cbc93ba63545f0 P 37082af638174239ad44e4bd87106a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.743368   431 tablet_replica.cc:333] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13: stopping tablet replica
I20260709 13:06:06.743939   431 raft_consensus.cc:2243] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.744483   431 raft_consensus.cc:2272] T 9f4ad9cd83524e83a13ea0b3ba1b6348 P 37082af638174239ad44e4bd87106a13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.746762   431 tablet_replica.cc:333] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13: stopping tablet replica
I20260709 13:06:06.747370   431 raft_consensus.cc:2243] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.748219   431 raft_consensus.cc:2272] T 6e6432a578be4da5b0de856d3335181d P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.750332   431 tablet_replica.cc:333] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13: stopping tablet replica
I20260709 13:06:06.750766   431 raft_consensus.cc:2243] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.751122   431 raft_consensus.cc:2272] T cb46eb4cb53e44339135ad74f08fee78 P 37082af638174239ad44e4bd87106a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.774989   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:06:06.788018   431 master.cc:562] Master@127.0.107.254:45681 shutting down...
I20260709 13:06:06.803584   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.804214   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.804557   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 186aa2b2432941679f4016e7c55ebf62: stopping tablet replica
I20260709 13:06:06.824736   431 master.cc:584] Master@127.0.107.254:45681 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2463 ms)
[----------] 6 tests from LeaderRebalancerTest (323292 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:06:06.854807   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38115
I20260709 13:06:06.855886   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:06.861203 11778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:06.861720 11779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:06.863657   431 server_base.cc:1061] running on GCE node
W20260709 13:06:06.863826 11781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:06.864831   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:06.865036   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:06.865216   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602366865183 us; error 0 us; skew 500 ppm
I20260709 13:06:06.865823   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:06.868484   431 webserver.cc:533] Webserver started at http://127.0.107.254:45987/ using document root <none> and password file <none>
I20260709 13:06:06.869001   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:06.869189   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:06.869486   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:06.870548   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "300912e572d844ff89a629a1db3023b3"
format_stamp: "Formatted at 2026-07-09 13:06:06 on dist-test-slave-rrf3"
I20260709 13:06:06.875296   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:06:06.878772 11786 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:06.879706   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:06.880125   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "300912e572d844ff89a629a1db3023b3"
format_stamp: "Formatted at 2026-07-09 13:06:06 on dist-test-slave-rrf3"
I20260709 13:06:06.880475   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:06.898670   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:06.899740   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:06.936306   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38115
I20260709 13:06:06.936474 11837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38115 every 8 connection(s)
I20260709 13:06:06.940235 11838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.951647 11838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: Bootstrap starting.
I20260709 13:06:06.956100 11838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:06.960462 11838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: No bootstrap required, opened a new log
I20260709 13:06:06.962567 11838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER }
I20260709 13:06:06.962986 11838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:06.963205 11838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 300912e572d844ff89a629a1db3023b3, State: Initialized, Role: FOLLOWER
I20260709 13:06:06.963899 11838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER }
I20260709 13:06:06.964382 11838 raft_consensus.cc:399] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:06.964610 11838 raft_consensus.cc:493] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:06.964887 11838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:06.969663 11838 raft_consensus.cc:515] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER }
I20260709 13:06:06.970263 11838 leader_election.cc:304] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 300912e572d844ff89a629a1db3023b3; no voters: 
I20260709 13:06:06.971464 11838 leader_election.cc:290] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:06.971828 11841 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:06.973217 11841 raft_consensus.cc:697] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 1 LEADER]: Becoming Leader. State: Replica: 300912e572d844ff89a629a1db3023b3, State: Running, Role: LEADER
I20260709 13:06:06.973889 11841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER }
I20260709 13:06:06.974582 11838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:06.978246 11842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "300912e572d844ff89a629a1db3023b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER } }
I20260709 13:06:06.978971 11842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:06.978874 11843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 300912e572d844ff89a629a1db3023b3. Latest consensus state: current_term: 1 leader_uuid: "300912e572d844ff89a629a1db3023b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300912e572d844ff89a629a1db3023b3" member_type: VOTER } }
I20260709 13:06:06.979530 11843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:06.988919 11848 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:07.027060 11848 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:07.041291   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:07.043478 11848 catalog_manager.cc:1383] Generated new cluster ID: d311925d598f4212a5f7611eecfa84af
I20260709 13:06:07.043844 11848 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:07.058547 11848 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:07.059957 11848 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:07.071792 11848 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: Generated new TSK 0
I20260709 13:06:07.072557 11848 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:07.108568   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:07.116463 11860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.117142 11861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.119230 11863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:07.119537   431 server_base.cc:1061] running on GCE node
I20260709 13:06:07.120791   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:07.121040   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:07.121239   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602367121220 us; error 0 us; skew 500 ppm
I20260709 13:06:07.121840   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:07.124657   431 webserver.cc:533] Webserver started at http://127.0.107.193:36871/ using document root <none> and password file <none>
I20260709 13:06:07.125232   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:07.125435   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:07.125777   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:07.127379   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "efef032111ff46cfa5a5208028592f68"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.132730   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:06:07.136474 11868 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.137259   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:06:07.137562   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "efef032111ff46cfa5a5208028592f68"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.137871   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:07.156179   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:07.157524   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:07.159103   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:07.161685   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:07.161926   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.162180   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:07.162372   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.208081   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43409
I20260709 13:06:07.208201 11930 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43409 every 8 connection(s)
I20260709 13:06:07.214610   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:07.224170 11935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.224501 11936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.228153 11938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:07.229183   431 server_base.cc:1061] running on GCE node
I20260709 13:06:07.231344   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:07.231710   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:07.231824 11931 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 13:06:07.231966   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602367231944 us; error 0 us; skew 500 ppm
I20260709 13:06:07.232420 11931 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:07.233023   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:07.233520 11931 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 13:06:07.236292   431 webserver.cc:533] Webserver started at http://127.0.107.194:33803/ using document root <none> and password file <none>
I20260709 13:06:07.236575 11803 ts_manager.cc:194] Registered new tserver with Master: efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409)
I20260709 13:06:07.236924   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:07.237253   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:07.237561   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:07.239059   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "b5e9ebcc11564acdb61e45afb0256e21"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.239077 11803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48952
I20260709 13:06:07.245177   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.004s
I20260709 13:06:07.249284 11943 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.250079   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:07.250433   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "b5e9ebcc11564acdb61e45afb0256e21"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.250721   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:07.270583   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:07.271901   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:07.273496   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:07.275774   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:07.276063   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.276322   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:07.276491   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.322399   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45983
I20260709 13:06:07.322530 12005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45983 every 8 connection(s)
I20260709 13:06:07.327509   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:07.334591 12009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.336266 12010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:07.340404 12012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:07.341172   431 server_base.cc:1061] running on GCE node
I20260709 13:06:07.342020 12006 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 13:06:07.342207   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:06:07.342474 12006 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:07.342561   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:07.342967   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602367342942 us; error 0 us; skew 500 ppm
I20260709 13:06:07.343489 12006 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 13:06:07.343652   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:07.346099 11803 ts_manager.cc:194] Registered new tserver with Master: b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:07.346726   431 webserver.cc:533] Webserver started at http://127.0.107.195:43353/ using document root <none> and password file <none>
I20260709 13:06:07.347582   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:07.347831   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:07.347980 11803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48968
I20260709 13:06:07.348271   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:07.350005   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.355026   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:06:07.358886 12017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.359741   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:06:07.360116   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
format_stamp: "Formatted at 2026-07-09 13:06:07 on dist-test-slave-rrf3"
I20260709 13:06:07.360425   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:07.387645   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:07.389041   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:07.390480   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:07.392889   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:07.393126   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.393389   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:07.393569   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:07.442266   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44895
I20260709 13:06:07.442406 12079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44895 every 8 connection(s)
I20260709 13:06:07.461563 12080 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38115
I20260709 13:06:07.462026 12080 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:07.463063 12080 heartbeater.cc:507] Master 127.0.107.254:38115 requested a full tablet report, sending...
I20260709 13:06:07.465186 11803 ts_manager.cc:194] Registered new tserver with Master: c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:07.465999   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019802832s
I20260709 13:06:07.466862 11803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48978
I20260709 13:06:07.496495 11803 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48984:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:07.499645 11803 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:07.574694 11969 tablet_service.cc:1511] Processing CreateTablet for tablet d7a8403fdb7e4756bd88d966e2224639 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:07.577078 11970 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3ae153d03f4d34a5dbd5646328f7b8 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:07.578751 11970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3ae153d03f4d34a5dbd5646328f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.578492 11971 tablet_service.cc:1511] Processing CreateTablet for tablet b316101c01c749c1a43fe312a4b6eae4 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:07.579941 11971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316101c01c749c1a43fe312a4b6eae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.580681 11969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a8403fdb7e4756bd88d966e2224639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.580703 11968 tablet_service.cc:1511] Processing CreateTablet for tablet d02c0c9fea83417ebbbf4a60fbd9ed80 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:07.582453 11968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02c0c9fea83417ebbbf4a60fbd9ed80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.583508 11967 tablet_service.cc:1511] Processing CreateTablet for tablet d24d373945434c13bf1df741ff0a1e7f (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:07.584949 11967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24d373945434c13bf1df741ff0a1e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.590333 11966 tablet_service.cc:1511] Processing CreateTablet for tablet fdb98de5c19e4e19b8016e932b51a4ff (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:07.591856 11966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb98de5c19e4e19b8016e932b51a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.595953 11965 tablet_service.cc:1511] Processing CreateTablet for tablet 780e7c514e424336a8c7e49e4d48499b (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:07.597507 11965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780e7c514e424336a8c7e49e4d48499b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.602728 11964 tablet_service.cc:1511] Processing CreateTablet for tablet dd979729212446a1ac6293b3d2f6d37a (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:07.604238 11964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd979729212446a1ac6293b3d2f6d37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.608543 11963 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1740c65ee424698f828958f632d00 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:07.610327 11963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1740c65ee424698f828958f632d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.638262 11893 tablet_service.cc:1511] Processing CreateTablet for tablet d02c0c9fea83417ebbbf4a60fbd9ed80 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:07.640022 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02c0c9fea83417ebbbf4a60fbd9ed80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.641280 11895 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3ae153d03f4d34a5dbd5646328f7b8 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:07.655696 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3ae153d03f4d34a5dbd5646328f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.642469 11894 tablet_service.cc:1511] Processing CreateTablet for tablet d7a8403fdb7e4756bd88d966e2224639 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:07.662315 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a8403fdb7e4756bd88d966e2224639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.665329 12037 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1740c65ee424698f828958f632d00 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:07.666857 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1740c65ee424698f828958f632d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.668546 12038 tablet_service.cc:1511] Processing CreateTablet for tablet dd979729212446a1ac6293b3d2f6d37a (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:07.645897 11889 tablet_service.cc:1511] Processing CreateTablet for tablet dd979729212446a1ac6293b3d2f6d37a (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:07.646929 11892 tablet_service.cc:1511] Processing CreateTablet for tablet d24d373945434c13bf1df741ff0a1e7f (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:07.645632 11888 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1740c65ee424698f828958f632d00 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:07.647804 11890 tablet_service.cc:1511] Processing CreateTablet for tablet 780e7c514e424336a8c7e49e4d48499b (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:07.672889 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd979729212446a1ac6293b3d2f6d37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.648227 11891 tablet_service.cc:1511] Processing CreateTablet for tablet fdb98de5c19e4e19b8016e932b51a4ff (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:07.649058 12041 tablet_service.cc:1511] Processing CreateTablet for tablet d24d373945434c13bf1df741ff0a1e7f (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:07.649435 12040 tablet_service.cc:1511] Processing CreateTablet for tablet fdb98de5c19e4e19b8016e932b51a4ff (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:07.650277 12039 tablet_service.cc:1511] Processing CreateTablet for tablet 780e7c514e424336a8c7e49e4d48499b (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:07.650581 11896 tablet_service.cc:1511] Processing CreateTablet for tablet b316101c01c749c1a43fe312a4b6eae4 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:07.651460 12044 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3ae153d03f4d34a5dbd5646328f7b8 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:07.651674 12043 tablet_service.cc:1511] Processing CreateTablet for tablet d7a8403fdb7e4756bd88d966e2224639 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:07.652633 12045 tablet_service.cc:1511] Processing CreateTablet for tablet b316101c01c749c1a43fe312a4b6eae4 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:07.652637 12042 tablet_service.cc:1511] Processing CreateTablet for tablet d02c0c9fea83417ebbbf4a60fbd9ed80 (DEFAULT_TABLE table=test-workload [id=21643a18b37d42758caecd57562829b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:07.689533 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780e7c514e424336a8c7e49e4d48499b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.693094 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316101c01c749c1a43fe312a4b6eae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.693714 12038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd979729212446a1ac6293b3d2f6d37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.696349 12042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02c0c9fea83417ebbbf4a60fbd9ed80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.697633 12095 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:07.681293 12094 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:07.700368 12039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780e7c514e424336a8c7e49e4d48499b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.704492 12044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3ae153d03f4d34a5dbd5646328f7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.705546 12095 tablet_bootstrap.cc:654] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.710935 12041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24d373945434c13bf1df741ff0a1e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.713773 12094 tablet_bootstrap.cc:654] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.713863 12040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb98de5c19e4e19b8016e932b51a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.721460 12043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a8403fdb7e4756bd88d966e2224639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.723860 12045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316101c01c749c1a43fe312a4b6eae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.732538 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24d373945434c13bf1df741ff0a1e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.736261 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1740c65ee424698f828958f632d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.747886 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb98de5c19e4e19b8016e932b51a4ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.860435 12095 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:07.861073 12097 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:07.861105 12095 ts_tablet_manager.cc:1403] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.164s	user 0.041s	sys 0.085s
I20260709 13:06:07.868180 12097 tablet_bootstrap.cc:654] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.868912 12095 raft_consensus.cc:359] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.870172 12095 raft_consensus.cc:385] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.870666 12095 raft_consensus.cc:740] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.871820 12095 consensus_queue.cc:260] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.891671 12097 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:07.892763 12097 ts_tablet_manager.cc:1403] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.006s
I20260709 13:06:07.895881 12094 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:07.897172 12095 ts_tablet_manager.cc:1434] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 13:06:07.901597 11931 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 13:06:07.901937 12100 raft_consensus.cc:493] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.908471 12094 ts_tablet_manager.cc:1403] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.228s	user 0.021s	sys 0.007s
I20260709 13:06:07.909304 12100 raft_consensus.cc:515] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.898712 12097 raft_consensus.cc:359] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.910849 12097 raft_consensus.cc:385] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.911305 12097 raft_consensus.cc:740] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.912845 12097 consensus_queue.cc:260] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.914220 12100 leader_election.cc:290] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:07.914245 12095 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:07.918012 12094 raft_consensus.cc:359] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.918982 12094 raft_consensus.cc:385] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:07.919291 12094 raft_consensus.cc:740] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:07.920722 12094 consensus_queue.cc:260] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.926319 12080 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 13:06:07.927327 12097 ts_tablet_manager.cc:1434] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 13:06:07.932057 12097 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:07.939505 12105 raft_consensus.cc:493] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.940398 12105 raft_consensus.cc:515] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:07.943401 12095 tablet_bootstrap.cc:654] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:07.951614 12006 heartbeater.cc:499] Master 127.0.107.254:38115 was elected leader, sending a full tablet report...
I20260709 13:06:07.980801 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
W20260709 13:06:07.983314 12021 leader_election.cc:343] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:07.985489 12105 leader_election.cc:290] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:08.000267 12094 ts_tablet_manager.cc:1434] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.005s
I20260709 13:06:08.000357 12097 tablet_bootstrap.cc:654] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.001616 12094 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.006001 12095 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.006672 12095 ts_tablet_manager.cc:1403] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.036s
I20260709 13:06:08.010399 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.011914 12095 raft_consensus.cc:359] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.012841 12095 raft_consensus.cc:385] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.013203 12095 raft_consensus.cc:740] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
W20260709 13:06:08.014117 12018 leader_election.cc:343] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.014173 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.015003 12018 leader_election.cc:304] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd; no voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68
I20260709 13:06:08.014096 12095 consensus_queue.cc:260] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
W20260709 13:06:08.016542 11872 leader_election.cc:343] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.017786 12104 raft_consensus.cc:2749] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.018185 12094 tablet_bootstrap.cc:654] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.017750 12095 ts_tablet_manager.cc:1434] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:08.021317 12095 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.023736 12094 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.024432 12094 ts_tablet_manager.cc:1403] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:06:08.027151 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.027257 12094 raft_consensus.cc:359] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.028123 12094 raft_consensus.cc:385] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.028560 12094 raft_consensus.cc:740] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.029474 12094 consensus_queue.cc:260] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.031032 12097 tablet_bootstrap.cc:492] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
W20260709 13:06:08.031152 11852 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:08.031374 12094 ts_tablet_manager.cc:1434] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:08.031771 12097 ts_tablet_manager.cc:1403] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.007s
I20260709 13:06:08.032446 12094 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
W20260709 13:06:08.032927 11869 leader_election.cc:343] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.033439 11869 leader_election.cc:304] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efef032111ff46cfa5a5208028592f68; no voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:08.034720 12101 raft_consensus.cc:2749] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.034988 12097 raft_consensus.cc:359] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.035794 12097 raft_consensus.cc:385] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.036118 12097 raft_consensus.cc:740] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.036893 12097 consensus_queue.cc:260] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.038328 12094 tablet_bootstrap.cc:654] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.039013 12097 ts_tablet_manager.cc:1434] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:06:08.040086 12097 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.046319 12095 tablet_bootstrap.cc:654] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.047173 12097 tablet_bootstrap.cc:654] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.061365 12095 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.063033 12095 ts_tablet_manager.cc:1403] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.005s
I20260709 13:06:08.063620 12097 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.064100 12094 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.064246 12097 ts_tablet_manager.cc:1403] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:06:08.064714 12094 ts_tablet_manager.cc:1403] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.016s
I20260709 13:06:08.066238 12095 raft_consensus.cc:359] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.067055 12095 raft_consensus.cc:385] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.067404 12095 raft_consensus.cc:740] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.067466 12097 raft_consensus.cc:359] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.068295 12097 raft_consensus.cc:385] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.068217 12095 consensus_queue.cc:260] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.068688 12097 raft_consensus.cc:740] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.069770 12097 consensus_queue.cc:260] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.070616 12094 raft_consensus.cc:359] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.071039 12101 raft_consensus.cc:493] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.071383 12094 raft_consensus.cc:385] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.071753 12094 raft_consensus.cc:740] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.071548 12101 raft_consensus.cc:515] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.070626 12095 ts_tablet_manager.cc:1434] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:06:08.073558 12095 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.074853 12104 raft_consensus.cc:493] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.075170 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a8403fdb7e4756bd88d966e2224639" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.075368 12104 raft_consensus.cc:515] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.075817 12055 raft_consensus.cc:2468] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:08.077273 11872 leader_election.cc:304] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.077740 12104 leader_election.cc:290] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:08.078145 12100 raft_consensus.cc:2804] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.078543 12100 raft_consensus.cc:493] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.078688 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a8403fdb7e4756bd88d966e2224639" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.078891 12100 raft_consensus.cc:3060] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.078925 12101 leader_election.cc:290] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.079336 11981 raft_consensus.cc:2468] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:08.080538 12095 tablet_bootstrap.cc:654] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.083421 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
W20260709 13:06:08.084992 12018 leader_election.cc:343] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.085794 12097 ts_tablet_manager.cc:1434] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:06:08.086905 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.087416 12097 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
W20260709 13:06:08.089591 12021 leader_election.cc:343] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.090082 12021 leader_election.cc:304] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd; no voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68
I20260709 13:06:08.091354 12104 raft_consensus.cc:2749] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.096460 12097 tablet_bootstrap.cc:654] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.098830 12100 raft_consensus.cc:515] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.075853 12094 consensus_queue.cc:260] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.101652 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a8403fdb7e4756bd88d966e2224639" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:08.102391 11981 raft_consensus.cc:3060] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.102636 12094 ts_tablet_manager.cc:1434] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:06:08.103835 12094 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.111129 11981 raft_consensus.cc:2468] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:08.112111 12094 tablet_bootstrap.cc:654] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.113508 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a8403fdb7e4756bd88d966e2224639" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.112828 12100 leader_election.cc:290] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.115329 11869 leader_election.cc:304] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.114964 12055 raft_consensus.cc:3060] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.119079 12095 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.119799 12095 ts_tablet_manager.cc:1403] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.020s
I20260709 13:06:08.123988 12095 raft_consensus.cc:359] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.125118 12095 raft_consensus.cc:385] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.125224 12100 raft_consensus.cc:2804] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.125695 12095 raft_consensus.cc:740] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.127188 12095 consensus_queue.cc:260] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.129544 12100 raft_consensus.cc:697] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:08.134487 12094 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.132397 12100 consensus_queue.cc:237] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.135046 12094 ts_tablet_manager.cc:1403] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.011s
I20260709 13:06:08.135215 12055 raft_consensus.cc:2468] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:08.138692 12094 raft_consensus.cc:359] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.139569 12094 raft_consensus.cc:385] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.139993 12094 raft_consensus.cc:740] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.141633 12097 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.141191 12094 consensus_queue.cc:260] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.142012 12095 ts_tablet_manager.cc:1434] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:06:08.142333 12097 ts_tablet_manager.cc:1403] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.030s
I20260709 13:06:08.143379 12095 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.148692 12094 ts_tablet_manager.cc:1434] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:06:08.149693 12094 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.151820 12095 tablet_bootstrap.cc:654] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.151615 11801 catalog_manager.cc:5697] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.155440 12094 tablet_bootstrap.cc:654] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.146485 12097 raft_consensus.cc:359] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.160743 12097 raft_consensus.cc:385] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.161213 12097 raft_consensus.cc:740] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.162400 12097 consensus_queue.cc:260] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.166065 12097 ts_tablet_manager.cc:1434] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:06:08.167512 12097 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.176996 12097 tablet_bootstrap.cc:654] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.190094 12095 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.190618 12095 ts_tablet_manager.cc:1403] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.005s
I20260709 13:06:08.190860 12097 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.192567 12097 ts_tablet_manager.cc:1403] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:06:08.194167 12095 raft_consensus.cc:359] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.194787 12094 tablet_bootstrap.cc:492] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.195184 12095 raft_consensus.cc:385] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.195485 12094 ts_tablet_manager.cc:1403] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.025s
I20260709 13:06:08.195597 12095 raft_consensus.cc:740] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.195981 12100 raft_consensus.cc:493] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.196604 12100 raft_consensus.cc:515] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.196877 12097 raft_consensus.cc:359] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.196794 12095 consensus_queue.cc:260] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.197803 12097 raft_consensus.cc:385] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.198870 12100 leader_election.cc:290] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.199216 12094 raft_consensus.cc:359] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.199759 12095 ts_tablet_manager.cc:1434] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:08.199724 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02c0c9fea83417ebbbf4a60fbd9ed80" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.200242 12094 raft_consensus.cc:385] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.200606 11981 raft_consensus.cc:2468] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:08.200656 12094 raft_consensus.cc:740] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.201275 12095 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.202157 11869 leader_election.cc:304] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.201889 12094 consensus_queue.cc:260] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.202777 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02c0c9fea83417ebbbf4a60fbd9ed80" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.204404 12118 raft_consensus.cc:2804] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.204824 12118 raft_consensus.cc:493] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.205113 12094 ts_tablet_manager.cc:1434] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 13:06:08.206049 11872 leader_election.cc:343] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.206413 12094 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.205165 12118 raft_consensus.cc:3060] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.198161 12097 raft_consensus.cc:740] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.208190 12097 consensus_queue.cc:260] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.209842 12095 tablet_bootstrap.cc:654] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.213065 12097 ts_tablet_manager.cc:1434] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:08.214185 12097 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.215037 12094 tablet_bootstrap.cc:654] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.220337 12106 raft_consensus.cc:493] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.220211 12118 raft_consensus.cc:515] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.221309 12106 raft_consensus.cc:515] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.223734 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02c0c9fea83417ebbbf4a60fbd9ed80" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:08.224512 11981 raft_consensus.cc:3060] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.224171 12118 leader_election.cc:290] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.220885 12097 tablet_bootstrap.cc:654] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.223852 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02c0c9fea83417ebbbf4a60fbd9ed80" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.227725 12106 leader_election.cc:290] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
W20260709 13:06:08.228781 11872 leader_election.cc:343] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:08.240072 12118 raft_consensus.cc:493] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.244886 12118 raft_consensus.cc:515] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.249730 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.250715 11980 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:08.254055 11869 leader_election.cc:304] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.254969 12100 raft_consensus.cc:2804] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.255345 12100 raft_consensus.cc:493] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.255586 12095 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.255684 12100 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.256311 12095 ts_tablet_manager.cc:1403] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.028s
I20260709 13:06:08.259585 12095 raft_consensus.cc:359] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.260377 12095 raft_consensus.cc:385] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.260679 12095 raft_consensus.cc:740] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.264700 11981 raft_consensus.cc:2468] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:08.266775 11869 leader_election.cc:304] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:08.267655 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.268090 12101 raft_consensus.cc:2804] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.268546 12055 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:08.262480 12095 consensus_queue.cc:260] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.270887 12118 leader_election.cc:290] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.274092 12100 raft_consensus.cc:515] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.278350 12097 tablet_bootstrap.cc:492] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.279536 12097 ts_tablet_manager.cc:1403] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.004s
I20260709 13:06:08.283046 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:08.284024 11980 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.285543 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.286722 12055 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.297420 12101 raft_consensus.cc:697] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:08.297930 12100 leader_election.cc:290] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.298971 12101 consensus_queue.cc:237] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.296022 11980 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:08.311517 11869 leader_election.cc:304] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.314098 12100 raft_consensus.cc:2804] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.315841 12100 raft_consensus.cc:697] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:08.317842 12094 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.318675 12094 ts_tablet_manager.cc:1403] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.113s	user 0.043s	sys 0.049s
I20260709 13:06:08.317261 12100 consensus_queue.cc:237] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.323737 12094 raft_consensus.cc:359] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.324899 12094 raft_consensus.cc:385] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.325290 12094 raft_consensus.cc:740] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.326344 12055 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:08.326298 12094 consensus_queue.cc:260] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.334589 12094 ts_tablet_manager.cc:1434] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:06:08.338619 12106 raft_consensus.cc:493] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.339249 12106 raft_consensus.cc:515] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.342872 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.346235 12106 leader_election.cc:290] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895), efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409)
I20260709 13:06:08.346534 12097 raft_consensus.cc:359] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.347438 12097 raft_consensus.cc:385] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.347772 12097 raft_consensus.cc:740] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.347941 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.348659 11906 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.348883 12094 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.350169 11947 leader_election.cc:304] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.351002 12106 raft_consensus.cc:2804] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.351353 12106 raft_consensus.cc:493] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.351701 12106 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.352581 12097 consensus_queue.cc:260] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.352603 11801 catalog_manager.cc:5697] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.356102 12097 ts_tablet_manager.cc:1434] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.002s
I20260709 13:06:08.357343 12097 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.359254 12094 tablet_bootstrap.cc:654] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.360864 12095 ts_tablet_manager.cc:1434] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.104s	user 0.047s	sys 0.024s
I20260709 13:06:08.362046 12095 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.370225 12095 tablet_bootstrap.cc:654] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.373661 12097 tablet_bootstrap.cc:654] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.381141 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.382087 12055 raft_consensus.cc:2393] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5e9ebcc11564acdb61e45afb0256e21 in current term 1: Already voted for candidate efef032111ff46cfa5a5208028592f68 in this term.
I20260709 13:06:08.386286 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.387179 12055 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.396454 12095 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.397099 12095 ts_tablet_manager.cc:1403] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.014s
I20260709 13:06:08.398371 12094 tablet_bootstrap.cc:492] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.399513 12094 ts_tablet_manager.cc:1403] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.024s
I20260709 13:06:08.399972 12106 raft_consensus.cc:515] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.402217 12106 leader_election.cc:290] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895), efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409)
I20260709 13:06:08.398612 11947 leader_election.cc:304] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21; no voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68
I20260709 13:06:08.403096 12106 raft_consensus.cc:2749] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:08.404484 12094 raft_consensus.cc:359] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.405367 12094 raft_consensus.cc:385] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.405402 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.405751 12094 raft_consensus.cc:740] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.405851 12097 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.406142 12055 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.406698 12097 ts_tablet_manager.cc:1403] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.007s
I20260709 13:06:08.404965 11802 catalog_manager.cc:5697] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.406728 12094 consensus_queue.cc:260] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.409703 12095 raft_consensus.cc:359] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.410506 12095 raft_consensus.cc:385] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.410167 12097 raft_consensus.cc:359] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.410873 12095 raft_consensus.cc:740] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.411158 12097 raft_consensus.cc:385] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.411618 12097 raft_consensus.cc:740] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.410211 12094 ts_tablet_manager.cc:1434] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:06:08.412510 12097 consensus_queue.cc:260] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.411814 12095 consensus_queue.cc:260] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.413893 12094 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.415501 12095 ts_tablet_manager.cc:1434] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:06:08.416540 12095 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.421381 12094 tablet_bootstrap.cc:654] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.424012 12095 tablet_bootstrap.cc:654] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.422812 12097 ts_tablet_manager.cc:1434] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:06:08.428954 12055 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.432413 12097 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.432296 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.433214 11906 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.442902 12097 tablet_bootstrap.cc:654] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.443017 12094 tablet_bootstrap.cc:492] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.444465 12094 ts_tablet_manager.cc:1403] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 13:06:08.446197 11906 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.447438 11947 leader_election.cc:304] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:08.447361 12094 raft_consensus.cc:359] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.448256 12094 raft_consensus.cc:385] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.448544 12094 raft_consensus.cc:740] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.448454 12106 raft_consensus.cc:2804] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.450306 12106 raft_consensus.cc:697] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:08.451474 12095 tablet_bootstrap.cc:492] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.451984 12095 ts_tablet_manager.cc:1403] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.014s
I20260709 13:06:08.454448 12097 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.451187 12106 consensus_queue.cc:237] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:08.454999 12097 ts_tablet_manager.cc:1403] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:06:08.455150 12095 raft_consensus.cc:359] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.455332 12094 consensus_queue.cc:260] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.455994 12095 raft_consensus.cc:385] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.456480 12095 raft_consensus.cc:740] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.457351 12095 consensus_queue.cc:260] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.458166 12094 ts_tablet_manager.cc:1434] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:06:08.458195 12097 raft_consensus.cc:359] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.459097 12097 raft_consensus.cc:385] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.459373 12097 raft_consensus.cc:740] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.459506 12094 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:08.460260 12097 consensus_queue.cc:260] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.466904 12094 tablet_bootstrap.cc:654] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.467716 12095 ts_tablet_manager.cc:1434] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:08.468811 12095 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:08.469580 12141 raft_consensus.cc:493] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.470186 12141 raft_consensus.cc:515] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.471582 12097 ts_tablet_manager.cc:1434] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:06:08.472513 12141 leader_election.cc:290] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.472664 12097 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:08.475045 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780e7c514e424336a8c7e49e4d48499b" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.475440 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780e7c514e424336a8c7e49e4d48499b" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.475797 12055 raft_consensus.cc:2468] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.476217 11906 raft_consensus.cc:2468] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.478425 11947 leader_election.cc:304] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:08.479450 12106 raft_consensus.cc:2804] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.479884 12106 raft_consensus.cc:493] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.480170 12095 tablet_bootstrap.cc:654] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.480401 12106 raft_consensus.cc:3060] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.480545 11801 catalog_manager.cc:5697] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.485335 12097 tablet_bootstrap.cc:654] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:08.494859 12106 raft_consensus.cc:515] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.499553 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780e7c514e424336a8c7e49e4d48499b" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.500159 11906 raft_consensus.cc:3060] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.500340 12097 tablet_bootstrap.cc:492] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:08.500841 12097 ts_tablet_manager.cc:1403] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:06:08.503612 12097 raft_consensus.cc:359] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.504364 12097 raft_consensus.cc:385] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.504590 12097 raft_consensus.cc:740] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.505506 12097 consensus_queue.cc:260] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.509850 12094 tablet_bootstrap.cc:492] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:08.510480 12094 ts_tablet_manager.cc:1403] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.011s
I20260709 13:06:08.512140 12095 tablet_bootstrap.cc:492] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:08.513406 12095 ts_tablet_manager.cc:1403] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.015s
I20260709 13:06:08.513212 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780e7c514e424336a8c7e49e4d48499b" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.512718 12106 leader_election.cc:290] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.513672 11906 raft_consensus.cc:2468] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.515506 12055 raft_consensus.cc:3060] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.516350 11947 leader_election.cc:304] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.517653 12100 consensus_queue.cc:1048] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.518249 12106 raft_consensus.cc:2804] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.518404 12095 raft_consensus.cc:359] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.514966 12097 ts_tablet_manager.cc:1434] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:08.519357 12095 raft_consensus.cc:385] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.518826 12106 raft_consensus.cc:697] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:08.519739 12095 raft_consensus.cc:740] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.520239 12141 raft_consensus.cc:493] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.520411 12106 consensus_queue.cc:237] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.520812 12141 raft_consensus.cc:515] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.523001 12141 leader_election.cc:290] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.524290 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.524986 12055 raft_consensus.cc:2468] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.527333 12054 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.528607 11947 leader_election.cc:304] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:08.529636 12141 raft_consensus.cc:2804] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.530213 12141 raft_consensus.cc:493] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.520614 12095 consensus_queue.cc:260] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.525642 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.530555 12141 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.531320 11906 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.534967 12095 ts_tablet_manager.cc:1434] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:06:08.547554 11802 catalog_manager.cc:5697] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.550220 12141 raft_consensus.cc:515] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.514472 12094 raft_consensus.cc:359] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.552320 12094 raft_consensus.cc:385] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:08.552629 12094 raft_consensus.cc:740] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:08.553604 12094 consensus_queue.cc:260] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.555864 12094 ts_tablet_manager.cc:1434] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:06:08.557358 12141 leader_election.cc:290] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.558499 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.558715 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.559147 12055 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.559448 11906 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.564342 12104 raft_consensus.cc:493] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.564917 12104 raft_consensus.cc:515] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.565317 12130 consensus_queue.cc:1048] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.567107 12104 leader_election.cc:290] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:08.567240 12055 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.569051 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.569777 11905 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:08.570041 11947 leader_election.cc:304] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:08.571189 12021 leader_election.cc:304] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.571533 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:08.572146 12104 raft_consensus.cc:2804] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.572247 11980 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:08.572604 12104 raft_consensus.cc:493] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.573011 12104 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.573745 11906 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.579504 12141 raft_consensus.cc:2804] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.580921 12141 raft_consensus.cc:697] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:08.581873 12141 consensus_queue.cc:237] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.583384 12104 raft_consensus.cc:515] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.586665 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:08.587287 11980 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.589705 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.590376 11906 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.594367 11980 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:08.595584 12018 leader_election.cc:304] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:08.596568 12151 raft_consensus.cc:2804] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.602397 12104 leader_election.cc:290] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:08.604678 12151 raft_consensus.cc:697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:08.604512 11800 catalog_manager.cc:5697] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.605661 12151 consensus_queue.cc:237] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.606282 11906 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:08.614867 11802 catalog_manager.cc:5697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.632766 12141 raft_consensus.cc:493] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.633445 12141 raft_consensus.cc:515] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.635231 12141 leader_election.cc:290] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.636341 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.636530 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.637079 11906 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.637117 12055 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.638375 11947 leader_election.cc:304] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.639101 12141 raft_consensus.cc:2804] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.639626 12141 raft_consensus.cc:493] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.640015 12141 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.645025 12141 raft_consensus.cc:515] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.646673 12141 leader_election.cc:290] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.647495 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.647894 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.648203 11906 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.648537 12055 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.655490 12055 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.655490 11906 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.657014 11947 leader_election.cc:304] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.657685 12141 raft_consensus.cc:2804] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.658176 12141 raft_consensus.cc:697] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:08.659001 12141 consensus_queue.cc:237] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.666430 11802 catalog_manager.cc:5697] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.748811 12055 raft_consensus.cc:3060] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.756095 12130 consensus_queue.cc:1048] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.756711 12100 consensus_queue.cc:1048] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.813793 12141 raft_consensus.cc:493] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.814288 12141 raft_consensus.cc:515] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.816360 12141 leader_election.cc:290] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.817157 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:08.817497 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:08.817909 11906 raft_consensus.cc:2468] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.818122 12055 raft_consensus.cc:2468] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:08.819072 11947 leader_election.cc:304] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.819835 12141 raft_consensus.cc:2804] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:08.820277 12141 raft_consensus.cc:493] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.820619 12141 raft_consensus.cc:3060] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.827286 12141 raft_consensus.cc:515] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.829197 12141 leader_election.cc:290] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:08.829988 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:08.830199 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd979729212446a1ac6293b3d2f6d37a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:08.830551 11906 raft_consensus.cc:3060] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.830925 12055 raft_consensus.cc:3060] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:08.835976 11906 raft_consensus.cc:2468] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.837088 12055 raft_consensus.cc:2468] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:08.837191 11947 leader_election.cc:304] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:08.838054 12141 raft_consensus.cc:2804] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:08.838580 12141 raft_consensus.cc:697] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:08.839527 12141 consensus_queue.cc:237] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:08.848062 11801 catalog_manager.cc:5697] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.849179 12141 consensus_queue.cc:1048] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.862865 12147 consensus_queue.cc:1048] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.882602 12101 consensus_queue.cc:1048] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.894549 12131 consensus_queue.cc:1048] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:08.903016 12147 consensus_queue.cc:1048] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:08.914499 12141 consensus_queue.cc:1048] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.031206 12162 consensus_queue.cc:1048] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.046614 12141 consensus_queue.cc:1048] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.079763 11980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
mode: GRACEFUL
new_leader_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:42274
I20260709 13:06:09.080461 11980 raft_consensus.cc:606] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Received request to transfer leadership to TS efef032111ff46cfa5a5208028592f68
I20260709 13:06:09.094081 12151 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.098359 12055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
mode: GRACEFUL
new_leader_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:06:09.099104 12055 raft_consensus.cc:606] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Received request to transfer leadership to TS efef032111ff46cfa5a5208028592f68
I20260709 13:06:09.107156 12104 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.108450 12106 consensus_queue.cc:1048] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.118388 12104 raft_consensus.cc:993] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: : Instructing follower efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:09.119038 12151 raft_consensus.cc:1081] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Signalling peer efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:09.120808 11906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:33160
I20260709 13:06:09.121481 11906 raft_consensus.cc:493] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.122946 11906 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.130051 12106 consensus_queue.cc:1048] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.130766 11906 raft_consensus.cc:515] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.133845 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:09.134514 11980 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.146657 11906 leader_election.cc:290] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:09.148283 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:09.149206 12055 raft_consensus.cc:3055] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.149438 11980 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:09.149626 12055 raft_consensus.cc:740] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:09.150913 11869 leader_election.cc:304] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:09.151911 12101 raft_consensus.cc:2804] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.152478 12101 raft_consensus.cc:697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:09.153303 12101 consensus_queue.cc:237] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.153836 12055 consensus_queue.cc:260] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.155217 12055 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.163168 11906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
mode: GRACEFUL
new_leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:39318
I20260709 13:06:09.163389 12055 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:09.162847 11800 catalog_manager.cc:5697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 1 to 2, leader changed from c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195) to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.163856 11906 raft_consensus.cc:606] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Received request to transfer leadership to TS b5e9ebcc11564acdb61e45afb0256e21
I20260709 13:06:09.176597 11980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdd1740c65ee424698f828958f632d00"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
mode: GRACEFUL
new_leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:42274
I20260709 13:06:09.177119 11980 raft_consensus.cc:606] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Received request to transfer leadership to TS c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:09.219450 12106 consensus_queue.cc:1048] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:09.232825 12163 consensus_queue.cc:1048] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:09.345043 12131 raft_consensus.cc:993] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: : Instructing follower b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:09.345535 12131 raft_consensus.cc:1081] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Signalling peer b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:09.347229 11980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:06:09.347800 11980 raft_consensus.cc:493] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.348178 11980 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.354418 11980 raft_consensus.cc:515] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.356523 11980 leader_election.cc:290] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:09.357156 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:09.357829 11906 raft_consensus.cc:3055] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.357852 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb98de5c19e4e19b8016e932b51a4ff" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:09.358294 11906 raft_consensus.cc:740] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:09.358623 12055 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.359162 11906 consensus_queue.cc:260] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.360278 11906 raft_consensus.cc:3060] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.364499 12055 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:09.365252 11906 raft_consensus.cc:2468] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:09.365943 11947 leader_election.cc:304] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:09.366856 12162 raft_consensus.cc:2804] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.367312 12162 raft_consensus.cc:697] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:09.368223 12162 consensus_queue.cc:237] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.374549 11800 catalog_manager.cc:5697] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 1 to 2, leader changed from efef032111ff46cfa5a5208028592f68 (127.0.107.193) to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.452754 12163 raft_consensus.cc:993] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: : Instructing follower efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:09.453338 12162 raft_consensus.cc:1081] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Signalling peer efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:09.454833 11906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:33170
I20260709 13:06:09.455350 11906 raft_consensus.cc:493] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.455664 11906 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.460563 11906 raft_consensus.cc:515] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:09.462172 11906 leader_election.cc:290] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:09.463202 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:09.463328 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b316101c01c749c1a43fe312a4b6eae4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:09.464004 11980 raft_consensus.cc:3055] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.464063 12055 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.464548 11980 raft_consensus.cc:740] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:09.465456 11980 consensus_queue.cc:260] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:09.467569 11980 raft_consensus.cc:3060] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.471534 12055 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:09.472584 11872 leader_election.cc:304] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:09.473289 12131 raft_consensus.cc:2804] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.473315 11980 raft_consensus.cc:2468] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:09.474088 12131 raft_consensus.cc:697] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:09.474967 12131 consensus_queue.cc:237] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } }
I20260709 13:06:09.481645 11800 catalog_manager.cc:5697] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 1 to 2, leader changed from b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194) to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.679076 12055 raft_consensus.cc:1275] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.680619 12131 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.689778 11980 raft_consensus.cc:1275] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.691262 12101 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.700109 12141 raft_consensus.cc:993] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: : Instructing follower c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:09.700685 12163 raft_consensus.cc:1081] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Signalling peer c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:09.702250 12055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdd1740c65ee424698f828958f632d00"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:06:09.702764 12055 raft_consensus.cc:493] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.703102 12055 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.709192 12055 raft_consensus.cc:515] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.710784 12055 leader_election.cc:290] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:09.711781 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:09.711671 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1740c65ee424698f828958f632d00" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:09.712517 11980 raft_consensus.cc:3055] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.712556 11906 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.712993 11980 raft_consensus.cc:740] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:09.713858 11980 consensus_queue.cc:260] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.715126 11980 raft_consensus.cc:3060] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.720058 11906 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:09.721340 12021 leader_election.cc:304] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:09.722118 12151 raft_consensus.cc:2804] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.722254 11980 raft_consensus.cc:2468] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:09.723097 12151 raft_consensus.cc:697] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:09.724154 12151 consensus_queue.cc:237] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:09.730866 11801 catalog_manager.cc:5697] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 1 to 2, leader changed from b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194) to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.939057 12055 raft_consensus.cc:1275] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.940542 12141 consensus_queue.cc:1048] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.941753 11906 raft_consensus.cc:1275] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.943077 12141 consensus_queue.cc:1048] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.948225 11980 raft_consensus.cc:1275] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.949990 12131 consensus_queue.cc:1048] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.966768 12055 raft_consensus.cc:1275] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.968497 12101 consensus_queue.cc:1048] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:10.179585 11980 raft_consensus.cc:1275] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:10.181061 12151 consensus_queue.cc:1048] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.191042 11906 raft_consensus.cc:1275] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:10.193130 12188 consensus_queue.cc:1048] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.203186 11801 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53472:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:12.205708 11801 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:12.253382 11892 tablet_service.cc:1511] Processing CreateTablet for tablet cdadac6c1fa246e0abad6ec695de817b (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:12.254554 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdadac6c1fa246e0abad6ec695de817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.254719 11963 tablet_service.cc:1511] Processing CreateTablet for tablet cdadac6c1fa246e0abad6ec695de817b (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:12.256063 11963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdadac6c1fa246e0abad6ec695de817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.256826 12042 tablet_service.cc:1511] Processing CreateTablet for tablet cdadac6c1fa246e0abad6ec695de817b (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:12.258080 12042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdadac6c1fa246e0abad6ec695de817b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.257967 11889 tablet_service.cc:1511] Processing CreateTablet for tablet 44907837cc304b14914ff7edf5d860ac (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:12.259153 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44907837cc304b14914ff7edf5d860ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.261344 12040 tablet_service.cc:1511] Processing CreateTablet for tablet 44907837cc304b14914ff7edf5d860ac (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:12.262670 12040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44907837cc304b14914ff7edf5d860ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.263329 11965 tablet_service.cc:1511] Processing CreateTablet for tablet 44907837cc304b14914ff7edf5d860ac (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:12.264604 11965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44907837cc304b14914ff7edf5d860ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.266855 11969 tablet_service.cc:1511] Processing CreateTablet for tablet 37584ac011b543fa9d604f36f6649d54 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:12.268286 11969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37584ac011b543fa9d604f36f6649d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.269158 11888 tablet_service.cc:1511] Processing CreateTablet for tablet 37584ac011b543fa9d604f36f6649d54 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:12.270814 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37584ac011b543fa9d604f36f6649d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.280392 12039 tablet_service.cc:1511] Processing CreateTablet for tablet 37584ac011b543fa9d604f36f6649d54 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:12.281854 12039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37584ac011b543fa9d604f36f6649d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.286425 11970 tablet_service.cc:1511] Processing CreateTablet for tablet b27b819076b548f1b0bf1a0b8cba16a4 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:12.287820 11970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27b819076b548f1b0bf1a0b8cba16a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.290863 11890 tablet_service.cc:1511] Processing CreateTablet for tablet b27b819076b548f1b0bf1a0b8cba16a4 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:12.292425 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27b819076b548f1b0bf1a0b8cba16a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.309070 11964 tablet_service.cc:1511] Processing CreateTablet for tablet de51479e4532432ca0c74a861622ca6a (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:12.310526 11964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de51479e4532432ca0c74a861622ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.313517 12041 tablet_service.cc:1511] Processing CreateTablet for tablet b27b819076b548f1b0bf1a0b8cba16a4 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:12.314935 12041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27b819076b548f1b0bf1a0b8cba16a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.317101 11896 tablet_service.cc:1511] Processing CreateTablet for tablet de51479e4532432ca0c74a861622ca6a (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:12.318571 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de51479e4532432ca0c74a861622ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.330662 11966 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc4daaf69cc4ae99ae989c284ad130d (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:12.332753 11966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc4daaf69cc4ae99ae989c284ad130d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.337930 12205 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.340528 11893 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc4daaf69cc4ae99ae989c284ad130d (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:12.341924 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc4daaf69cc4ae99ae989c284ad130d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.345077 12039 tablet_service.cc:1511] Processing CreateTablet for tablet de51479e4532432ca0c74a861622ca6a (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:12.346566 12039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de51479e4532432ca0c74a861622ca6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.374859 12206 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.379295 12207 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.379544 11964 tablet_service.cc:1511] Processing CreateTablet for tablet e412b49b2bab426b80cb230e77b45dd0 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:12.379014 11963 tablet_service.cc:1511] Processing CreateTablet for tablet fbcfec0c19c3467dae6ab71664ccb447 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:12.387132 12042 tablet_service.cc:1511] Processing CreateTablet for tablet fbcfec0c19c3467dae6ab71664ccb447 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:12.387353 12040 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc4daaf69cc4ae99ae989c284ad130d (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:12.388320 11964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e412b49b2bab426b80cb230e77b45dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.388404 12045 tablet_service.cc:1511] Processing CreateTablet for tablet e412b49b2bab426b80cb230e77b45dd0 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:12.390734 11963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcfec0c19c3467dae6ab71664ccb447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.391930 12045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e412b49b2bab426b80cb230e77b45dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.393961 12040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc4daaf69cc4ae99ae989c284ad130d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.398417 12207 tablet_bootstrap.cc:654] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.404597 12042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcfec0c19c3467dae6ab71664ccb447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.408944 12205 tablet_bootstrap.cc:654] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.410570 11966 tablet_service.cc:1511] Processing CreateTablet for tablet 1a266eba88944be3b6c0fc075e1837a6 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:06:12.408218 11872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44895, user_credentials={real_user=slave}} blocked reactor thread for 45509.6us
I20260709 13:06:12.415271 11966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a266eba88944be3b6c0fc075e1837a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.419257 11892 tablet_service.cc:1511] Processing CreateTablet for tablet fbcfec0c19c3467dae6ab71664ccb447 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:12.420756 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcfec0c19c3467dae6ab71664ccb447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.420969 12041 tablet_service.cc:1511] Processing CreateTablet for tablet 1a266eba88944be3b6c0fc075e1837a6 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:12.423161 12041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a266eba88944be3b6c0fc075e1837a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.430981 11896 tablet_service.cc:1511] Processing CreateTablet for tablet e412b49b2bab426b80cb230e77b45dd0 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:12.431977 12206 tablet_bootstrap.cc:654] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.432885 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e412b49b2bab426b80cb230e77b45dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.436653 11888 tablet_service.cc:1511] Processing CreateTablet for tablet 1a266eba88944be3b6c0fc075e1837a6 (DEFAULT_TABLE table=soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:12.438517 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a266eba88944be3b6c0fc075e1837a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.464082 12205 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.464766 12205 ts_tablet_manager.cc:1403] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.030s
I20260709 13:06:12.468688 12205 raft_consensus.cc:359] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.469539 12205 raft_consensus.cc:385] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.469884 12205 raft_consensus.cc:740] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.470719 12205 consensus_queue.cc:260] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.473173 12205 ts_tablet_manager.cc:1434] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:12.491258 12205 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.497786 12205 tablet_bootstrap.cc:654] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.498497 12206 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.498986 12206 ts_tablet_manager.cc:1403] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 13:06:12.503585 12205 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.501698 12206 raft_consensus.cc:359] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.503610 12207 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.504251 12206 raft_consensus.cc:385] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.504390 12205 ts_tablet_manager.cc:1403] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:06:12.504586 12207 ts_tablet_manager.cc:1403] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.021s
I20260709 13:06:12.504750 12206 raft_consensus.cc:740] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.505797 12206 consensus_queue.cc:260] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.507597 12207 raft_consensus.cc:359] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.508199 12206 ts_tablet_manager.cc:1434] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:06:12.508301 12207 raft_consensus.cc:385] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.508863 12207 raft_consensus.cc:740] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.509395 12206 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.510071 12207 consensus_queue.cc:260] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.513597 12207 ts_tablet_manager.cc:1434] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:06:12.514654 12207 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.516067 12205 raft_consensus.cc:359] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.516857 12206 tablet_bootstrap.cc:654] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.522011 12205 raft_consensus.cc:385] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.522433 12205 raft_consensus.cc:740] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.523313 12205 consensus_queue.cc:260] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.525717 12205 ts_tablet_manager.cc:1434] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:06:12.526810 12207 tablet_bootstrap.cc:654] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.528151 12205 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.538865 12205 tablet_bootstrap.cc:654] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.545913 12206 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.546622 12205 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.546800 12207 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.546546 12206 ts_tablet_manager.cc:1403] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.000s
I20260709 13:06:12.547235 12205 ts_tablet_manager.cc:1403] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:06:12.547375 12207 ts_tablet_manager.cc:1403] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 13:06:12.550439 12206 raft_consensus.cc:359] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.550736 12207 raft_consensus.cc:359] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.550658 12205 raft_consensus.cc:359] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.551225 12206 raft_consensus.cc:385] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.551580 12207 raft_consensus.cc:385] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.551656 12205 raft_consensus.cc:385] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.551697 12206 raft_consensus.cc:740] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.552148 12207 raft_consensus.cc:740] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.552285 12205 raft_consensus.cc:740] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.552781 12206 consensus_queue.cc:260] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.553164 12205 consensus_queue.cc:260] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.553354 12207 consensus_queue.cc:260] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.555606 12205 ts_tablet_manager.cc:1434] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:06:12.556159 12207 ts_tablet_manager.cc:1434] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:06:12.556627 12205 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.557211 12207 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.563766 12192 raft_consensus.cc:493] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.564339 12192 raft_consensus.cc:515] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.564813 12207 tablet_bootstrap.cc:654] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.565819 12206 ts_tablet_manager.cc:1434] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:06:12.566890 12206 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.567986 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:12.568755 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:12.569443 11980 raft_consensus.cc:2468] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
W20260709 13:06:12.570611 12021 leader_election.cc:343] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.571854 12018 leader_election.cc:304] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: efef032111ff46cfa5a5208028592f68
I20260709 13:06:12.573776 12206 tablet_bootstrap.cc:654] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.574159 12192 leader_election.cc:290] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:12.574477 12217 raft_consensus.cc:2804] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.574950 12217 raft_consensus.cc:493] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.575287 12217 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.563809 12205 tablet_bootstrap.cc:654] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.580399 12208 raft_consensus.cc:493] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.580981 12208 raft_consensus.cc:515] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.583150 12208 leader_election.cc:290] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.584903 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
W20260709 13:06:12.587488 11872 leader_election.cc:343] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.587821 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:12.589244 12206 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
W20260709 13:06:12.589381 11869 leader_election.cc:343] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.589704 12207 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.589900 12206 ts_tablet_manager.cc:1403] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:06:12.590315 12207 ts_tablet_manager.cc:1403] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:06:12.589923 11869 leader_election.cc:304] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efef032111ff46cfa5a5208028592f68; no voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:12.591255 12208 raft_consensus.cc:2749] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.593588 12206 raft_consensus.cc:359] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.594421 12206 raft_consensus.cc:385] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.594098 12207 raft_consensus.cc:359] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.594863 12207 raft_consensus.cc:385] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.594736 12206 raft_consensus.cc:740] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.595207 12207 raft_consensus.cc:740] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.595980 12207 consensus_queue.cc:260] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.595980 12206 consensus_queue.cc:260] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.598676 12207 ts_tablet_manager.cc:1434] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:12.599787 12207 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.599217 12217 raft_consensus.cc:515] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.602664 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:12.603340 12205 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.603946 12205 ts_tablet_manager.cc:1403] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.010s
W20260709 13:06:12.604140 12021 leader_election.cc:343] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.606946 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:12.607115 12207 tablet_bootstrap.cc:654] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.607573 11980 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.607230 12205 raft_consensus.cc:359] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.608266 12205 raft_consensus.cc:385] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.608618 12205 raft_consensus.cc:740] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.609443 12205 consensus_queue.cc:260] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.613664 12206 ts_tablet_manager.cc:1434] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:06:12.614336 12205 ts_tablet_manager.cc:1434] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:12.615231 12206 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.615484 12205 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.619575 12207 tablet_bootstrap.cc:492] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.620246 12207 ts_tablet_manager.cc:1403] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.016s
I20260709 13:06:12.623104 12205 tablet_bootstrap.cc:654] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.623980 12207 raft_consensus.cc:359] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.624930 12207 raft_consensus.cc:385] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.625273 12207 raft_consensus.cc:740] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.626102 12207 consensus_queue.cc:260] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.626758 12206 tablet_bootstrap.cc:654] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.632165 12217 leader_election.cc:290] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:12.635092 12207 ts_tablet_manager.cc:1434] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:06:12.636253 12207 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.643074 12207 tablet_bootstrap.cc:654] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.626345 11980 raft_consensus.cc:2468] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:12.645057 12018 leader_election.cc:304] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: efef032111ff46cfa5a5208028592f68
I20260709 13:06:12.646287 12217 raft_consensus.cc:2804] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.647706 12205 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.648324 12205 ts_tablet_manager.cc:1403] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:06:12.648720 12224 raft_consensus.cc:493] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.649269 12224 raft_consensus.cc:515] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.651747 12205 raft_consensus.cc:359] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.652333 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:12.652719 12205 raft_consensus.cc:385] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.653693 12192 raft_consensus.cc:493] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.653789 12205 raft_consensus.cc:740] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.654279 12192 raft_consensus.cc:515] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.654826 12205 consensus_queue.cc:260] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
W20260709 13:06:12.657516 11947 leader_election.cc:343] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.657668 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:12.658644 12192 leader_election.cc:290] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:12.658768 11905 raft_consensus.cc:2468] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:12.660234 12206 tablet_bootstrap.cc:492] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.661293 12206 ts_tablet_manager.cc:1403] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.008s
I20260709 13:06:12.660739 12021 leader_election.cc:304] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:12.662223 12192 raft_consensus.cc:2804] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.662593 12192 raft_consensus.cc:493] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.662921 12192 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.657704 12205 ts_tablet_manager.cc:1434] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:12.664762 12206 raft_consensus.cc:359] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.660516 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:12.665560 12206 raft_consensus.cc:385] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.665868 12205 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
W20260709 13:06:12.669576 12018 leader_election.cc:343] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.665908 12206 raft_consensus.cc:740] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.671674 12192 raft_consensus.cc:515] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.671826 12217 raft_consensus.cc:697] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:12.673885 12217 consensus_queue.cc:237] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.675587 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:12.676352 11905 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.677696 12205 tablet_bootstrap.cc:654] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.687296 11905 raft_consensus.cc:2468] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:12.688328 12206 consensus_queue.cc:260] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.690991 12206 ts_tablet_manager.cc:1434] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.004s
I20260709 13:06:12.691907 12192 leader_election.cc:290] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:12.693370 12206 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.694425 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:12.696467 12021 leader_election.cc:304] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:12.697644 12192 raft_consensus.cc:2804] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.698376 12192 raft_consensus.cc:697] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:12.697999 11802 catalog_manager.cc:5697] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.700078 12208 raft_consensus.cc:493] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.700613 12208 raft_consensus.cc:515] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
W20260709 13:06:12.701081 12018 leader_election.cc:343] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.704480 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.705147 12055 raft_consensus.cc:2468] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:12.706423 11872 leader_election.cc:304] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:12.707352 12194 raft_consensus.cc:2804] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.707743 12194 raft_consensus.cc:493] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.708173 12194 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.709443 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.710152 12055 raft_consensus.cc:2468] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:12.711552 11947 leader_election.cc:304] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: efef032111ff46cfa5a5208028592f68
I20260709 13:06:12.712572 12193 raft_consensus.cc:2804] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.712961 12193 raft_consensus.cc:493] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.713332 12193 raft_consensus.cc:3060] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.714058 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
W20260709 13:06:12.715777 11869 leader_election.cc:343] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.716470 12208 leader_election.cc:290] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.699327 12192 consensus_queue.cc:237] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.722424 12224 leader_election.cc:290] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.721977 12193 raft_consensus.cc:515] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.721977 12194 raft_consensus.cc:515] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.726969 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:12.727289 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:12.727907 12055 raft_consensus.cc:3060] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:12.729173 11869 leader_election.cc:343] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.730319 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
W20260709 13:06:12.731595 11947 leader_election.cc:343] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.736685 12055 raft_consensus.cc:2468] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:12.738751 11947 leader_election.cc:304] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: efef032111ff46cfa5a5208028592f68
I20260709 13:06:12.739707 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:12.740063 12224 raft_consensus.cc:2804] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.740556 12054 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.737268 12193 leader_election.cc:290] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.746639 12224 raft_consensus.cc:697] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:12.747114 12205 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.748126 12205 ts_tablet_manager.cc:1403] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.046s
I20260709 13:06:12.747936 12224 consensus_queue.cc:237] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.750193 12054 raft_consensus.cc:2468] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:12.751596 11872 leader_election.cc:304] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: b5e9ebcc11564acdb61e45afb0256e21
I20260709 13:06:12.752701 12208 raft_consensus.cc:2804] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.752594 12205 raft_consensus.cc:359] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.753881 12205 raft_consensus.cc:385] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.754304 12205 raft_consensus.cc:740] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.757653 12194 leader_election.cc:290] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.769119 12207 tablet_bootstrap.cc:492] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.768362 11802 catalog_manager.cc:5697] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.769717 12207 ts_tablet_manager.cc:1403] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.078s
I20260709 13:06:12.770157 12208 raft_consensus.cc:697] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:12.771548 12208 consensus_queue.cc:237] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.772876 12207 raft_consensus.cc:359] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.773622 12207 raft_consensus.cc:385] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.773904 12207 raft_consensus.cc:740] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.774645 12207 consensus_queue.cc:260] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.776702 12207 ts_tablet_manager.cc:1434] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:12.777081 12206 tablet_bootstrap.cc:654] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.777706 12207 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.755350 12205 consensus_queue.cc:260] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.783806 12205 ts_tablet_manager.cc:1434] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 13:06:12.785096 12205 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.785383 12207 tablet_bootstrap.cc:654] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.785657 12229 raft_consensus.cc:493] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.786262 12229 raft_consensus.cc:515] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.788935 12229 leader_election.cc:290] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.791715 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:12.792829 11905 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:12.795672 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.796773 12054 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:12.799728 11947 leader_election.cc:304] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:12.797816 11803 catalog_manager.cc:5697] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.802878 12229 raft_consensus.cc:2804] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.803438 12229 raft_consensus.cc:493] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.803874 12229 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.812315 12208 raft_consensus.cc:493] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.812925 12208 raft_consensus.cc:515] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.815491 12208 leader_election.cc:290] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.816970 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:12.819279 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de51479e4532432ca0c74a861622ca6a" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.820428 12054 raft_consensus.cc:2393] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efef032111ff46cfa5a5208028592f68 in current term 1: Already voted for candidate b5e9ebcc11564acdb61e45afb0256e21 in this term.
I20260709 13:06:12.824596 11872 leader_election.cc:304] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efef032111ff46cfa5a5208028592f68; no voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:12.826779 12231 raft_consensus.cc:3060] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.829032 12206 tablet_bootstrap.cc:492] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.829836 12229 raft_consensus.cc:515] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.831171 11803 catalog_manager.cc:5697] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.832340 12229 leader_election.cc:290] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.830503 12206 ts_tablet_manager.cc:1403] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.001s
I20260709 13:06:12.833562 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:12.834261 12055 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.836956 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:12.833639 12207 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.837703 11905 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.839592 12207 ts_tablet_manager.cc:1403] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.013s
I20260709 13:06:12.842031 12055 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:12.843369 11947 leader_election.cc:304] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:12.844637 12205 tablet_bootstrap.cc:654] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.845316 12193 raft_consensus.cc:2804] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.844990 12207 raft_consensus.cc:359] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.847669 12193 raft_consensus.cc:697] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:12.847700 12207 raft_consensus.cc:385] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.846642 12206 raft_consensus.cc:359] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.848816 12193 consensus_queue.cc:237] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.823318 12224 raft_consensus.cc:493] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.853890 12224 raft_consensus.cc:515] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.852952 12206 raft_consensus.cc:385] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.856873 12206 raft_consensus.cc:740] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.858860 12206 consensus_queue.cc:260] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.859326 11905 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:12.852499 12207 raft_consensus.cc:740] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.861011 12231 raft_consensus.cc:2749] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.861985 12207 consensus_queue.cc:260] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.863166 12206 ts_tablet_manager.cc:1434] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:06:12.864675 12206 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.865705 12207 ts_tablet_manager.cc:1434] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:06:12.867396 12207 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.872085 12224 leader_election.cc:290] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.883711 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:12.884593 11905 raft_consensus.cc:2468] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 0.
I20260709 13:06:12.889549 12207 tablet_bootstrap.cc:654] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.889050 11802 catalog_manager.cc:5697] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.890233 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.897349 12206 tablet_bootstrap.cc:654] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.898120 12205 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.898731 12205 ts_tablet_manager.cc:1403] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.023s
I20260709 13:06:12.899343 11947 leader_election.cc:304] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:12.901434 12193 raft_consensus.cc:2804] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:12.901867 12193 raft_consensus.cc:493] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.902202 12193 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.902376 12205 raft_consensus.cc:359] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.903234 12205 raft_consensus.cc:385] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.903578 12205 raft_consensus.cc:740] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.904407 12205 consensus_queue.cc:260] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.906834 12205 ts_tablet_manager.cc:1434] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:12.907970 12205 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.913064 12207 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.913239 12208 raft_consensus.cc:493] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.913663 12207 ts_tablet_manager.cc:1403] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:06:12.913810 12208 raft_consensus.cc:515] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.916066 12208 leader_election.cc:290] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.915751 12193 raft_consensus.cc:515] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.916769 12207 raft_consensus.cc:359] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.917682 12207 raft_consensus.cc:385] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.918048 12207 raft_consensus.cc:740] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.918708 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:12.919601 11980 raft_consensus.cc:2393] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efef032111ff46cfa5a5208028592f68 in current term 1: Already voted for candidate c8e1bade31714d0eab7d5afde0ec61bd in this term.
W20260709 13:06:12.920320 11947 leader_election.cc:343] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.918900 12193 leader_election.cc:290] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:12.920604 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:12.913110 12206 tablet_bootstrap.cc:492] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.922187 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:12.922237 12206 ts_tablet_manager.cc:1403] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.003s
I20260709 13:06:12.922194 11872 leader_election.cc:304] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efef032111ff46cfa5a5208028592f68; no voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:12.922827 11905 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.924382 12205 tablet_bootstrap.cc:654] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.924458 12208 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:12.926203 12206 raft_consensus.cc:359] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.927104 12206 raft_consensus.cc:385] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.927462 12206 raft_consensus.cc:740] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.918830 12207 consensus_queue.cc:260] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.930486 12207 ts_tablet_manager.cc:1434] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:06:12.930815 11905 raft_consensus.cc:2468] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 1.
I20260709 13:06:12.931591 12207 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.932125 12208 raft_consensus.cc:2749] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:12.928604 12206 consensus_queue.cc:260] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.932979 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
W20260709 13:06:12.934718 11947 leader_election.cc:343] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:12.935511 11947 leader_election.cc:304] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:12.936597 12193 raft_consensus.cc:2804] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:12.937327 12193 raft_consensus.cc:697] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:12.937897 12206 ts_tablet_manager.cc:1434] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:06:12.938230 12193 consensus_queue.cc:237] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.939018 12207 tablet_bootstrap.cc:654] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.939224 12206 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:12.946606 12205 tablet_bootstrap.cc:492] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:12.947435 12205 ts_tablet_manager.cc:1403] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.001s
I20260709 13:06:12.949415 12205 raft_consensus.cc:359] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.949889 12205 raft_consensus.cc:385] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.950163 12205 raft_consensus.cc:740] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.950712 12205 consensus_queue.cc:260] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.951064 12206 tablet_bootstrap.cc:654] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.952404 12205 ts_tablet_manager.cc:1434] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:06:12.953863 12205 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: Bootstrap starting.
I20260709 13:06:12.953905 11802 catalog_manager.cc:5697] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.963189 12205 tablet_bootstrap.cc:654] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.964953 12207 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:12.965493 12207 ts_tablet_manager.cc:1403] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.004s
I20260709 13:06:12.969373 12207 raft_consensus.cc:359] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.970340 12207 raft_consensus.cc:385] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.970680 12207 raft_consensus.cc:740] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.971460 12207 consensus_queue.cc:260] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.972278 12206 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:12.972892 12206 ts_tablet_manager.cc:1403] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.007s
I20260709 13:06:12.974560 12207 ts_tablet_manager.cc:1434] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:12.975950 12207 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: Bootstrap starting.
I20260709 13:06:12.975931 12206 raft_consensus.cc:359] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.976799 12206 raft_consensus.cc:385] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:12.977093 12206 raft_consensus.cc:740] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:12.977854 12206 consensus_queue.cc:260] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:12.985675 12207 tablet_bootstrap.cc:654] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:12.998191 12206 ts_tablet_manager.cc:1434] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:06:12.999408 12206 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:13.008886 12192 raft_consensus.cc:493] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.009769 12192 raft_consensus.cc:515] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.012614 12207 tablet_bootstrap.cc:492] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: No bootstrap required, opened a new log
I20260709 13:06:13.013180 12207 ts_tablet_manager.cc:1403] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.016s
I20260709 13:06:13.016548 12205 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: No bootstrap required, opened a new log
I20260709 13:06:13.015978 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:13.015354 12192 leader_election.cc:290] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:13.021894 11980 raft_consensus.cc:2468] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:13.022393 12206 tablet_bootstrap.cc:654] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.021888 12205 ts_tablet_manager.cc:1403] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.023s
I20260709 13:06:13.023613 12018 leader_election.cc:304] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:13.024540 12192 raft_consensus.cc:2804] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.024895 12192 raft_consensus.cc:493] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.017030 12207 raft_consensus.cc:359] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.024828 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:13.025482 12192 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.025761 12207 raft_consensus.cc:385] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.025836 12193 raft_consensus.cc:493] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.026191 12207 raft_consensus.cc:740] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.026454 12193 raft_consensus.cc:515] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.027019 12207 consensus_queue.cc:260] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.027961 11905 raft_consensus.cc:2468] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:13.028656 12193 leader_election.cc:290] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.029294 12207 ts_tablet_manager.cc:1434] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:13.029806 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:13.029707 12205 raft_consensus.cc:359] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.030467 12205 raft_consensus.cc:385] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.030675 12054 raft_consensus.cc:2393] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5e9ebcc11564acdb61e45afb0256e21 in current term 1: Already voted for candidate efef032111ff46cfa5a5208028592f68 in this term.
I20260709 13:06:13.030735 12205 raft_consensus.cc:740] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.031617 12205 consensus_queue.cc:260] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.033106 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:13.033653 12205 ts_tablet_manager.cc:1434] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:06:13.034801 11947 leader_election.cc:304] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21; no voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.035959 12193 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.038507 12192 raft_consensus.cc:515] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.043787 12193 raft_consensus.cc:2749] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.044137 12206 tablet_bootstrap.cc:492] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:13.044730 12206 ts_tablet_manager.cc:1403] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.012s
I20260709 13:06:13.045413 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.046013 11980 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.046171 11904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:13.047713 12206 raft_consensus.cc:359] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.048421 12206 raft_consensus.cc:385] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.048714 12206 raft_consensus.cc:740] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.049403 12206 consensus_queue.cc:260] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.051131 12206 ts_tablet_manager.cc:1434] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:13.052093 12206 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Bootstrap starting.
I20260709 13:06:13.052987 11980 raft_consensus.cc:2468] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:13.054308 12018 leader_election.cc:304] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.055173 12217 raft_consensus.cc:2804] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.055616 12217 raft_consensus.cc:697] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:13.056458 12217 consensus_queue.cc:237] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.060675 12206 tablet_bootstrap.cc:654] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:13.065516 12192 leader_election.cc:290] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:13.071895 12206 tablet_bootstrap.cc:492] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: No bootstrap required, opened a new log
I20260709 13:06:13.072499 12206 ts_tablet_manager.cc:1403] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:06:13.075865 12206 raft_consensus.cc:359] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.076594 12206 raft_consensus.cc:385] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:13.076864 12206 raft_consensus.cc:740] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Initialized, Role: FOLLOWER
I20260709 13:06:13.078715 12206 consensus_queue.cc:260] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.081632 12206 ts_tablet_manager.cc:1434] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:13.083998 11801 catalog_manager.cc:5697] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.092815 12217 raft_consensus.cc:493] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.093451 12217 raft_consensus.cc:515] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.095103 12217 leader_election.cc:290] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:13.096225 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a266eba88944be3b6c0fc075e1837a6" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:13.096053 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a266eba88944be3b6c0fc075e1837a6" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:13.096856 11980 raft_consensus.cc:2468] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:13.096894 11905 raft_consensus.cc:2468] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 0.
I20260709 13:06:13.098037 12021 leader_election.cc:304] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.098713 12217 raft_consensus.cc:2804] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.099092 12217 raft_consensus.cc:493] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.099442 12217 raft_consensus.cc:3060] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:13.100132 11852 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:13.102274 12208 raft_consensus.cc:493] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.102840 12208 raft_consensus.cc:515] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.108484 12217 raft_consensus.cc:515] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.109347 12208 leader_election.cc:290] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.109932 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" is_pre_election: true
I20260709 13:06:13.110626 12055 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:13.109932 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:13.111763 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a266eba88944be3b6c0fc075e1837a6" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:13.112159 11872 leader_election.cc:304] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.112372 11905 raft_consensus.cc:3060] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.112258 11980 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 0.
I20260709 13:06:13.113147 12208 raft_consensus.cc:2804] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:13.113552 12208 raft_consensus.cc:493] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.113895 12208 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.114177 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a266eba88944be3b6c0fc075e1837a6" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.114840 11981 raft_consensus.cc:3060] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.111346 12217 leader_election.cc:290] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:13.115732 12217 consensus_queue.cc:1048] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.120663 11905 raft_consensus.cc:2468] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:13.121497 12208 raft_consensus.cc:515] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.122215 11981 raft_consensus.cc:2468] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 1.
I20260709 13:06:13.122529 12021 leader_election.cc:304] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.124722 12208 leader_election.cc:290] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.124853 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.125497 12055 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.125581 12217 raft_consensus.cc:2804] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.126482 12217 raft_consensus.cc:697] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:13.127429 12217 consensus_queue.cc:237] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.128684 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.129388 11981 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.133472 12055 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:13.134824 11872 leader_election.cc:304] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.135712 12208 raft_consensus.cc:2804] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:13.136206 12208 raft_consensus.cc:697] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:13.136924 11981 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 1.
I20260709 13:06:13.137036 12208 consensus_queue.cc:237] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.149161 12192 consensus_queue.cc:1048] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.151643 11803 catalog_manager.cc:5697] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.162976 11801 catalog_manager.cc:5697] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.195076 12193 consensus_queue.cc:1048] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.207517 12193 consensus_queue.cc:1048] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.240629 12055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
mode: GRACEFUL
new_leader_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:06:13.241245 12055 raft_consensus.cc:606] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Received request to transfer leadership to TS efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.249485 12055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
mode: GRACEFUL
new_leader_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:06:13.250020 12055 raft_consensus.cc:606] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Received request to transfer leadership to TS efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.255125 11981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
mode: GRACEFUL
new_leader_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:42274
I20260709 13:06:13.255710 11981 raft_consensus.cc:606] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Received request to transfer leadership to TS efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.267575 12055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
mode: GRACEFUL
new_leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:06:13.268317 12055 raft_consensus.cc:606] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Received request to transfer leadership to TS b5e9ebcc11564acdb61e45afb0256e21
I20260709 13:06:13.269799 11981 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.273571 11905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
mode: GRACEFUL
new_leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:39318
I20260709 13:06:13.274232 11905 raft_consensus.cc:606] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Received request to transfer leadership to TS b5e9ebcc11564acdb61e45afb0256e21
I20260709 13:06:13.277529 12217 consensus_queue.cc:1048] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.286121 12220 raft_consensus.cc:493] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.286645 12220 raft_consensus.cc:515] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.288728 12220 leader_election.cc:290] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:13.289011 12192 consensus_queue.cc:1048] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.290369 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21" is_pre_election: true
I20260709 13:06:13.291914 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef032111ff46cfa5a5208028592f68" is_pre_election: true
I20260709 13:06:13.292752 11906 raft_consensus.cc:2393] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8e1bade31714d0eab7d5afde0ec61bd in current term 1: Already voted for candidate b5e9ebcc11564acdb61e45afb0256e21 in this term.
I20260709 13:06:13.294358 12021 leader_election.cc:304] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd; no voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68
I20260709 13:06:13.295199 12220 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.302354 12192 raft_consensus.cc:993] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: : Instructing follower efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.302968 12217 raft_consensus.cc:1081] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Signalling peer efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.304929 11906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:33160
I20260709 13:06:13.305051 12220 raft_consensus.cc:2749] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:13.305626 11906 raft_consensus.cc:493] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.306010 11906 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.310554 11906 raft_consensus.cc:515] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.312162 11906 leader_election.cc:290] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.313067 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.313243 12055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdadac6c1fa246e0abad6ec695de817b" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.313777 11981 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.313874 12055 raft_consensus.cc:3055] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.314316 12055 raft_consensus.cc:740] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:13.314900 12055 consensus_queue.cc:260] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.315858 12055 raft_consensus.cc:3060] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.320571 11981 raft_consensus.cc:2468] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.322109 11869 leader_election.cc:304] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.323055 12208 raft_consensus.cc:2804] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.323565 12208 raft_consensus.cc:697] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:13.324326 12236 consensus_queue.cc:1048] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.324417 12208 consensus_queue.cc:237] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.326354 12055 raft_consensus.cc:2468] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.332736 11801 catalog_manager.cc:5697] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 1 to 2, leader changed from c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195) to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.342991 12236 consensus_queue.cc:1048] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.349937 12229 raft_consensus.cc:993] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: : Instructing follower efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.350522 12236 raft_consensus.cc:1081] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Signalling peer efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.352119 11906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:33170
I20260709 13:06:13.352695 11906 raft_consensus.cc:493] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.353034 11906 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.357738 11906 raft_consensus.cc:515] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.359185 11906 leader_election.cc:290] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.360095 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.360770 11981 raft_consensus.cc:3055] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.361136 11981 raft_consensus.cc:740] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:13.361464 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27b819076b548f1b0bf1a0b8cba16a4" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.362313 12054 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.362335 11981 consensus_queue.cc:260] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.364121 11981 raft_consensus.cc:3060] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.364413 12208 consensus_queue.cc:1048] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.371019 12054 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.372646 11981 raft_consensus.cc:2468] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.372702 11872 leader_election.cc:304] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.376343 12208 raft_consensus.cc:2804] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.376888 12208 raft_consensus.cc:697] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:13.377677 12208 consensus_queue.cc:237] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.381989 12231 consensus_queue.cc:1048] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.393994 11802 catalog_manager.cc:5697] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 1 to 2, leader changed from b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194) to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.497578 11906 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:13.503870 12220 consensus_queue.cc:1048] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.515321 12192 consensus_queue.cc:1048] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.524449 12217 raft_consensus.cc:993] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: : Instructing follower b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:13.524921 12192 raft_consensus.cc:1081] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Signalling peer b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:13.526847 11981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:50620
I20260709 13:06:13.527427 11981 raft_consensus.cc:493] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.527843 11981 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.533185 11981 raft_consensus.cc:515] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.535148 11981 leader_election.cc:290] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.535909 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:13.536412 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcfec0c19c3467dae6ab71664ccb447" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.536615 11906 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.537767 12054 raft_consensus.cc:3055] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.538123 12054 raft_consensus.cc:740] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:13.538923 12054 consensus_queue.cc:260] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.540235 12054 raft_consensus.cc:3060] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.546073 11906 raft_consensus.cc:2468] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:13.546908 12054 raft_consensus.cc:2468] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:13.547020 12236 consensus_queue.cc:1048] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.547171 11947 leader_election.cc:304] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.548100 12229 raft_consensus.cc:2804] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.548578 12229 raft_consensus.cc:697] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:13.549362 12229 consensus_queue.cc:237] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.557705 12236 consensus_queue.cc:1048] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.560027 11802 catalog_manager.cc:5697] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 1 to 2, leader changed from c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195) to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.569024 12192 consensus_queue.cc:1048] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:13.589296 12220 consensus_queue.cc:1048] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.638494 12208 consensus_queue.cc:1048] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.650799 12231 consensus_queue.cc:1048] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:13.663671 12264 raft_consensus.cc:993] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: : Instructing follower b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:13.664206 12264 raft_consensus.cc:1081] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Signalling peer b5e9ebcc11564acdb61e45afb0256e21 to start an election
I20260709 13:06:13.666006 11981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
 from {username='slave'} at 127.0.0.1:50614
I20260709 13:06:13.667487 11981 raft_consensus.cc:493] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.667999 11981 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.674153 11981 raft_consensus.cc:515] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.676110 11981 leader_election.cc:290] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.676789 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:13.677412 11906 raft_consensus.cc:3055] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.677712 11906 raft_consensus.cc:740] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:13.677690 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e412b49b2bab426b80cb230e77b45dd0" candidate_uuid: "b5e9ebcc11564acdb61e45afb0256e21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.678398 12054 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.678633 11906 consensus_queue.cc:260] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.679898 11906 raft_consensus.cc:3060] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.685634 12054 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:13.686534 11906 raft_consensus.cc:2468] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e9ebcc11564acdb61e45afb0256e21 in term 2.
I20260709 13:06:13.687008 11947 leader_election.cc:304] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:13.687889 12224 raft_consensus.cc:2804] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.688380 12224 raft_consensus.cc:697] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Becoming Leader. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:13.689098 12224 consensus_queue.cc:237] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.695711 11802 catalog_manager.cc:5697] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 reported cstate change: term changed from 1 to 2, leader changed from efef032111ff46cfa5a5208028592f68 (127.0.107.193) to b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "b5e9ebcc11564acdb61e45afb0256e21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.706686 12192 raft_consensus.cc:993] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: : Instructing follower efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.707170 12220 raft_consensus.cc:1081] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Signalling peer efef032111ff46cfa5a5208028592f68 to start an election
I20260709 13:06:13.708609 11906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
 from {username='slave'} at 127.0.0.1:33160
I20260709 13:06:13.709167 11906 raft_consensus.cc:493] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:13.709512 11906 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.713647 12054 raft_consensus.cc:1275] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.715081 11906 raft_consensus.cc:515] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.715167 12264 consensus_queue.cc:1048] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.716822 11906 leader_election.cc:290] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Requested vote from peers b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983), c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895)
I20260709 13:06:13.717618 11981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:13.718274 11981 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.721535 12054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37584ac011b543fa9d604f36f6649d54" candidate_uuid: "efef032111ff46cfa5a5208028592f68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
I20260709 13:06:13.723110 12054 raft_consensus.cc:3055] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.723470 12054 raft_consensus.cc:740] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:13.724346 12054 consensus_queue.cc:260] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.725890 12054 raft_consensus.cc:3060] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.728462 11981 raft_consensus.cc:2468] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.733662 11981 raft_consensus.cc:1275] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.734129 11869 leader_election.cc:304] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:13.735661 12275 raft_consensus.cc:2804] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:13.736274 12275 raft_consensus.cc:697] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Leader. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:13.737076 12275 consensus_queue.cc:237] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:13.742534 12231 consensus_queue.cc:1048] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.745047 12054 raft_consensus.cc:2468] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef032111ff46cfa5a5208028592f68 in term 2.
I20260709 13:06:13.745452 11801 catalog_manager.cc:5697] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 reported cstate change: term changed from 1 to 2, leader changed from c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195) to efef032111ff46cfa5a5208028592f68 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "efef032111ff46cfa5a5208028592f68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.806362 12054 raft_consensus.cc:1275] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.808130 12231 consensus_queue.cc:1048] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.815623 11981 raft_consensus.cc:1275] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.817008 12275 consensus_queue.cc:1048] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.094332 11906 raft_consensus.cc:1275] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.095822 12224 consensus_queue.cc:1048] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.107942 12055 raft_consensus.cc:1275] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.109470 12276 consensus_queue.cc:1048] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.151662 12055 raft_consensus.cc:1275] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.153415 12276 consensus_queue.cc:1048] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.156462 11906 raft_consensus.cc:1275] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer b5e9ebcc11564acdb61e45afb0256e21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.158247 12276 consensus_queue.cc:1048] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.952437 11979 raft_consensus.cc:1275] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.984225 12055 raft_consensus.cc:1275] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Refusing update from remote peer efef032111ff46cfa5a5208028592f68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.991094 12291 consensus_queue.cc:1048] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:15.018791 12277 consensus_queue.cc:1048] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:15.952859 12076 debug-util.cc:398] Leaking SignalData structure 0x7b080018cae0 after lost signal to thread 434
W20260709 13:06:15.953982 12076 debug-util.cc:398] Leaking SignalData structure 0x7b0800041ec0 after lost signal to thread 11837
W20260709 13:06:15.955045 12076 debug-util.cc:398] Leaking SignalData structure 0x7b080005cda0 after lost signal to thread 11930
W20260709 13:06:15.955991 12076 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec6a0 after lost signal to thread 12005
W20260709 13:06:15.956965 12076 debug-util.cc:398] Leaking SignalData structure 0x7b0800250020 after lost signal to thread 12079
I20260709 13:06:17.001050 11802 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53472:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:06:17.023209 11802 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53472:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:06:17.178896   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:06:17.295660 12321 log.cc:927] Time spent T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:06:17.418962 12327 log.cc:927] Time spent T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:06:17.439474 12324 log.cc:927] Time spent T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:06:17.534286 12328 log.cc:927] Time spent T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 13:06:17.604504 12351 tablet.cc:1724] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.605602 12353 tablet.cc:1724] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.640614 12350 tablet.cc:1724] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.653851 12354 tablet.cc:1724] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.655218 12357 tablet.cc:1724] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.664466 12366 tablet.cc:1724] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.669871 12360 tablet.cc:1724] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:17.685468 12355 log.cc:927] Time spent T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:17.692492 12361 tablet.cc:1724] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.699385 12360 tablet.cc:1724] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.705060 12362 tablet.cc:1724] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.705197 12363 tablet.cc:1724] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.716996 12368 tablet.cc:1724] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.728870 12361 tablet.cc:1724] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.756183 12357 tablet.cc:1724] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.762506 12363 tablet.cc:1724] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.781615 12351 tablet.cc:1724] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.797191 12361 tablet.cc:1724] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.800602 12369 tablet.cc:1724] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.820477 12363 tablet.cc:1724] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.828562 12366 tablet.cc:1724] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.838104 12362 tablet.cc:1724] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.848280 12363 tablet.cc:1724] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.851958 11801 catalog_manager.cc:5789] TS c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195:44895) does not have the latest schema for tablet 1a266eba88944be3b6c0fc075e1837a6 (table soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda]). Expected version 1 got 0
I20260709 13:06:17.862031 12368 tablet.cc:1724] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.864668 11906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
mode: GRACEFUL
new_leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:39332
I20260709 13:06:17.867128 12350 tablet.cc:1724] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.867543 12353 tablet.cc:1724] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.865784 11906 raft_consensus.cc:606] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Received request to transfer leadership to TS c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:17.877837 12366 tablet.cc:1724] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.917760 12353 tablet.cc:1724] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:17.945592 11980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
mode: GRACEFUL
new_leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:42284
I20260709 13:06:17.946216 11980 raft_consensus.cc:606] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Received request to transfer leadership to TS c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:17.947474   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:06:17.948103   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:17.948593 11802 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: soft_deleted_table [id=8642eabd9c63449f85bc4c47b4090dda] alter complete (version 1)
I20260709 13:06:17.962505 11902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8"
dest_uuid: "efef032111ff46cfa5a5208028592f68"
mode: GRACEFUL
new_leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:39332
I20260709 13:06:17.963227 11902 raft_consensus.cc:606] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Received request to transfer leadership to TS c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:17.974445 11980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f"
dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
mode: GRACEFUL
new_leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:42284
I20260709 13:06:17.975379 11980 raft_consensus.cc:606] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Received request to transfer leadership to TS c8e1bade31714d0eab7d5afde0ec61bd
I20260709 13:06:17.977278 12325 raft_consensus.cc:993] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: : Instructing follower c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:17.977339   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:17.978041 12341 raft_consensus.cc:1081] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Signalling peer c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:17.978179   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:17.979758 12053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:06:17.980391 12053 raft_consensus.cc:493] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:17.980814 12053 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.988319 12053 raft_consensus.cc:515] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:17.992193 11902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:17.992573 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc4daaf69cc4ae99ae989c284ad130d" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:17.992975 11902 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.993196 11980 raft_consensus.cc:3055] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:17.995034 11980 raft_consensus.cc:740] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:17.995923 11980 consensus_queue.cc:260] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:17.992887 12053 leader_election.cc:290] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:17.997177 11980 raft_consensus.cc:3060] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.003418 11980 raft_consensus.cc:2468] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.008801 12018 leader_election.cc:304] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:18.010497 12333 raft_consensus.cc:2804] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.011068 12333 raft_consensus.cc:697] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:18.012326 12333 consensus_queue.cc:237] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.015017 11902 raft_consensus.cc:2468] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.021886 11800 catalog_manager.cc:5697] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 1 to 2, leader changed from b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194) to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.050241 12349 raft_consensus.cc:993] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: : Instructing follower c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.050887 12301 raft_consensus.cc:1081] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Signalling peer c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.052627 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:38744
I20260709 13:06:18.053113 12048 raft_consensus.cc:493] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.053411 12048 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.059064 12048 raft_consensus.cc:515] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.061420 12048 leader_election.cc:290] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 3 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:18.061822 11902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:18.062013 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3ae153d03f4d34a5dbd5646328f7b8" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:18.063453 11980 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.063473 11902 raft_consensus.cc:3055] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:18.063941 11902 raft_consensus.cc:740] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:18.064966 11902 consensus_queue.cc:260] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.066331 11902 raft_consensus.cc:3060] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.070526 11980 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 3.
I20260709 13:06:18.071866 12018 leader_election.cc:304] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:18.072698 12333 raft_consensus.cc:2804] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:18.073172 12333 raft_consensus.cc:697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 3 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:18.074016 12333 consensus_queue.cc:237] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.075397 11902 raft_consensus.cc:2468] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 3.
I20260709 13:06:18.083194 11800 catalog_manager.cc:5697] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 2 to 3, leader changed from efef032111ff46cfa5a5208028592f68 (127.0.107.193) to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.096963 12349 raft_consensus.cc:993] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: : Instructing follower c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.097512 12301 raft_consensus.cc:1081] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Signalling peer c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.099009 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:38744
I20260709 13:06:18.099653 12048 raft_consensus.cc:493] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.100085 12048 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.108318 12048 raft_consensus.cc:515] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.110661 12048 leader_election.cc:290] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:18.111743 11902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:18.112442 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44907837cc304b14914ff7edf5d860ac" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:18.112484 11902 raft_consensus.cc:3055] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:18.113142 11980 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.113413 11902 raft_consensus.cc:740] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efef032111ff46cfa5a5208028592f68, State: Running, Role: LEADER
I20260709 13:06:18.114434 11902 consensus_queue.cc:260] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.115799 11902 raft_consensus.cc:3060] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.120370 11980 raft_consensus.cc:2468] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.121589 12018 leader_election.cc:304] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e9ebcc11564acdb61e45afb0256e21, c8e1bade31714d0eab7d5afde0ec61bd; no voters: 
I20260709 13:06:18.122493 12333 raft_consensus.cc:2804] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.122954 12333 raft_consensus.cc:697] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:18.123873 12333 consensus_queue.cc:237] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.124920 11902 raft_consensus.cc:2468] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.133193 11800 catalog_manager.cc:5697] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 1 to 2, leader changed from efef032111ff46cfa5a5208028592f68 (127.0.107.193) to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.485476 11981 raft_consensus.cc:1275] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:18.486907 12333 consensus_queue.cc:1048] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:18.496379 12282 raft_consensus.cc:993] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: : Instructing follower c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.496744 11981 raft_consensus.cc:1275] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 3 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:18.497079 12282 raft_consensus.cc:1081] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Signalling peer c8e1bade31714d0eab7d5afde0ec61bd to start an election
I20260709 13:06:18.499686 12048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f"
dest_uuid: "c8e1bade31714d0eab7d5afde0ec61bd"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:06:18.499677 12333 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:18.500453 12048 raft_consensus.cc:493] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:18.500850 12048 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.518263 12048 raft_consensus.cc:515] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.521799 11902 raft_consensus.cc:1275] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:18.530508 12288 consensus_queue.cc:1048] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.551110 12048 leader_election.cc:290] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Requested vote from peers efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409), b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983)
I20260709 13:06:18.561672 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efef032111ff46cfa5a5208028592f68"
I20260709 13:06:18.562417 11905 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.561746 11906 raft_consensus.cc:1275] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 3 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:18.574501 11906 raft_consensus.cc:1275] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:18.588855 12333 consensus_queue.cc:1048] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.595429 11905 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.597394 12021 leader_election.cc:304] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e1bade31714d0eab7d5afde0ec61bd, efef032111ff46cfa5a5208028592f68; no voters: 
I20260709 13:06:18.602035 12288 consensus_queue.cc:1048] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:18.604044 12333 raft_consensus.cc:2804] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:18.604614 12333 raft_consensus.cc:697] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Becoming Leader. State: Replica: c8e1bade31714d0eab7d5afde0ec61bd, State: Running, Role: LEADER
I20260709 13:06:18.605639 12333 consensus_queue.cc:237] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.608522 11980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24d373945434c13bf1df741ff0a1e7f" candidate_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5e9ebcc11564acdb61e45afb0256e21"
I20260709 13:06:18.609180 11980 raft_consensus.cc:3055] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:18.609511 11980 raft_consensus.cc:740] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5e9ebcc11564acdb61e45afb0256e21, State: Running, Role: LEADER
I20260709 13:06:18.610445 11980 consensus_queue.cc:260] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } }
I20260709 13:06:18.611773 11980 raft_consensus.cc:3060] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:18.633545 12018 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45983, user_credentials={real_user=slave}} blocked reactor thread for 43933.3us
I20260709 13:06:18.637100 11980 raft_consensus.cc:2468] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e1bade31714d0eab7d5afde0ec61bd in term 2.
I20260709 13:06:18.856712 11981 raft_consensus.cc:1275] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:18.861656 12288 consensus_queue.cc:1048] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:18.894395 11800 catalog_manager.cc:5697] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd reported cstate change: term changed from 1 to 2, leader changed from b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194) to c8e1bade31714d0eab7d5afde0ec61bd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e1bade31714d0eab7d5afde0ec61bd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44895 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:19.048887   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:06:19.055512   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:06:19.055955   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:19.063900   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:06:19.064426   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:19.142515 11979 raft_consensus.cc:1275] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:19.143923 12333 consensus_queue.cc:1048] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e9ebcc11564acdb61e45afb0256e21" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.155440 11905 raft_consensus.cc:1275] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Refusing update from remote peer c8e1bade31714d0eab7d5afde0ec61bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:19.157151 12333 consensus_queue.cc:1048] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef032111ff46cfa5a5208028592f68" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:19.755482 11834 debug-util.cc:398] Leaking SignalData structure 0x7b0800091580 after lost signal to thread 434
W20260709 13:06:19.756587 11834 debug-util.cc:398] Leaking SignalData structure 0x7b08001794e0 after lost signal to thread 11837
W20260709 13:06:19.757773 11834 debug-util.cc:398] Leaking SignalData structure 0x7b080026c3e0 after lost signal to thread 11930
W20260709 13:06:19.758725 11834 debug-util.cc:398] Leaking SignalData structure 0x7b0800083d20 after lost signal to thread 12005
W20260709 13:06:19.759801 11834 debug-util.cc:398] Leaking SignalData structure 0x7b080026a9c0 after lost signal to thread 12079
I20260709 13:06:20.116750   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:06:20.122824 12021 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:06:20.147541 12021 consensus_peers.cc:597] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.186054 12021 consensus_peers.cc:597] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.204936   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:20.206034   431 tablet_replica.cc:333] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.207139   431 raft_consensus.cc:2243] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.207701   431 raft_consensus.cc:2272] T 1a266eba88944be3b6c0fc075e1837a6 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.210680   431 tablet_replica.cc:333] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.211513   431 raft_consensus.cc:2243] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.212095   431 raft_consensus.cc:2272] T e412b49b2bab426b80cb230e77b45dd0 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.214740   431 tablet_replica.cc:333] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.215499   431 raft_consensus.cc:2243] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.216013   431 raft_consensus.cc:2272] T de51479e4532432ca0c74a861622ca6a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.218778   431 tablet_replica.cc:333] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.219489   431 raft_consensus.cc:2243] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.219982   431 raft_consensus.cc:2272] T fbcfec0c19c3467dae6ab71664ccb447 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.222239   431 tablet_replica.cc:333] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.222884   431 raft_consensus.cc:2243] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.224174   431 raft_consensus.cc:2272] T 37584ac011b543fa9d604f36f6649d54 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.227622   431 tablet_replica.cc:333] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.228736   431 raft_consensus.cc:2243] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.229255   431 raft_consensus.cc:2272] T 44907837cc304b14914ff7edf5d860ac P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.231613   431 tablet_replica.cc:333] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.232477   431 raft_consensus.cc:2243] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.233495   431 raft_consensus.cc:2272] T b27b819076b548f1b0bf1a0b8cba16a4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.236498   431 tablet_replica.cc:333] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.237303   431 raft_consensus.cc:2243] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.238255   431 raft_consensus.cc:2272] T cdadac6c1fa246e0abad6ec695de817b P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.241070   431 tablet_replica.cc:333] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.241775   431 raft_consensus.cc:2243] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.242223   431 raft_consensus.cc:2272] T 6d3ae153d03f4d34a5dbd5646328f7b8 P efef032111ff46cfa5a5208028592f68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.244876   431 tablet_replica.cc:333] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.245528   431 raft_consensus.cc:2243] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.246047   431 raft_consensus.cc:2272] T d24d373945434c13bf1df741ff0a1e7f P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.249257   431 tablet_replica.cc:333] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.250018   431 raft_consensus.cc:2243] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.251070   431 raft_consensus.cc:2272] T b316101c01c749c1a43fe312a4b6eae4 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.253765   431 tablet_replica.cc:333] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.254565   431 raft_consensus.cc:2243] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.255163   431 raft_consensus.cc:2272] T 780e7c514e424336a8c7e49e4d48499b P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.257827   431 tablet_replica.cc:333] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.258466   431 raft_consensus.cc:2243] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.259316   431 raft_consensus.cc:2272] T d02c0c9fea83417ebbbf4a60fbd9ed80 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.262272   431 tablet_replica.cc:333] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.263090   431 raft_consensus.cc:2243] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.263753   431 raft_consensus.cc:2272] T fdb98de5c19e4e19b8016e932b51a4ff P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.266685   431 tablet_replica.cc:333] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.267364   431 raft_consensus.cc:2243] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.268374   431 raft_consensus.cc:2272] T 5cc4daaf69cc4ae99ae989c284ad130d P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.271462   431 tablet_replica.cc:333] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.272235   431 raft_consensus.cc:2243] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.273424   431 raft_consensus.cc:2272] T d7a8403fdb7e4756bd88d966e2224639 P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.277052   431 tablet_replica.cc:333] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.277663   431 raft_consensus.cc:2243] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.278208   431 raft_consensus.cc:2272] T dd979729212446a1ac6293b3d2f6d37a P efef032111ff46cfa5a5208028592f68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.280803   431 tablet_replica.cc:333] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68: stopping tablet replica
I20260709 13:06:20.281471   431 raft_consensus.cc:2243] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.282034   431 raft_consensus.cc:2272] T cdd1740c65ee424698f828958f632d00 P efef032111ff46cfa5a5208028592f68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.319335   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:06:20.377228 11947 consensus_peers.cc:597] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.383173   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:06:20.398034 11947 consensus_peers.cc:597] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.404337 12021 consensus_peers.cc:597] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.408660 12021 consensus_peers.cc:597] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.417485 12018 consensus_peers.cc:597] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd -> Peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Couldn't send request to peer b5e9ebcc11564acdb61e45afb0256e21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.435079 11947 consensus_peers.cc:597] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.443506 12021 consensus_peers.cc:597] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.444764   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:20.445676   431 tablet_replica.cc:333] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.446741   431 raft_consensus.cc:2243] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.447793   431 raft_consensus.cc:2272] T e412b49b2bab426b80cb230e77b45dd0 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.450395   431 tablet_replica.cc:333] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.451110   431 raft_consensus.cc:2243] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.451629   431 raft_consensus.cc:2272] T 1a266eba88944be3b6c0fc075e1837a6 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.454196   431 tablet_replica.cc:333] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.454813   431 raft_consensus.cc:2243] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.455416   431 raft_consensus.cc:2272] T 44907837cc304b14914ff7edf5d860ac P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.458164   431 tablet_replica.cc:333] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.458848   431 raft_consensus.cc:2243] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.459335   431 raft_consensus.cc:2272] T cdadac6c1fa246e0abad6ec695de817b P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.461823   431 tablet_replica.cc:333] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.462451   431 raft_consensus.cc:2243] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.462978   431 raft_consensus.cc:2272] T b27b819076b548f1b0bf1a0b8cba16a4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.465296   431 tablet_replica.cc:333] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.465956   431 raft_consensus.cc:2243] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.466882   431 raft_consensus.cc:2272] T de51479e4532432ca0c74a861622ca6a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.469295   431 tablet_replica.cc:333] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.469923   431 raft_consensus.cc:2243] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.470577   431 raft_consensus.cc:2272] T b316101c01c749c1a43fe312a4b6eae4 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.473273   431 tablet_replica.cc:333] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.474134   431 raft_consensus.cc:2243] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.475221   431 raft_consensus.cc:2272] T 780e7c514e424336a8c7e49e4d48499b P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:20.476372 11947 consensus_peers.cc:597] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.477766   431 tablet_replica.cc:333] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.478453   431 raft_consensus.cc:2243] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.479244   431 raft_consensus.cc:2272] T fbcfec0c19c3467dae6ab71664ccb447 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.481652   431 tablet_replica.cc:333] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.482236   431 raft_consensus.cc:2243] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.482750   431 raft_consensus.cc:2272] T 37584ac011b543fa9d604f36f6649d54 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.485172   431 tablet_replica.cc:333] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.485994   431 raft_consensus.cc:2243] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.486428   431 raft_consensus.cc:2272] T d24d373945434c13bf1df741ff0a1e7f P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.488639   431 tablet_replica.cc:333] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.489163   431 raft_consensus.cc:2243] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.489708   431 raft_consensus.cc:2272] T 6d3ae153d03f4d34a5dbd5646328f7b8 P b5e9ebcc11564acdb61e45afb0256e21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.491891   431 tablet_replica.cc:333] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.492478   431 raft_consensus.cc:2243] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.493326   431 raft_consensus.cc:2272] T fdb98de5c19e4e19b8016e932b51a4ff P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.495725   431 tablet_replica.cc:333] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.496367   431 raft_consensus.cc:2243] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.496798   431 raft_consensus.cc:2272] T d7a8403fdb7e4756bd88d966e2224639 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.499053   431 tablet_replica.cc:333] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.499688   431 raft_consensus.cc:2243] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.500171   431 raft_consensus.cc:2272] T 5cc4daaf69cc4ae99ae989c284ad130d P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.502395   431 tablet_replica.cc:333] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.502962   431 raft_consensus.cc:2243] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.503396   431 raft_consensus.cc:2272] T cdd1740c65ee424698f828958f632d00 P b5e9ebcc11564acdb61e45afb0256e21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.505920   431 tablet_replica.cc:333] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.506450   431 raft_consensus.cc:2243] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.507462   431 raft_consensus.cc:2272] T dd979729212446a1ac6293b3d2f6d37a P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.509903   431 tablet_replica.cc:333] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21: stopping tablet replica
I20260709 13:06:20.510404   431 raft_consensus.cc:2243] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.510864   431 raft_consensus.cc:2272] T d02c0c9fea83417ebbbf4a60fbd9ed80 P b5e9ebcc11564acdb61e45afb0256e21 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:20.517973 12021 consensus_peers.cc:597] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd -> Peer efef032111ff46cfa5a5208028592f68 (127.0.107.193:43409): Couldn't send request to peer efef032111ff46cfa5a5208028592f68. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.566985   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:06:20.573318 12018 consensus_peers.cc:597] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd -> Peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Couldn't send request to peer b5e9ebcc11564acdb61e45afb0256e21. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.588912 12018 consensus_peers.cc:597] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd -> Peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Couldn't send request to peer b5e9ebcc11564acdb61e45afb0256e21. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:20.597484 12018 consensus_peers.cc:597] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd -> Peer b5e9ebcc11564acdb61e45afb0256e21 (127.0.107.194:45983): Couldn't send request to peer b5e9ebcc11564acdb61e45afb0256e21. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:20.613813   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:06:20.666882   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:20.667824   431 tablet_replica.cc:333] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.669062   431 raft_consensus.cc:2243] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.670156   431 raft_consensus.cc:2272] T 1a266eba88944be3b6c0fc075e1837a6 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.673107   431 tablet_replica.cc:333] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.673997   431 raft_consensus.cc:2243] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.674576   431 raft_consensus.cc:2272] T e412b49b2bab426b80cb230e77b45dd0 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.677525   431 tablet_replica.cc:333] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.678376   431 raft_consensus.cc:2243] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.679008   431 raft_consensus.cc:2272] T de51479e4532432ca0c74a861622ca6a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.681932   431 tablet_replica.cc:333] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.682837   431 raft_consensus.cc:2243] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.683401   431 raft_consensus.cc:2272] T b27b819076b548f1b0bf1a0b8cba16a4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.686237   431 tablet_replica.cc:333] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.687095   431 raft_consensus.cc:2243] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.688169   431 raft_consensus.cc:2272] T 44907837cc304b14914ff7edf5d860ac P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.691049   431 tablet_replica.cc:333] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.691964   431 raft_consensus.cc:2243] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.692620   431 raft_consensus.cc:2272] T cdadac6c1fa246e0abad6ec695de817b P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.695525   431 tablet_replica.cc:333] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.696333   431 raft_consensus.cc:2243] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.696934   431 raft_consensus.cc:2272] T d02c0c9fea83417ebbbf4a60fbd9ed80 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.700155   431 tablet_replica.cc:333] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.701086   431 raft_consensus.cc:2243] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.702148   431 raft_consensus.cc:2272] T 6d3ae153d03f4d34a5dbd5646328f7b8 P c8e1bade31714d0eab7d5afde0ec61bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.705103   431 tablet_replica.cc:333] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.705935   431 raft_consensus.cc:2243] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.707010   431 raft_consensus.cc:2272] T d24d373945434c13bf1df741ff0a1e7f P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.710009   431 tablet_replica.cc:333] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.710829   431 raft_consensus.cc:2243] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.711437   431 raft_consensus.cc:2272] T b316101c01c749c1a43fe312a4b6eae4 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.714602   431 tablet_replica.cc:333] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.715447   431 raft_consensus.cc:2243] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.716048   431 raft_consensus.cc:2272] T 780e7c514e424336a8c7e49e4d48499b P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.719079   431 tablet_replica.cc:333] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.719954   431 raft_consensus.cc:2243] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.720578   431 raft_consensus.cc:2272] T fbcfec0c19c3467dae6ab71664ccb447 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.723289   431 tablet_replica.cc:333] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.724121   431 raft_consensus.cc:2243] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.724706   431 raft_consensus.cc:2272] T 37584ac011b543fa9d604f36f6649d54 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.727682   431 tablet_replica.cc:333] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.728547   431 raft_consensus.cc:2243] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.729142   431 raft_consensus.cc:2272] T fdb98de5c19e4e19b8016e932b51a4ff P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.732139   431 tablet_replica.cc:333] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.732950   431 raft_consensus.cc:2243] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.734117   431 raft_consensus.cc:2272] T cdd1740c65ee424698f828958f632d00 P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.737231   431 tablet_replica.cc:333] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.738003   431 raft_consensus.cc:2243] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.738575   431 raft_consensus.cc:2272] T dd979729212446a1ac6293b3d2f6d37a P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.741807   431 tablet_replica.cc:333] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.742513   431 raft_consensus.cc:2243] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.743527   431 raft_consensus.cc:2272] T 5cc4daaf69cc4ae99ae989c284ad130d P c8e1bade31714d0eab7d5afde0ec61bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.746344   431 tablet_replica.cc:333] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd: stopping tablet replica
I20260709 13:06:20.747001   431 raft_consensus.cc:2243] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.747543   431 raft_consensus.cc:2272] T d7a8403fdb7e4756bd88d966e2224639 P c8e1bade31714d0eab7d5afde0ec61bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.814694   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:06:20.855230   431 master.cc:562] Master@127.0.107.254:38115 shutting down...
I20260709 13:06:20.889846   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:20.890441   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.890802   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 300912e572d844ff89a629a1db3023b3: stopping tablet replica
W20260709 13:06:21.908413   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11834)
W20260709 13:06:22.908880   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11834)
I20260709 13:06:23.273322   431 master.cc:584] Master@127.0.107.254:38115 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (16479 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:06:23.334774   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39631
I20260709 13:06:23.335891   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:23.341681 12405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.342765 12408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.343248 12406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.345839   431 server_base.cc:1061] running on GCE node
I20260709 13:06:23.347110   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:23.347358   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:23.347478   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602383347467 us; error 0 us; skew 500 ppm
I20260709 13:06:23.347935   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:23.350528   431 webserver.cc:533] Webserver started at http://127.0.107.254:41753/ using document root <none> and password file <none>
I20260709 13:06:23.351020   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:23.351176   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:23.351402   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:23.352592   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/master-0-root/instance:
uuid: "b3c393215bc24911a91b5b297529805e"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.357285   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:23.361045 12413 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.361996   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:23.362283   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/master-0-root
uuid: "b3c393215bc24911a91b5b297529805e"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.362598   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:23.383958   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:23.385273   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:23.430701   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39631
I20260709 13:06:23.430805 12464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39631 every 8 connection(s)
I20260709 13:06:23.435078 12465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.446748 12465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: Bootstrap starting.
I20260709 13:06:23.451622 12465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:23.456316 12465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: No bootstrap required, opened a new log
I20260709 13:06:23.458595 12465 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER }
I20260709 13:06:23.459012 12465 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:23.459236 12465 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c393215bc24911a91b5b297529805e, State: Initialized, Role: FOLLOWER
I20260709 13:06:23.459975 12465 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER }
I20260709 13:06:23.460486 12465 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:23.460707 12465 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:23.460978 12465 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:23.466202 12465 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER }
I20260709 13:06:23.466856 12465 leader_election.cc:304] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3c393215bc24911a91b5b297529805e; no voters: 
I20260709 13:06:23.468396 12465 leader_election.cc:290] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:23.468712 12468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:23.470211 12468 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 1 LEADER]: Becoming Leader. State: Replica: b3c393215bc24911a91b5b297529805e, State: Running, Role: LEADER
I20260709 13:06:23.470990 12468 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER }
I20260709 13:06:23.471664 12465 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:23.475723 12469 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3c393215bc24911a91b5b297529805e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER } }
I20260709 13:06:23.476538 12469 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:23.476573 12470 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3c393215bc24911a91b5b297529805e. Latest consensus state: current_term: 1 leader_uuid: "b3c393215bc24911a91b5b297529805e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c393215bc24911a91b5b297529805e" member_type: VOTER } }
I20260709 13:06:23.477643 12470 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:23.481245 12474 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:23.489773 12474 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:23.491242   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:23.499475 12474 catalog_manager.cc:1383] Generated new cluster ID: 22b7abfe3d2545cca993c9258c35b145
I20260709 13:06:23.499797 12474 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:23.515825 12474 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:23.517372 12474 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:23.530556 12474 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: Generated new TSK 0
I20260709 13:06:23.531245 12474 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:23.558679   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:23.565441 12486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.567152 12487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.569320 12489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.569386   431 server_base.cc:1061] running on GCE node
I20260709 13:06:23.571013   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:23.571264   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:23.571455   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602383571436 us; error 0 us; skew 500 ppm
I20260709 13:06:23.571993   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:23.574756   431 webserver.cc:533] Webserver started at http://127.0.107.193:44847/ using document root <none> and password file <none>
I20260709 13:06:23.575289   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:23.575497   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:23.575757   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:23.576903   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-0-root/instance:
uuid: "fc2992e6f7d5442495a80488190a805b"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.581516   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:06:23.585165 12494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.585975   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:06:23.586287   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-0-root
uuid: "fc2992e6f7d5442495a80488190a805b"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.586601   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:23.618343   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:23.619699   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:23.621265   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:23.623524   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:23.623746   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.623996   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:23.624212   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:06:23.665475   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41443
I20260709 13:06:23.665598 12556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41443 every 8 connection(s)
I20260709 13:06:23.670588   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:23.678416 12561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.679271 12562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.685835   431 server_base.cc:1061] running on GCE node
W20260709 13:06:23.685806 12565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.687811   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:23.688138   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:23.688365   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602383688347 us; error 0 us; skew 500 ppm
I20260709 13:06:23.689108   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:23.689348 12557 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39631
I20260709 13:06:23.689867 12557 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:23.691004 12557 heartbeater.cc:507] Master 127.0.107.254:39631 requested a full tablet report, sending...
I20260709 13:06:23.693053   431 webserver.cc:533] Webserver started at http://127.0.107.194:38897/ using document root <none> and password file <none>
I20260709 13:06:23.693655   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:23.693598 12430 ts_manager.cc:194] Registered new tserver with Master: fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443)
I20260709 13:06:23.694064   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:23.694378   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:23.695519   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-1-root/instance:
uuid: "e35bdc3e9b3b4602955809715f74827d"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.695628 12430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54494
I20260709 13:06:23.701129   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:06:23.705093 12569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.706004   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:06:23.706269   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-1-root
uuid: "e35bdc3e9b3b4602955809715f74827d"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.706568   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:23.721331   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:23.722465   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:23.723896   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:23.726516   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:23.726703   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.727007   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:23.727156   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.771739   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34799
I20260709 13:06:23.771972 12631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34799 every 8 connection(s)
I20260709 13:06:23.777024   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:23.784817 12635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:23.785950 12636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.788654   431 server_base.cc:1061] running on GCE node
W20260709 13:06:23.789956 12638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:23.790522 12632 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39631
I20260709 13:06:23.791038 12632 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:23.791260   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:23.791576   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:23.791801   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602383791770 us; error 0 us; skew 500 ppm
I20260709 13:06:23.791993 12632 heartbeater.cc:507] Master 127.0.107.254:39631 requested a full tablet report, sending...
I20260709 13:06:23.792645   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:23.794787 12430 ts_manager.cc:194] Registered new tserver with Master: e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:23.795812   431 webserver.cc:533] Webserver started at http://127.0.107.195:32891/ using document root <none> and password file <none>
I20260709 13:06:23.796465   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:23.796670   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:23.796622 12430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54498
I20260709 13:06:23.797155   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:23.798830   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-2-root/instance:
uuid: "2f0f4839a29548a0b4179dc3adcff600"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.803790   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:06:23.807731 12643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.808825   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:06:23.809170   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-2-root
uuid: "2f0f4839a29548a0b4179dc3adcff600"
format_stamp: "Formatted at 2026-07-09 13:06:23 on dist-test-slave-rrf3"
I20260709 13:06:23.809448   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwjG09f/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602043384352-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:23.822153   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:23.823392   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:23.825021   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:23.827486   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:23.827739   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:23.827993   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:23.828233   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:06:23.874384   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44279
I20260709 13:06:23.874488 12705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44279 every 8 connection(s)
I20260709 13:06:23.889765 12706 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39631
I20260709 13:06:23.890282 12706 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:23.891072 12706 heartbeater.cc:507] Master 127.0.107.254:39631 requested a full tablet report, sending...
I20260709 13:06:23.893174 12430 ts_manager.cc:194] Registered new tserver with Master: 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:23.893453   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015535498s
I20260709 13:06:23.894650 12430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54510
I20260709 13:06:23.920182 12430 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54518:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:23.922915 12430 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:24.009686 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2f110ac2aa4305b535e10990fd067c (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:24.011472 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2f110ac2aa4305b535e10990fd067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.013281 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:24.015097 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.015502 12596 tablet_service.cc:1511] Processing CreateTablet for tablet 84e57a1d090b4284ace9e52e52a0f6c1 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:24.017163 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e57a1d090b4284ace9e52e52a0f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.017439 12669 tablet_service.cc:1511] Processing CreateTablet for tablet 071cf28a10a94df4a341829812b1111d (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:24.019071 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071cf28a10a94df4a341829812b1111d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.021426 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 2164f5547ff34a49b4a6c281ecd13a0e (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:24.022912 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2164f5547ff34a49b4a6c281ecd13a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.023756 12522 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2f110ac2aa4305b535e10990fd067c (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:24.025529 12591 tablet_service.cc:1511] Processing CreateTablet for tablet 5653fb04d7ae4650aa051e6c1be8fd8f (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:24.025775 12594 tablet_service.cc:1511] Processing CreateTablet for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:24.027132 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5653fb04d7ae4650aa051e6c1be8fd8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.026823 12521 tablet_service.cc:1511] Processing CreateTablet for tablet 84e57a1d090b4284ace9e52e52a0f6c1 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:24.021474 12592 tablet_service.cc:1511] Processing CreateTablet for tablet 45e3f2d02450446bb05a3c69a47fcac4 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:24.031320 12519 tablet_service.cc:1511] Processing CreateTablet for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:24.033308 12590 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:24.033589 12520 tablet_service.cc:1511] Processing CreateTablet for tablet 071cf28a10a94df4a341829812b1111d (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:24.035319 12667 tablet_service.cc:1511] Processing CreateTablet for tablet 2164f5547ff34a49b4a6c281ecd13a0e (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:24.013430 12597 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2f110ac2aa4305b535e10990fd067c (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:24.010984 12670 tablet_service.cc:1511] Processing CreateTablet for tablet 84e57a1d090b4284ace9e52e52a0f6c1 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:24.036769 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2164f5547ff34a49b4a6c281ecd13a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.037474 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e57a1d090b4284ace9e52e52a0f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.039047 12589 tablet_service.cc:1511] Processing CreateTablet for tablet 85135b3a7cec49bf847d956d42f8b452 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:24.021474 12595 tablet_service.cc:1511] Processing CreateTablet for tablet 071cf28a10a94df4a341829812b1111d (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:24.031606 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 45e3f2d02450446bb05a3c69a47fcac4 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:24.041206 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e3f2d02450446bb05a3c69a47fcac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.042306 12518 tablet_service.cc:1511] Processing CreateTablet for tablet 2164f5547ff34a49b4a6c281ecd13a0e (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:24.044389 12592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e3f2d02450446bb05a3c69a47fcac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.044667 12517 tablet_service.cc:1511] Processing CreateTablet for tablet 45e3f2d02450446bb05a3c69a47fcac4 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:24.047411 12516 tablet_service.cc:1511] Processing CreateTablet for tablet 5653fb04d7ae4650aa051e6c1be8fd8f (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:24.049021 12590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.050590 12515 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:24.053167 12514 tablet_service.cc:1511] Processing CreateTablet for tablet 85135b3a7cec49bf847d956d42f8b452 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:24.025566 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2f110ac2aa4305b535e10990fd067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.056813 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85135b3a7cec49bf847d956d42f8b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.060750 12516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5653fb04d7ae4650aa051e6c1be8fd8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.060889 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.062561 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071cf28a10a94df4a341829812b1111d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.068498 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2f110ac2aa4305b535e10990fd067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.061822 12515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.072654 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85135b3a7cec49bf847d956d42f8b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.074970 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 5653fb04d7ae4650aa051e6c1be8fd8f (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:24.075455 12663 tablet_service.cc:1511] Processing CreateTablet for tablet 85135b3a7cec49bf847d956d42f8b452 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:24.076391 12517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e3f2d02450446bb05a3c69a47fcac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.076552 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5653fb04d7ae4650aa051e6c1be8fd8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.077409 12663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85135b3a7cec49bf847d956d42f8b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.080389 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2164f5547ff34a49b4a6c281ecd13a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.080359 12664 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6 (DEFAULT_TABLE table=test-workload [id=2e9c10c06abb448595b2ef07143d9d54]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:24.081815 12664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e41f781bd4de3bb79fd8a7fba7eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.084868 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071cf28a10a94df4a341829812b1111d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.086197 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aa9a8dc6ae49ceb8ae283dd86a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.087553 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e57a1d090b4284ace9e52e52a0f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.230885 12722 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.248416 12723 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.254875 12721 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.262038 12721 tablet_bootstrap.cc:654] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.263489 12722 tablet_bootstrap.cc:654] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.268306 12721 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.268715 12723 tablet_bootstrap.cc:654] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.268836 12721 ts_tablet_manager.cc:1403] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:06:24.272228 12721 raft_consensus.cc:359] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.272914 12721 raft_consensus.cc:385] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.273207 12721 raft_consensus.cc:740] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.273999 12721 consensus_queue.cc:260] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.274577 12722 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.274928 12723 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.275164 12722 ts_tablet_manager.cc:1403] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.006s
I20260709 13:06:24.275418 12723 ts_tablet_manager.cc:1403] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.003s
I20260709 13:06:24.276721 12706 heartbeater.cc:499] Master 127.0.107.254:39631 was elected leader, sending a full tablet report...
I20260709 13:06:24.277206 12721 ts_tablet_manager.cc:1434] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:24.278232 12721 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.278745 12722 raft_consensus.cc:359] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.278996 12723 raft_consensus.cc:359] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.279609 12722 raft_consensus.cc:385] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.279847 12723 raft_consensus.cc:385] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.279987 12722 raft_consensus.cc:740] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.280368 12723 raft_consensus.cc:740] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.281096 12722 consensus_queue.cc:260] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.281213 12723 consensus_queue.cc:260] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.286223 12721 tablet_bootstrap.cc:654] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.291817 12632 heartbeater.cc:499] Master 127.0.107.254:39631 was elected leader, sending a full tablet report...
I20260709 13:06:24.292418 12722 ts_tablet_manager.cc:1434] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.009s
I20260709 13:06:24.293547 12722 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.300716 12722 tablet_bootstrap.cc:654] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.307269 12721 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.308169 12721 ts_tablet_manager.cc:1403] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:06:24.310933 12557 heartbeater.cc:499] Master 127.0.107.254:39631 was elected leader, sending a full tablet report...
I20260709 13:06:24.311425 12723 ts_tablet_manager.cc:1434] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.036s	user 0.027s	sys 0.008s
I20260709 13:06:24.312685 12723 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.313927 12722 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.314572 12722 ts_tablet_manager.cc:1403] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:06:24.317968 12722 raft_consensus.cc:359] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.318794 12722 raft_consensus.cc:385] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.319115 12722 raft_consensus.cc:740] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.319809 12723 tablet_bootstrap.cc:654] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.319900 12722 consensus_queue.cc:260] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.322460 12722 ts_tablet_manager.cc:1434] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:24.323570 12722 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.327601 12728 raft_consensus.cc:493] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.328265 12728 raft_consensus.cc:515] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.329648 12722 tablet_bootstrap.cc:654] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.341919 12722 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.342602 12722 ts_tablet_manager.cc:1403] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:06:24.343497 12721 raft_consensus.cc:359] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.344797 12721 raft_consensus.cc:385] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.345257 12721 raft_consensus.cc:740] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.347158 12728 leader_election.cc:290] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.346756 12722 raft_consensus.cc:359] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.347853 12722 raft_consensus.cc:385] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.348326 12722 raft_consensus.cc:740] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.349316 12722 consensus_queue.cc:260] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.351910 12722 ts_tablet_manager.cc:1434] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:24.353008 12722 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.359822 12722 tablet_bootstrap.cc:654] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.346572 12721 consensus_queue.cc:260] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.366837 12721 ts_tablet_manager.cc:1434] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.004s
I20260709 13:06:24.369366 12721 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.370071 12723 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.370730 12723 ts_tablet_manager.cc:1403] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.028s
I20260709 13:06:24.373950 12723 raft_consensus.cc:359] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.374830 12723 raft_consensus.cc:385] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.375190 12723 raft_consensus.cc:740] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.376161 12723 consensus_queue.cc:260] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.376672 12721 tablet_bootstrap.cc:654] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:24.378932 12707 tablet.cc:2406] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:24.380630 12723 ts_tablet_manager.cc:1434] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:24.381799 12723 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.390821 12723 tablet_bootstrap.cc:654] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.405038 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.405918 12532 raft_consensus.cc:2468] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:24.407450 12572 leader_election.cc:304] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:24.408547 12728 raft_consensus.cc:2804] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.409017 12728 raft_consensus.cc:493] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.409430 12728 raft_consensus.cc:3060] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.420457 12728 raft_consensus.cc:515] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.423942 12728 leader_election.cc:290] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.424350 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:24.425575 12532 raft_consensus.cc:3060] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.426479 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.427954 12721 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.428285 12723 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.428745 12721 ts_tablet_manager.cc:1403] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:06:24.428984 12723 ts_tablet_manager.cc:1403] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.004s
W20260709 13:06:24.429371 12571 leader_election.cc:343] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.428135 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
W20260709 13:06:24.431545 12571 leader_election.cc:343] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.432482 12721 raft_consensus.cc:359] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.432825 12723 raft_consensus.cc:359] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.433374 12721 raft_consensus.cc:385] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.433713 12723 raft_consensus.cc:385] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.433792 12721 raft_consensus.cc:740] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.434150 12723 raft_consensus.cc:740] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.434284 12722 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.434262 12532 raft_consensus.cc:2468] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:24.434959 12722 ts_tablet_manager.cc:1403] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.043s
I20260709 13:06:24.435900 12572 leader_election.cc:304] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 2f0f4839a29548a0b4179dc3adcff600
I20260709 13:06:24.435199 12723 consensus_queue.cc:260] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.435024 12721 consensus_queue.cc:260] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.438745 12721 ts_tablet_manager.cc:1434] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:06:24.439208 12723 ts_tablet_manager.cc:1434] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:24.439903 12721 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.440359 12723 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.443589 12722 raft_consensus.cc:359] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.444587 12722 raft_consensus.cc:385] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.444973 12722 raft_consensus.cc:740] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.445830 12722 consensus_queue.cc:260] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.446637 12723 tablet_bootstrap.cc:654] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.446916 12728 raft_consensus.cc:2804] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.447937 12721 tablet_bootstrap.cc:654] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.452903 12728 raft_consensus.cc:697] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:24.453886 12728 consensus_queue.cc:237] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.460263 12722 ts_tablet_manager.cc:1434] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:06:24.461611 12722 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.461784 12721 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.462442 12721 ts_tablet_manager.cc:1403] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:06:24.466001 12721 raft_consensus.cc:359] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.466975 12721 raft_consensus.cc:385] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.467367 12721 raft_consensus.cc:740] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.468549 12721 consensus_queue.cc:260] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.470098 12727 raft_consensus.cc:493] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.470602 12727 raft_consensus.cc:515] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.473145 12722 tablet_bootstrap.cc:654] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.479447 12727 leader_election.cc:290] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:24.484145 12426 catalog_manager.cc:5697] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:24.485857 12478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:24.472055 12723 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.471146 12721 ts_tablet_manager.cc:1434] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:24.490660 12721 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.489547 12723 ts_tablet_manager.cc:1403] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.008s
I20260709 13:06:24.495715 12723 raft_consensus.cc:359] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.498514 12721 tablet_bootstrap.cc:654] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.496855 12723 raft_consensus.cc:385] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.505825 12723 raft_consensus.cc:740] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.522655 12728 raft_consensus.cc:493] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.523310 12728 raft_consensus.cc:515] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.525595 12728 leader_election.cc:290] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.512212 12723 consensus_queue.cc:260] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.527262 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.527633 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.528378 12680 raft_consensus.cc:2468] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:24.528995 12723 ts_tablet_manager.cc:1434] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:06:24.530124 12723 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.530965 12571 leader_election.cc:304] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:24.531958 12728 raft_consensus.cc:2804] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.532372 12728 raft_consensus.cc:493] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.532692 12728 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:24.533282 12572 leader_election.cc:343] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.534257 12722 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.535506 12722 ts_tablet_manager.cc:1403] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.028s
I20260709 13:06:24.537110 12723 tablet_bootstrap.cc:654] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.539224 12739 raft_consensus.cc:493] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.539808 12739 raft_consensus.cc:515] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.541066 12721 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.541826 12721 ts_tablet_manager.cc:1403] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.011s
I20260709 13:06:24.542217 12739 leader_election.cc:290] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279), fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443)
I20260709 13:06:24.544271 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.545066 12680 raft_consensus.cc:2468] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:24.546672 12571 leader_election.cc:304] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:24.548271 12739 raft_consensus.cc:2804] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.548745 12739 raft_consensus.cc:493] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.548864 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.549247 12739 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:24.550328 12572 leader_election.cc:343] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.550066 12728 raft_consensus.cc:515] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.551867 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85135b3a7cec49bf847d956d42f8b452" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.552707 12532 raft_consensus.cc:2468] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:24.553241 12728 leader_election.cc:290] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.546247 12721 raft_consensus.cc:359] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.554178 12721 raft_consensus.cc:385] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.554603 12721 raft_consensus.cc:740] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.555770 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:24.555684 12721 consensus_queue.cc:260] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.556854 12680 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.558419 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
W20260709 13:06:24.560578 12572 leader_election.cc:343] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.569264 12721 ts_tablet_manager.cc:1434] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:06:24.570402 12646 leader_election.cc:304] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:24.575510 12721 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.577654 12680 raft_consensus.cc:2468] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:24.579372 12571 leader_election.cc:304] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: fc2992e6f7d5442495a80488190a805b
I20260709 13:06:24.580840 12728 raft_consensus.cc:2804] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.581404 12728 raft_consensus.cc:697] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:24.582340 12728 consensus_queue.cc:237] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.584358 12744 raft_consensus.cc:2804] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.585062 12744 raft_consensus.cc:493] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.585606 12744 raft_consensus.cc:3060] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.585904 12739 raft_consensus.cc:515] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.558452 12722 raft_consensus.cc:359] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.588331 12722 raft_consensus.cc:385] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.588903 12722 raft_consensus.cc:740] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.592332 12722 consensus_queue.cc:260] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.593046 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
W20260709 13:06:24.594764 12572 leader_election.cc:343] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.591221 12739 leader_election.cc:290] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279), fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443)
I20260709 13:06:24.595890 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:24.596787 12680 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.596915 12722 ts_tablet_manager.cc:1434] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.006s
I20260709 13:06:24.597167 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85135b3a7cec49bf847d956d42f8b452" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:24.599135 12722 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
W20260709 13:06:24.599376 12646 leader_election.cc:343] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.599732 12723 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.600296 12723 ts_tablet_manager.cc:1403] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.039s
I20260709 13:06:24.600509 12744 raft_consensus.cc:515] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.603456 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85135b3a7cec49bf847d956d42f8b452" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:24.604290 12532 raft_consensus.cc:3060] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.603557 12723 raft_consensus.cc:359] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.604808 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85135b3a7cec49bf847d956d42f8b452" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:24.606400 12723 raft_consensus.cc:385] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:24.606531 12646 leader_election.cc:343] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.606820 12723 raft_consensus.cc:740] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.607620 12729 raft_consensus.cc:493] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.608433 12722 tablet_bootstrap.cc:654] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.608189 12729 raft_consensus.cc:515] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.609349 12721 tablet_bootstrap.cc:654] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.612154 12723 consensus_queue.cc:260] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.620508 12427 catalog_manager.cc:5697] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.622424 12729 leader_election.cc:290] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.638773 12744 leader_election.cc:290] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:24.640244 12739 raft_consensus.cc:493] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.640910 12739 raft_consensus.cc:515] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.643064 12739 leader_election.cc:290] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.644759 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.646154 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.646881 12531 raft_consensus.cc:2468] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:24.648164 12572 leader_election.cc:304] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
W20260709 13:06:24.649636 12571 leader_election.cc:343] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.650676 12739 raft_consensus.cc:2804] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.651206 12739 raft_consensus.cc:493] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.651599 12739 raft_consensus.cc:3060] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.654551 12532 raft_consensus.cc:2468] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:24.655913 12646 leader_election.cc:304] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:24.657500 12744 raft_consensus.cc:2804] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.658218 12680 raft_consensus.cc:2468] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:24.659065 12744 raft_consensus.cc:697] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:24.659864 12571 leader_election.cc:304] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: fc2992e6f7d5442495a80488190a805b
I20260709 13:06:24.660998 12728 raft_consensus.cc:2804] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.660426 12744 consensus_queue.cc:237] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.661572 12728 raft_consensus.cc:697] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:24.662824 12722 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.662573 12728 consensus_queue.cc:237] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.664537 12722 ts_tablet_manager.cc:1403] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.015s
I20260709 13:06:24.665686 12739 raft_consensus.cc:515] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.671460 12739 leader_election.cc:290] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.673159 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:24.673676 12723 ts_tablet_manager.cc:1434] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.073s	user 0.015s	sys 0.019s
I20260709 13:06:24.673950 12532 raft_consensus.cc:3060] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.675642 12723 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.682816 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:24.683343 12723 tablet_bootstrap.cc:654] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:24.685994 12571 leader_election.cc:343] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.695897 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46aa9a8dc6ae49ceb8ae283dd86a1c85" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:24.694294 12722 raft_consensus.cc:359] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
W20260709 13:06:24.700609 12497 leader_election.cc:343] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.702404 12532 raft_consensus.cc:2468] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:24.703030 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46aa9a8dc6ae49ceb8ae283dd86a1c85" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.703788 12680 raft_consensus.cc:2468] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:24.705415 12496 leader_election.cc:304] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:24.700594 12722 raft_consensus.cc:385] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.706293 12722 raft_consensus.cc:740] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.705593 12427 catalog_manager.cc:5697] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.706817 12756 raft_consensus.cc:2804] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.707273 12756 raft_consensus.cc:493] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.707835 12756 raft_consensus.cc:3060] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.707175 12722 consensus_queue.cc:260] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.710152 12722 ts_tablet_manager.cc:1434] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.005s
I20260709 13:06:24.711349 12722 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.712960 12572 leader_election.cc:304] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 2f0f4839a29548a0b4179dc3adcff600
I20260709 13:06:24.713406 12721 tablet_bootstrap.cc:492] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.714118 12721 ts_tablet_manager.cc:1403] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.047s
I20260709 13:06:24.714511 12728 raft_consensus.cc:2804] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.715519 12728 raft_consensus.cc:697] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:24.716639 12728 consensus_queue.cc:237] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.717516 12721 raft_consensus.cc:359] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.718314 12721 raft_consensus.cc:385] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.718621 12721 raft_consensus.cc:740] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.718727 12722 tablet_bootstrap.cc:654] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.721407 12723 tablet_bootstrap.cc:492] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.722138 12723 ts_tablet_manager.cc:1403] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 13:06:24.725379 12723 raft_consensus.cc:359] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.726104 12723 raft_consensus.cc:385] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.726554 12723 raft_consensus.cc:740] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.727432 12723 consensus_queue.cc:260] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:24.729746 12723 ts_tablet_manager.cc:1434] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:24.730980 12723 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.733204 12721 consensus_queue.cc:260] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.726052 12756 raft_consensus.cc:515] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.737974 12723 tablet_bootstrap.cc:654] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.743363 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46aa9a8dc6ae49ceb8ae283dd86a1c85" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
W20260709 13:06:24.745396 12497 leader_election.cc:343] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.742625 12427 catalog_manager.cc:5697] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.751420 12721 ts_tablet_manager.cc:1434] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:06:24.764065 12756 leader_election.cc:290] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.768579 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46aa9a8dc6ae49ceb8ae283dd86a1c85" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:24.772643 12680 raft_consensus.cc:3060] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.786409 12426 catalog_manager.cc:5697] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.787705 12744 raft_consensus.cc:493] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.788286 12722 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.788926 12722 ts_tablet_manager.cc:1403] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.037s
I20260709 13:06:24.788519 12744 raft_consensus.cc:515] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.792313 12722 raft_consensus.cc:359] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.793043 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:24.793099 12722 raft_consensus.cc:385] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.794544 12722 raft_consensus.cc:740] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.794720 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:24.795437 12722 consensus_queue.cc:260] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
W20260709 13:06:24.796197 12646 leader_election.cc:343] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.797336 12756 raft_consensus.cc:493] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.797487 12607 raft_consensus.cc:2468] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:24.798352 12722 ts_tablet_manager.cc:1434] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:06:24.797967 12756 raft_consensus.cc:515] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.799516 12722 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.800539 12756 leader_election.cc:290] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.802166 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:24.802996 12681 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:24.806023 12722 tablet_bootstrap.cc:654] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.809444 12496 leader_election.cc:304] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:24.810808 12756 raft_consensus.cc:2804] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.811391 12756 raft_consensus.cc:493] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.811825 12756 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.812078 12722 tablet_bootstrap.cc:492] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.812721 12722 ts_tablet_manager.cc:1403] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:06:24.814796 12722 raft_consensus.cc:359] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.815325 12722 raft_consensus.cc:385] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.815562 12722 raft_consensus.cc:740] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.802934 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:24.816195 12722 consensus_queue.cc:260] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.816733 12606 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:24.818037 12744 leader_election.cc:290] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:24.818580 12722 ts_tablet_manager.cc:1434] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:24.819602 12722 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:24.820557 12646 leader_election.cc:304] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: fc2992e6f7d5442495a80488190a805b
I20260709 13:06:24.771029 12721 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.825593 12722 tablet_bootstrap.cc:654] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.832335 12744 raft_consensus.cc:2804] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:24.833258 12744 raft_consensus.cc:493] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.833647 12744 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.835361 12723 tablet_bootstrap.cc:492] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.836915 12721 tablet_bootstrap.cc:654] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.837800 12723 ts_tablet_manager.cc:1403] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.107s	user 0.043s	sys 0.057s
I20260709 13:06:24.836771 12680 raft_consensus.cc:2468] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:24.841475 12496 leader_election.cc:304] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:24.842736 12729 raft_consensus.cc:2804] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.844239 12723 raft_consensus.cc:359] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.845491 12723 raft_consensus.cc:385] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.845949 12723 raft_consensus.cc:740] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.847095 12723 consensus_queue.cc:260] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.848675 12756 raft_consensus.cc:515] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.852522 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:24.853292 12607 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.858992 12729 raft_consensus.cc:697] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:24.860097 12729 consensus_queue.cc:237] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.862190 12607 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:24.863623 12497 leader_election.cc:304] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:24.864976 12768 raft_consensus.cc:2804] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.865589 12768 raft_consensus.cc:697] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:24.866683 12768 consensus_queue.cc:237] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.877903 12744 raft_consensus.cc:515] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.880795 12756 leader_election.cc:290] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:24.881599 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:24.881049 12427 catalog_manager.cc:5697] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.882941 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:24.883283 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:24.883611 12607 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:24.884662 12646 leader_election.cc:343] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:24.883909 12680 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:24.888083 12744 leader_election.cc:290] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:24.891983 12607 raft_consensus.cc:2468] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:24.892522 12680 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:24.893478 12646 leader_election.cc:304] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: fc2992e6f7d5442495a80488190a805b
I20260709 13:06:24.894685 12744 raft_consensus.cc:2804] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:24.895942 12744 raft_consensus.cc:697] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:24.896822 12744 consensus_queue.cc:237] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.898903 12721 tablet_bootstrap.cc:492] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:24.899505 12721 ts_tablet_manager.cc:1403] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.007s
I20260709 13:06:24.901551 12722 tablet_bootstrap.cc:492] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:24.902091 12722 ts_tablet_manager.cc:1403] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.083s	user 0.040s	sys 0.032s
I20260709 13:06:24.902941 12721 raft_consensus.cc:359] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.905149 12723 ts_tablet_manager.cc:1434] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.067s	user 0.019s	sys 0.022s
I20260709 13:06:24.904870 12722 raft_consensus.cc:359] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.905625 12722 raft_consensus.cc:385] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.905917 12722 raft_consensus.cc:740] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.906494 12723 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.904016 12721 raft_consensus.cc:385] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.906741 12722 consensus_queue.cc:260] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.907420 12721 raft_consensus.cc:740] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.908870 12721 consensus_queue.cc:260] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.912940 12721 ts_tablet_manager.cc:1434] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:06:24.914584 12723 tablet_bootstrap.cc:654] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.918013 12722 ts_tablet_manager.cc:1434] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:06:24.917805 12426 catalog_manager.cc:5697] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.923614 12427 catalog_manager.cc:5697] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.924952 12721 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.932341 12721 tablet_bootstrap.cc:654] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.936259 12728 consensus_queue.cc:1048] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:24.952298 12723 tablet_bootstrap.cc:492] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.952873 12723 ts_tablet_manager.cc:1403] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.014s
I20260709 13:06:24.952965 12721 tablet_bootstrap.cc:492] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
W20260709 13:06:24.953384 12571 consensus_peers.cc:597] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d -> Peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Couldn't send request to peer 2f0f4839a29548a0b4179dc3adcff600. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.953540 12721 ts_tablet_manager.cc:1403] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:06:24.955442 12723 raft_consensus.cc:359] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.956197 12723 raft_consensus.cc:385] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.955938 12721 raft_consensus.cc:359] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.956563 12723 raft_consensus.cc:740] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.956773 12721 raft_consensus.cc:385] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.957206 12721 raft_consensus.cc:740] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.957419 12723 consensus_queue.cc:260] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.957986 12721 consensus_queue.cc:260] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.959437 12723 ts_tablet_manager.cc:1434] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:24.960286 12723 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:24.961365 12721 ts_tablet_manager.cc:1434] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:24.962361 12721 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:24.965994 12723 tablet_bootstrap.cc:654] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.968305 12721 tablet_bootstrap.cc:654] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:24.986801 12723 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:24.987861 12723 ts_tablet_manager.cc:1403] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:06:24.993326 12723 raft_consensus.cc:359] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.994256 12723 raft_consensus.cc:385] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:24.994594 12723 raft_consensus.cc:740] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:24.995464 12723 consensus_queue.cc:260] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:24.997152 12728 consensus_queue.cc:1048] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:24.997920 12723 ts_tablet_manager.cc:1434] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:25.005780 12721 tablet_bootstrap.cc:492] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:25.006330 12721 ts_tablet_manager.cc:1403] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 13:06:25.009377 12721 raft_consensus.cc:359] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.010087 12721 raft_consensus.cc:385] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:25.010383 12721 raft_consensus.cc:740] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:25.011103 12721 consensus_queue.cc:260] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.012663 12768 raft_consensus.cc:493] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.013283 12721 ts_tablet_manager.cc:1434] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:25.013566 12532 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.013151 12768 raft_consensus.cc:515] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.015815 12768 leader_election.cc:290] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:25.017021 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:25.017808 12681 raft_consensus.cc:2468] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:25.018906 12496 leader_election.cc:304] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:25.019824 12768 raft_consensus.cc:2804] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:25.020272 12768 raft_consensus.cc:493] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.020607 12768 raft_consensus.cc:3060] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.022661 12740 consensus_queue.cc:1048] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.022704 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:25.023998 12607 raft_consensus.cc:2468] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:25.029201 12768 raft_consensus.cc:515] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.031500 12768 leader_election.cc:290] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:25.032228 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:25.032903 12607 raft_consensus.cc:3060] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.033252 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:25.034204 12680 raft_consensus.cc:3060] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.047873 12744 consensus_queue.cc:1048] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.050334 12607 raft_consensus.cc:2468] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:25.052341 12497 leader_election.cc:304] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:25.053247 12768 raft_consensus.cc:2804] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:25.053743 12768 raft_consensus.cc:697] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:25.054208 12680 raft_consensus.cc:2468] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:25.054611 12768 consensus_queue.cc:237] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.067278 12607 raft_consensus.cc:3060] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.068133 12429 catalog_manager.cc:5697] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.074067 12740 consensus_queue.cc:1048] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.078751 12786 consensus_queue.cc:1048] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.080446 12727 raft_consensus.cc:493] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.081053 12727 raft_consensus.cc:515] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.083256 12727 leader_election.cc:290] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:25.083940 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:25.084893 12532 raft_consensus.cc:2393] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f0f4839a29548a0b4179dc3adcff600 in current term 1: Already voted for candidate e35bdc3e9b3b4602955809715f74827d in this term.
I20260709 13:06:25.086596 12532 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.086674 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:25.089160 12768 raft_consensus.cc:493] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.089720 12768 raft_consensus.cc:515] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.091779 12646 leader_election.cc:304] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:25.093972 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:25.094383 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:25.095001 12606 raft_consensus.cc:2393] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc2992e6f7d5442495a80488190a805b in current term 1: Already voted for candidate 2f0f4839a29548a0b4179dc3adcff600 in this term.
I20260709 13:06:25.091995 12768 leader_election.cc:290] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:25.097222 12744 raft_consensus.cc:3060] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.097868 12728 consensus_queue.cc:1048] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.097165 12497 leader_election.cc:304] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc2992e6f7d5442495a80488190a805b; no voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:25.100513 12768 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.104367 12728 consensus_queue.cc:1048] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.106017 12744 raft_consensus.cc:2749] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.110416 12768 raft_consensus.cc:2749] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.123214 12739 consensus_queue.cc:1048] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.207508 12607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
mode: GRACEFUL
new_leader_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:59038
I20260709 13:06:25.208220 12607 raft_consensus.cc:606] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Received request to transfer leadership to TS fc2992e6f7d5442495a80488190a805b
I20260709 13:06:25.238608 12681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f"
dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
mode: GRACEFUL
new_leader_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:53140
I20260709 13:06:25.239198 12681 raft_consensus.cc:606] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Received request to transfer leadership to TS e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:25.295007 12786 raft_consensus.cc:493] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.295775 12786 raft_consensus.cc:515] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.296969 12607 raft_consensus.cc:3060] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.297897 12786 leader_election.cc:290] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:25.298910 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:25.298774 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2164f5547ff34a49b4a6c281ecd13a0e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:25.300669 12646 leader_election.cc:304] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:25.301353 12786 raft_consensus.cc:2749] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:25.306077 12768 consensus_queue.cc:1048] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.318307 12768 consensus_queue.cc:1048] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.373353 12681 raft_consensus.cc:3060] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:25.459273 12768 consensus_queue.cc:1048] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.469888 12729 consensus_queue.cc:1048] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.501089 12729 consensus_queue.cc:1048] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.508944 12769 consensus_queue.cc:1048] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.511147 12786 consensus_queue.cc:1048] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:25.514575 12786 consensus_queue.cc:1048] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:25.538539 12744 raft_consensus.cc:993] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: : Instructing follower e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:25.539043 12727 raft_consensus.cc:1081] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Signalling peer e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:25.541229 12605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:06:25.542717 12605 raft_consensus.cc:493] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.543185 12605 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.550685 12605 raft_consensus.cc:515] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.556602 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:25.556740 12605 leader_election.cc:290] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:25.557286 12531 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.557880 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5653fb04d7ae4650aa051e6c1be8fd8f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:25.558348 12681 raft_consensus.cc:3055] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.558553 12681 raft_consensus.cc:740] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:25.559247 12681 consensus_queue.cc:260] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.560022 12681 raft_consensus.cc:3060] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.564451 12531 raft_consensus.cc:2468] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:25.565610 12572 leader_election.cc:304] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:25.565992 12681 raft_consensus.cc:2468] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:25.566323 12728 raft_consensus.cc:2804] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.566876 12728 raft_consensus.cc:697] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:25.567624 12728 consensus_queue.cc:237] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:25.574621 12426 catalog_manager.cc:5697] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 1 to 2, leader changed from 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195) to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.698513 12739 raft_consensus.cc:993] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: : Instructing follower fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:25.699039 12728 raft_consensus.cc:1081] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Signalling peer fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:25.701179 12531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:51588
I20260709 13:06:25.701879 12531 raft_consensus.cc:493] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.702257 12531 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.707950 12531 raft_consensus.cc:515] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:25.710007 12531 leader_election.cc:290] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:25.711144 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:25.711200 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2f110ac2aa4305b535e10990fd067c" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:25.711867 12681 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.711977 12605 raft_consensus.cc:3055] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.712440 12605 raft_consensus.cc:740] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:25.713099 12605 consensus_queue.cc:260] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:25.714059 12605 raft_consensus.cc:3060] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.717418 12681 raft_consensus.cc:2468] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:25.718679 12496 leader_election.cc:304] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:25.719470 12769 raft_consensus.cc:2804] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.720077 12769 raft_consensus.cc:697] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:25.720518 12605 raft_consensus.cc:2468] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:25.721097 12769 consensus_queue.cc:237] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } }
I20260709 13:06:25.727877 12426 catalog_manager.cc:5697] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 1 to 2, leader changed from e35bdc3e9b3b4602955809715f74827d (127.0.107.194) to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.994899 12531 raft_consensus.cc:1275] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.996510 12728 consensus_queue.cc:1048] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.005537 12681 raft_consensus.cc:1275] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.007182 12728 consensus_queue.cc:1048] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.171273 12681 raft_consensus.cc:1275] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.172807 12769 consensus_queue.cc:1048] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.182170 12605 raft_consensus.cc:1275] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.183773 12768 consensus_queue.cc:1048] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.280753 12426 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54534:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:28.283598 12426 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:28.349135 12521 tablet_service.cc:1511] Processing CreateTablet for tablet df92d5dc192340a1b701503547be467d (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:28.349846 12594 tablet_service.cc:1511] Processing CreateTablet for tablet df92d5dc192340a1b701503547be467d (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:28.351763 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df92d5dc192340a1b701503547be467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.354316 12516 tablet_service.cc:1511] Processing CreateTablet for tablet 17533f47560743ff9edcbba53ab90408 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:28.351477 12670 tablet_service.cc:1511] Processing CreateTablet for tablet df92d5dc192340a1b701503547be467d (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:28.356125 12516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17533f47560743ff9edcbba53ab90408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.355958 12589 tablet_service.cc:1511] Processing CreateTablet for tablet 17533f47560743ff9edcbba53ab90408 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:28.357302 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df92d5dc192340a1b701503547be467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.360351 12522 tablet_service.cc:1511] Processing CreateTablet for tablet b49d19b2b8a34cc09219e671ea04846f (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:28.361928 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d19b2b8a34cc09219e671ea04846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.351811 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df92d5dc192340a1b701503547be467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.365864 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17533f47560743ff9edcbba53ab90408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.366791 12591 tablet_service.cc:1511] Processing CreateTablet for tablet b49d19b2b8a34cc09219e671ea04846f (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:28.367404 12515 tablet_service.cc:1511] Processing CreateTablet for tablet bee2e25673e44226ac4b0a041d9885e1 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:28.368373 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d19b2b8a34cc09219e671ea04846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.368453 12596 tablet_service.cc:1511] Processing CreateTablet for tablet bee2e25673e44226ac4b0a041d9885e1 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:28.369297 12515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee2e25673e44226ac4b0a041d9885e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.370234 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee2e25673e44226ac4b0a041d9885e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.370440 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 17533f47560743ff9edcbba53ab90408 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:28.372094 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17533f47560743ff9edcbba53ab90408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.372206 12666 tablet_service.cc:1511] Processing CreateTablet for tablet b49d19b2b8a34cc09219e671ea04846f (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:28.374653 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49d19b2b8a34cc09219e671ea04846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.392273 12667 tablet_service.cc:1511] Processing CreateTablet for tablet bee2e25673e44226ac4b0a041d9885e1 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:28.393783 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee2e25673e44226ac4b0a041d9885e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.404547 12514 tablet_service.cc:1511] Processing CreateTablet for tablet 29397746c2d049e58042b46188921c03 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:28.406424 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29397746c2d049e58042b46188921c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.430964 12592 tablet_service.cc:1511] Processing CreateTablet for tablet 29397746c2d049e58042b46188921c03 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:28.432855 12592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29397746c2d049e58042b46188921c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.436076 12826 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:28.454478 12669 tablet_service.cc:1511] Processing CreateTablet for tablet 29397746c2d049e58042b46188921c03 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:28.455989 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29397746c2d049e58042b46188921c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.456614 12595 tablet_service.cc:1511] Processing CreateTablet for tablet a765e69f266148bfac6ac53d836eaa1e (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:28.460716 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a765e69f266148bfac6ac53d836eaa1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.461774 12514 tablet_service.cc:1511] Processing CreateTablet for tablet a765e69f266148bfac6ac53d836eaa1e (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:28.461849 12668 tablet_service.cc:1511] Processing CreateTablet for tablet a765e69f266148bfac6ac53d836eaa1e (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:28.465866 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a765e69f266148bfac6ac53d836eaa1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.465921 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a765e69f266148bfac6ac53d836eaa1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.466364 12522 tablet_service.cc:1511] Processing CreateTablet for tablet f6946f184e484e8ab9b462e8061eb0e9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:28.467738 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6946f184e484e8ab9b462e8061eb0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.472265 12597 tablet_service.cc:1511] Processing CreateTablet for tablet f6946f184e484e8ab9b462e8061eb0e9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:28.473698 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6946f184e484e8ab9b462e8061eb0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.480831 12826 tablet_bootstrap.cc:654] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.487211 12664 tablet_service.cc:1511] Processing CreateTablet for tablet f6946f184e484e8ab9b462e8061eb0e9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:28.488691 12664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6946f184e484e8ab9b462e8061eb0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.488528 12516 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1c9711c3a844a39c9d47767a0914d9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:28.490134 12516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1c9711c3a844a39c9d47767a0914d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.497861 12590 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1c9711c3a844a39c9d47767a0914d9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:28.499321 12590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1c9711c3a844a39c9d47767a0914d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.507985 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1c9711c3a844a39c9d47767a0914d9 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 13:06:28.511963 12572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41443, user_credentials={real_user=slave}} blocked reactor thread for 54472.5us
I20260709 13:06:28.512425 12828 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:28.515372 12591 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb509987c1847edb0809ad1cd615cb4 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:28.516695 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb509987c1847edb0809ad1cd615cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.520077 12828 tablet_bootstrap.cc:654] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.523456 12521 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb509987c1847edb0809ad1cd615cb4 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:28.524808 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb509987c1847edb0809ad1cd615cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.520669 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1c9711c3a844a39c9d47767a0914d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:28.534933 12478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:28.536463 12829 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:28.561487 12829 tablet_bootstrap.cc:654] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.578245 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb509987c1847edb0809ad1cd615cb4 (DEFAULT_TABLE table=soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:28.582021 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb509987c1847edb0809ad1cd615cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.595305 12826 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:28.596318 12826 ts_tablet_manager.cc:1403] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.014s
I20260709 13:06:28.600844 12826 raft_consensus.cc:359] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.601990 12826 raft_consensus.cc:385] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.602387 12826 raft_consensus.cc:740] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.602964 12828 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:28.603578 12828 ts_tablet_manager.cc:1403] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.092s	user 0.026s	sys 0.015s
I20260709 13:06:28.603395 12826 consensus_queue.cc:260] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.607151 12828 raft_consensus.cc:359] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.608119 12828 raft_consensus.cc:385] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.608494 12828 raft_consensus.cc:740] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.609527 12828 consensus_queue.cc:260] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.610097 12829 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:28.611018 12829 ts_tablet_manager.cc:1403] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 13:06:28.611938 12826 ts_tablet_manager.cc:1434] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:06:28.613216 12826 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:28.614423 12829 raft_consensus.cc:359] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.615401 12829 raft_consensus.cc:385] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.615752 12829 raft_consensus.cc:740] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.616758 12829 consensus_queue.cc:260] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.619761 12829 ts_tablet_manager.cc:1434] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:06:28.620002 12828 ts_tablet_manager.cc:1434] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:06:28.621038 12829 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:28.621335 12826 tablet_bootstrap.cc:654] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.625064 12828 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:28.629676 12829 tablet_bootstrap.cc:654] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.634960 12828 tablet_bootstrap.cc:654] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.637995 12829 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:28.638012 12826 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:28.638836 12829 ts_tablet_manager.cc:1403] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:06:28.638844 12826 ts_tablet_manager.cc:1403] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:06:28.640648 12828 tablet_bootstrap.cc:492] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:28.641191 12828 ts_tablet_manager.cc:1403] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:06:28.642067 12829 raft_consensus.cc:359] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.642751 12829 raft_consensus.cc:385] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.642819 12739 raft_consensus.cc:493] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.643216 12829 raft_consensus.cc:740] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.642803 12826 raft_consensus.cc:359] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.644078 12826 raft_consensus.cc:385] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.643821 12739 raft_consensus.cc:515] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.644454 12826 raft_consensus.cc:740] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.644428 12829 consensus_queue.cc:260] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.645833 12826 consensus_queue.cc:260] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.646404 12739 leader_election.cc:290] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:28.647614 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:28.648470 12531 raft_consensus.cc:2468] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:28.648921 12826 ts_tablet_manager.cc:1434] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:06:28.645536 12828 raft_consensus.cc:359] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.650068 12572 leader_election.cc:304] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:28.650584 12828 raft_consensus.cc:385] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.651005 12828 raft_consensus.cc:740] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.651098 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:28.651162 12739 raft_consensus.cc:2804] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:28.651854 12739 raft_consensus.cc:493] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.652486 12739 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:28.653028 12571 leader_election.cc:343] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:28.655561 12829 ts_tablet_manager.cc:1434] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:06:28.651876 12828 consensus_queue.cc:260] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.656896 12829 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:28.658883 12828 ts_tablet_manager.cc:1434] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:06:28.660060 12828 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:28.650059 12826 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:28.661715 12739 raft_consensus.cc:515] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.664322 12827 raft_consensus.cc:493] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.664956 12827 raft_consensus.cc:515] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.667412 12828 tablet_bootstrap.cc:654] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.667773 12826 tablet_bootstrap.cc:654] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.668958 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:28.669714 12681 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:28.672364 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:28.673363 12531 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:28.675438 12571 leader_election.cc:304] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:28.675978 12829 tablet_bootstrap.cc:654] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.678714 12827 leader_election.cc:290] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:28.679697 12827 raft_consensus.cc:2804] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:28.680640 12827 raft_consensus.cc:493] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.681216 12827 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.691234 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:28.692368 12531 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.701061 12739 leader_election.cc:290] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:28.704674 12830 raft_consensus.cc:493] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.710642 12830 raft_consensus.cc:515] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.714159 12830 leader_election.cc:290] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:28.716107 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:28.718245 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:28.718969 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
W20260709 13:06:28.720827 12646 leader_election.cc:343] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:28.722892 12646 leader_election.cc:343] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:28.723537 12646 leader_election.cc:304] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
W20260709 13:06:28.723973 12571 leader_election.cc:343] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:28.725018 12830 raft_consensus.cc:2749] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:28.729492 12531 raft_consensus.cc:2468] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:28.735755 12829 tablet_bootstrap.cc:492] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:28.736755 12829 ts_tablet_manager.cc:1403] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.024s
I20260709 13:06:28.736860 12572 leader_election.cc:304] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 2f0f4839a29548a0b4179dc3adcff600
I20260709 13:06:28.737908 12826 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:28.738335 12839 raft_consensus.cc:2804] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:28.738528 12826 ts_tablet_manager.cc:1403] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.031s
I20260709 13:06:28.738940 12839 raft_consensus.cc:697] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:28.739945 12839 consensus_queue.cc:237] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.741369 12829 raft_consensus.cc:359] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.742044 12826 raft_consensus.cc:359] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.742534 12829 raft_consensus.cc:385] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.742878 12826 raft_consensus.cc:385] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.743108 12829 raft_consensus.cc:740] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.744755 12829 consensus_queue.cc:260] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.746210 12827 raft_consensus.cc:515] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.749249 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:28.749871 12531 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.752692 12829 ts_tablet_manager.cc:1434] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:06:28.753960 12829 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:28.743506 12826 raft_consensus.cc:740] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.757860 12826 consensus_queue.cc:260] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.760473 12826 ts_tablet_manager.cc:1434] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 13:06:28.762115 12828 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:28.762701 12828 ts_tablet_manager.cc:1403] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.103s	user 0.036s	sys 0.050s
I20260709 13:06:28.762745 12826 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:28.764302 12429 catalog_manager.cc:5697] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.766319 12828 raft_consensus.cc:359] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.767206 12828 raft_consensus.cc:385] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.767531 12828 raft_consensus.cc:740] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.773805 12828 consensus_queue.cc:260] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.775851 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:28.776242 12828 ts_tablet_manager.cc:1434] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:06:28.776578 12681 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.776911 12531 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:28.777415 12828 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:28.778750 12572 leader_election.cc:304] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:28.780431 12839 raft_consensus.cc:2804] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:28.781123 12839 raft_consensus.cc:697] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:28.782028 12839 consensus_queue.cc:237] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.786339 12829 tablet_bootstrap.cc:654] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.787653 12826 tablet_bootstrap.cc:654] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.788223 12827 leader_election.cc:290] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:28.792308 12828 tablet_bootstrap.cc:654] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.794533 12681 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:28.805546 12826 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:28.806473 12826 ts_tablet_manager.cc:1403] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.015s
I20260709 13:06:28.812438 12829 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:28.812376 12826 raft_consensus.cc:359] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.813282 12829 ts_tablet_manager.cc:1403] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.011s
I20260709 13:06:28.813325 12826 raft_consensus.cc:385] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.813855 12826 raft_consensus.cc:740] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.815745 12826 consensus_queue.cc:260] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.818149 12829 raft_consensus.cc:359] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.819062 12829 raft_consensus.cc:385] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.819291 12826 ts_tablet_manager.cc:1434] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:06:28.819393 12829 raft_consensus.cc:740] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.820957 12826 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:28.820739 12829 consensus_queue.cc:260] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.824208 12829 ts_tablet_manager.cc:1434] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:06:28.825562 12829 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:28.830744 12828 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:28.831444 12828 ts_tablet_manager.cc:1403] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.007s
I20260709 13:06:28.832708 12826 tablet_bootstrap.cc:654] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:28.836483 12830 raft_consensus.cc:493] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.837179 12830 raft_consensus.cc:515] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.840005 12830 leader_election.cc:290] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:28.842532 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:28.843928 12828 raft_consensus.cc:359] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.844816 12828 raft_consensus.cc:385] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:28.845131 12828 raft_consensus.cc:740] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:28.845919 12828 consensus_queue.cc:260] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:28.847632 12828 ts_tablet_manager.cc:1434] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.005s
I20260709 13:06:28.842532 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:28.849061 12531 raft_consensus.cc:2393] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f0f4839a29548a0b4179dc3adcff600 in current term 1: Already voted for candidate e35bdc3e9b3b4602955809715f74827d in this term.
I20260709 13:06:28.850358 12646 leader_election.cc:304] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:28.851341 12830 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:28.857048 12828 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:28.991679 12829 tablet_bootstrap.cc:654] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.235754 12830 raft_consensus.cc:2749] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:29.595234 12826 tablet_bootstrap.cc:492] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:29.596235 12826 ts_tablet_manager.cc:1403] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.775s	user 0.017s	sys 0.006s
I20260709 13:06:29.600570 12826 raft_consensus.cc:359] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.601668 12826 raft_consensus.cc:385] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.602095 12826 raft_consensus.cc:740] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.603188 12826 consensus_queue.cc:260] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.609762 12826 ts_tablet_manager.cc:1434] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:06:29.611617 12826 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:29.614822 12828 tablet_bootstrap.cc:654] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.617441 12826 tablet_bootstrap.cc:654] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.619851 12829 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:29.620554 12829 ts_tablet_manager.cc:1403] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.795s	user 0.013s	sys 0.014s
I20260709 13:06:29.625121 12829 raft_consensus.cc:359] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.626271 12829 raft_consensus.cc:385] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.626832 12829 raft_consensus.cc:740] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.627709 12829 consensus_queue.cc:260] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.629648 12826 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:29.630331 12826 ts_tablet_manager.cc:1403] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:06:29.630620 12829 ts_tablet_manager.cc:1434] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:06:29.631798 12829 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:29.636294 12826 raft_consensus.cc:359] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.637156 12826 raft_consensus.cc:385] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.637528 12826 raft_consensus.cc:740] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.638324 12826 consensus_queue.cc:260] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.639124 12829 tablet_bootstrap.cc:654] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.641256 12826 ts_tablet_manager.cc:1434] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:29.642398 12828 tablet_bootstrap.cc:492] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:29.644505 12828 ts_tablet_manager.cc:1403] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.795s	user 0.021s	sys 0.016s
I20260709 13:06:29.643908 12826 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:29.648972 12828 raft_consensus.cc:359] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.649904 12828 raft_consensus.cc:385] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.650250 12828 raft_consensus.cc:740] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.651183 12829 tablet_bootstrap.cc:492] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:29.651916 12829 ts_tablet_manager.cc:1403] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:06:29.651355 12828 consensus_queue.cc:260] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.655516 12829 raft_consensus.cc:359] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.656450 12829 raft_consensus.cc:385] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.656795 12829 raft_consensus.cc:740] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.657866 12826 tablet_bootstrap.cc:654] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.657641 12829 consensus_queue.cc:260] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.661154 12829 ts_tablet_manager.cc:1434] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:06:29.663516 12829 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:29.676203 12828 ts_tablet_manager.cc:1434] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.013s
I20260709 13:06:29.677592 12828 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:29.677824 12826 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:29.683385 12826 ts_tablet_manager.cc:1403] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.000s
I20260709 13:06:29.684325 12829 tablet_bootstrap.cc:654] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.688134 12830 raft_consensus.cc:493] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.687453 12826 raft_consensus.cc:359] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.690800 12826 raft_consensus.cc:385] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.691121 12826 raft_consensus.cc:740] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.693503 12830 raft_consensus.cc:515] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.698642 12830 leader_election.cc:290] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:29.691928 12826 consensus_queue.cc:260] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.702482 12829 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:29.706333 12826 ts_tablet_manager.cc:1434] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:06:29.712639 12829 ts_tablet_manager.cc:1403] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.004s
I20260709 13:06:29.713339 12826 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:29.716358 12829 raft_consensus.cc:359] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.717304 12829 raft_consensus.cc:385] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.717723 12829 raft_consensus.cc:740] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.718665 12829 consensus_queue.cc:260] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.721447 12829 ts_tablet_manager.cc:1434] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:06:29.722144 12826 tablet_bootstrap.cc:654] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.711889 12828 tablet_bootstrap.cc:654] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.722662 12829 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:29.729477 12828 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:29.730113 12828 ts_tablet_manager.cc:1403] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.005s
I20260709 13:06:29.731087 12829 tablet_bootstrap.cc:654] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.733804 12828 raft_consensus.cc:359] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.734990 12828 raft_consensus.cc:385] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.735515 12828 raft_consensus.cc:740] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.737161 12852 raft_consensus.cc:493] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.738119 12852 raft_consensus.cc:515] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.741253 12852 leader_election.cc:290] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.736776 12828 consensus_queue.cc:260] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.744551 12829 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:29.745234 12829 ts_tablet_manager.cc:1403] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:06:29.746057 12828 ts_tablet_manager.cc:1434] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:06:29.749238 12829 raft_consensus.cc:359] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.750177 12829 raft_consensus.cc:385] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.750527 12829 raft_consensus.cc:740] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.751353 12829 consensus_queue.cc:260] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.752202 12826 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:29.752753 12826 ts_tablet_manager.cc:1403] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.018s
I20260709 13:06:29.753713 12829 ts_tablet_manager.cc:1434] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:29.754873 12829 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: Bootstrap starting.
I20260709 13:06:29.755780 12826 raft_consensus.cc:359] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.756579 12826 raft_consensus.cc:385] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.756852 12826 raft_consensus.cc:740] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.757606 12826 consensus_queue.cc:260] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.748536 12828 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:29.762686 12829 tablet_bootstrap.cc:654] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.764261 12826 ts_tablet_manager.cc:1434] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:29.765537 12826 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Bootstrap starting.
I20260709 13:06:29.766763 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.767535 12681 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:29.776671 12828 tablet_bootstrap.cc:654] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.776598 12571 leader_election.cc:304] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:29.778959 12826 tablet_bootstrap.cc:654] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.779978 12860 raft_consensus.cc:2804] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.780509 12860 raft_consensus.cc:493] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.780853 12860 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.812407 12854 raft_consensus.cc:493] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e35bdc3e9b3b4602955809715f74827d)
I20260709 13:06:29.812978 12852 raft_consensus.cc:493] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.813115 12854 raft_consensus.cc:515] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.813632 12852 raft_consensus.cc:515] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.814165 12829 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: No bootstrap required, opened a new log
I20260709 13:06:29.814841 12829 ts_tablet_manager.cc:1403] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.007s
I20260709 13:06:29.815802 12854 leader_election.cc:290] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.815745 12852 leader_election.cc:290] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.816861 12852 raft_consensus.cc:493] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc2992e6f7d5442495a80488190a805b)
I20260709 13:06:29.817368 12852 raft_consensus.cc:515] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.818212 12829 raft_consensus.cc:359] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.818962 12829 raft_consensus.cc:385] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.819235 12829 raft_consensus.cc:740] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.819597 12852 leader_election.cc:290] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.820113 12829 consensus_queue.cc:260] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.830338 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.832347 12863 consensus_queue.cc:1048] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:29.834473 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.809230 12830 raft_consensus.cc:493] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e35bdc3e9b3b4602955809715f74827d)
I20260709 13:06:29.840685 12865 consensus_queue.cc:1048] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:29.840719 12830 raft_consensus.cc:515] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.833662 12860 raft_consensus.cc:515] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.843860 12830 leader_election.cc:290] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:29.836943 12852 raft_consensus.cc:493] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.848555 12860 leader_election.cc:290] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.848799 12852 raft_consensus.cc:515] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.851413 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29397746c2d049e58042b46188921c03" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.851789 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:29.852289 12678 raft_consensus.cc:2468] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:29.852744 12681 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.851496 12852 leader_election.cc:290] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.859717 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.860541 12678 raft_consensus.cc:2468] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:29.866282 12828 tablet_bootstrap.cc:492] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:29.861692 12681 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:29.864459 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.875037 12828 ts_tablet_manager.cc:1403] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.019s
I20260709 13:06:29.870015 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29397746c2d049e58042b46188921c03" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.872715 12866 consensus_queue.cc:1048] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:29.876375 12528 raft_consensus.cc:2468] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:29.875449 12531 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 0.
I20260709 13:06:29.878866 12828 raft_consensus.cc:359] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.879922 12828 raft_consensus.cc:385] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:29.880247 12828 raft_consensus.cc:740] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:29.880749 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:29.881984 12854 raft_consensus.cc:493] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.881805 12828 consensus_queue.cc:260] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
W20260709 13:06:29.882637 12478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:29.882526 12854 raft_consensus.cc:515] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.883574 12427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54510 (request call id 47) took 1037 ms. Trace:
I20260709 13:06:29.884053 12427 rpcz_store.cc:276] 0709 13:06:28.845942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.846106 (+   164us) service_pool.cc:224] Handling call
0709 13:06:29.883415 (+1037309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2357,"reported_tablets":1}
I20260709 13:06:29.884984 12828 ts_tablet_manager.cc:1434] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:29.870689 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e57a1d090b4284ace9e52e52a0f6c1" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.886483 12828 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:29.892587 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:29.893313 12530 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.896131 12854 leader_election.cc:290] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.896356 12828 tablet_bootstrap.cc:654] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:29.895639 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:29.897096 12681 raft_consensus.cc:2468] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:29.898933 12496 leader_election.cc:304] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:29.900182 12854 raft_consensus.cc:2804] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.900655 12854 raft_consensus.cc:493] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.901060 12854 raft_consensus.cc:3060] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.901430 12826 tablet_bootstrap.cc:492] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: No bootstrap required, opened a new log
I20260709 13:06:29.902094 12826 ts_tablet_manager.cc:1403] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.006s
I20260709 13:06:29.916992 12854 raft_consensus.cc:515] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.918356 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.919306 12532 raft_consensus.cc:2393] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e35bdc3e9b3b4602955809715f74827d in current term 1: Already voted for candidate fc2992e6f7d5442495a80488190a805b in this term.
I20260709 13:06:29.921519 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:29.921314 12426 catalog_manager.cc:5697] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.922355 12681 raft_consensus.cc:3060] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.922559 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:29.924378 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:29.925185 12607 raft_consensus.cc:2393] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f0f4839a29548a0b4179dc3adcff600 in current term 1: Already voted for candidate e35bdc3e9b3b4602955809715f74827d in this term.
I20260709 13:06:29.928473 12830 raft_consensus.cc:493] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.929263 12830 raft_consensus.cc:515] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.932072 12830 leader_election.cc:290] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:29.933274 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb509987c1847edb0809ad1cd615cb4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
W20260709 13:06:29.934983 12646 leader_election.cc:343] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:29.938916 12681 raft_consensus.cc:2468] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:29.861999 12571 leader_election.cc:304] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:29.940724 12496 leader_election.cc:304] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:29.944022 12871 raft_consensus.cc:2804] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:29.961671 12871 raft_consensus.cc:697] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:29.944854 12854 leader_election.cc:290] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:29.962591 12871 consensus_queue.cc:237] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.963392 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.953527 12572 leader_election.cc:304] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d; no voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:29.954100 12867 raft_consensus.cc:2804] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.966352 12866 raft_consensus.cc:2749] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.966696 12867 raft_consensus.cc:493] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.967168 12867 raft_consensus.cc:3060] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.967515 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e3f2d02450446bb05a3c69a47fcac4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
W20260709 13:06:29.950498 12497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34799, user_credentials={real_user=slave}} blocked reactor thread for 57487us
I20260709 13:06:29.969806 12497 leader_election.cc:304] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc2992e6f7d5442495a80488190a805b; no voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:29.971807 12854 raft_consensus.cc:2749] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.972146 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb509987c1847edb0809ad1cd615cb4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:29.974208 12532 raft_consensus.cc:2468] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:29.976511 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:29.977324 12606 raft_consensus.cc:3060] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.874181 12860 consensus_queue.cc:1048] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260709 13:06:29.939005 12826 raft_consensus.cc:359] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.979682 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17533f47560743ff9edcbba53ab90408" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:29.980157 12646 leader_election.cc:304] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:29.986128 12646 leader_election.cc:304] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600; no voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b
I20260709 13:06:29.986864 12830 raft_consensus.cc:2749] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:29.987913 12830 raft_consensus.cc:2749] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.989084 12646 leader_election.cc:304] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:29.989904 12830 raft_consensus.cc:2804] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:29.990247 12830 raft_consensus.cc:493] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.990541 12830 raft_consensus.cc:3060] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:29.990993 12606 raft_consensus.cc:2468] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
W20260709 13:06:29.954154 12571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44279, user_credentials={real_user=slave}} blocked reactor thread for 92249.8us
I20260709 13:06:29.993216 12571 leader_election.cc:304] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: fc2992e6f7d5442495a80488190a805b
I20260709 13:06:29.994056 12866 raft_consensus.cc:2764] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:06:29.994390 12571 leader_election.cc:304] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:29.995306 12866 raft_consensus.cc:2804] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:29.995885 12866 raft_consensus.cc:697] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:29.996733 12866 consensus_queue.cc:237] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:29.983153 12826 raft_consensus.cc:385] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.001530 12826 raft_consensus.cc:740] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.006685 12826 consensus_queue.cc:260] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.011556 12826 ts_tablet_manager.cc:1434] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 13:06:30.005404 12870 raft_consensus.cc:493] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.014504 12870 raft_consensus.cc:515] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.019245 12829 ts_tablet_manager.cc:1434] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: Time spent starting tablet: real 0.204s	user 0.036s	sys 0.095s
I20260709 13:06:30.021443 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:30.021590 12830 raft_consensus.cc:515] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.022593 12606 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:30.019105 12870 leader_election.cc:290] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:30.021725 12828 tablet_bootstrap.cc:492] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:30.025223 12828 ts_tablet_manager.cc:1403] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.047s
I20260709 13:06:30.024343 12646 leader_election.cc:304] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:30.026590 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:30.027334 12531 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:30.028537 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb509987c1847edb0809ad1cd615cb4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.031901 12870 raft_consensus.cc:2804] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.032451 12828 raft_consensus.cc:359] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.033390 12828 raft_consensus.cc:385] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.033739 12828 raft_consensus.cc:740] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.034837 12828 consensus_queue.cc:260] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.035439 12870 raft_consensus.cc:493] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.036000 12606 raft_consensus.cc:3060] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.036201 12870 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.038939 12530 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:30.040895 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb509987c1847edb0809ad1cd615cb4" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.043880 12531 raft_consensus.cc:3060] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.028708 12867 raft_consensus.cc:515] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.058274 12606 raft_consensus.cc:2468] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.059558 12867 leader_election.cc:290] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.061057 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29397746c2d049e58042b46188921c03" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.062340 12828 ts_tablet_manager.cc:1434] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:06:30.095672 12528 raft_consensus.cc:3060] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.096454 12828 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: Bootstrap starting.
I20260709 13:06:30.099784 12871 raft_consensus.cc:493] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.100485 12871 raft_consensus.cc:515] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.063910 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29397746c2d049e58042b46188921c03" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.104368 12680 raft_consensus.cc:3060] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.104573 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:30.105453 12528 raft_consensus.cc:2468] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:30.067673 12868 raft_consensus.cc:493] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.072068 12870 raft_consensus.cc:515] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.106925 12572 leader_election.cc:304] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.024438 12830 leader_election.cc:290] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:30.108726 12870 leader_election.cc:290] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:30.110221 12867 raft_consensus.cc:2804] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.110988 12867 raft_consensus.cc:697] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.073669 12646 leader_election.cc:304] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:30.106832 12868 raft_consensus.cc:515] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.111961 12867 consensus_queue.cc:237] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.113485 12870 raft_consensus.cc:2804] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:30.107924 12497 leader_election.cc:343] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:30.114112 12870 raft_consensus.cc:697] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:30.115680 12828 tablet_bootstrap.cc:654] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:30.086758 12531 raft_consensus.cc:2468] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.115048 12868 leader_election.cc:290] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:30.119547 12870 consensus_queue.cc:237] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.131054 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b" is_pre_election: true
I20260709 13:06:30.132117 12525 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:30.134229 12646 leader_election.cc:304] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.135578 12868 raft_consensus.cc:2804] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.136163 12868 raft_consensus.cc:493] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.136631 12868 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.140236 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.140353 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d" is_pre_election: true
I20260709 13:06:30.141917 12606 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.141969 12607 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 0.
I20260709 13:06:30.144740 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.150484 12528 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.156713 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600" is_pre_election: true
I20260709 13:06:30.124152 12680 raft_consensus.cc:2468] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 1.
I20260709 13:06:30.157737 12679 raft_consensus.cc:2468] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 0.
I20260709 13:06:30.160859 12496 leader_election.cc:304] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:30.162356 12873 raft_consensus.cc:2804] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:30.162856 12873 raft_consensus.cc:493] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.163296 12873 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.154970 12871 leader_election.cc:290] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.173272 12528 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.175189 12646 leader_election.cc:304] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.176939 12830 raft_consensus.cc:2804] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.222991 12606 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.234321 12873 raft_consensus.cc:515] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.236409 12828 tablet_bootstrap.cc:492] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: No bootstrap required, opened a new log
I20260709 13:06:30.236918 12828 ts_tablet_manager.cc:1403] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.019s
I20260709 13:06:30.236047 12830 raft_consensus.cc:697] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:30.239203 12830 consensus_queue.cc:237] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.240461 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.237619 12868 raft_consensus.cc:515] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.243346 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.243758 12868 leader_election.cc:290] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:30.244334 12681 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.245270 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.245884 12607 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.248553 12828 raft_consensus.cc:359] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.249876 12828 raft_consensus.cc:385] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:30.250131 12828 raft_consensus.cc:740] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Initialized, Role: FOLLOWER
I20260709 13:06:30.251042 12828 consensus_queue.cc:260] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.252497 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.252775 12606 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.256173 12532 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:30.256212 12873 leader_election.cc:290] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.256916 12681 raft_consensus.cc:2468] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:30.258225 12496 leader_election.cc:304] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.259140 12873 raft_consensus.cc:2804] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.259904 12873 raft_consensus.cc:697] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:30.261183 12873 consensus_queue.cc:237] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.263649 12606 raft_consensus.cc:2468] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 1.
I20260709 13:06:30.253394 12828 ts_tablet_manager.cc:1434] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:06:30.255513 12607 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.265506 12646 leader_election.cc:304] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:30.266670 12892 raft_consensus.cc:2804] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:30.267284 12892 raft_consensus.cc:697] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:30.268452 12892 consensus_queue.cc:237] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.268309 12532 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 1.
I20260709 13:06:30.281512 12426 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54498 (request call id 43) took 1461 ms. Trace:
I20260709 13:06:30.281996 12426 rpcz_store.cc:276] 0709 13:06:28.820187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.821026 (+   839us) service_pool.cc:224] Handling call
0709 13:06:30.281398 (+1460372us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.075072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.076274 (+  1202us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.076324 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:30.076354 (+    30us) tablet.cc:662] Decoding operations
0709 13:06:30.076833 (+   479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.076988 (+   155us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.077034 (+    46us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:30.077338 (+   304us) tablet.cc:701] Row locks acquired
0709 13:06:30.077377 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:06:30.077570 (+   193us) write_op.cc:270] Start()
0709 13:06:30.077721 (+   151us) write_op.cc:276] Timestamp: P: 1783602390077509 usec, L: 0
0709 13:06:30.077752 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.078786 (+  1034us) log.cc:844] Serialized 540 byte log entry
0709 13:06:30.242860 (+164074us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.268711 (+ 25851us) write_op.cc:301] APPLY: starting
0709 13:06:30.268815 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.268926 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.269060 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.269223 (+   163us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.269345 (+   122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:30.269378 (+    33us) write_op.cc:312] APPLY: finished
0709 13:06:30.269516 (+   138us) log.cc:844] Serialized 22 byte log entry
0709 13:06:30.269722 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.269821 (+    99us) write_op.cc:454] Released schema lock
0709 13:06:30.269865 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.272143 (+  2278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.272176 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88127,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":25595,"apply.run_cpu_time_us":1572,"apply.run_wall_time_us":3383,"num_ops":1,"prepare.queue_time_us":138811,"prepare.run_cpu_time_us":12021,"prepare.run_wall_time_us":110709,"raft.queue_time_us":20819,"raft.run_cpu_time_us":3518,"raft.run_wall_time_us":28014,"replication_time_us":164933,"thread_start_us":287712,"threads_started":4,"wal-append.queue_time_us":132465}]]}
I20260709 13:06:30.288666 12429 catalog_manager.cc:5697] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.290037 12429 catalog_manager.cc:5697] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.291620 12429 catalog_manager.cc:5697] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.304632 12426 catalog_manager.cc:5697] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.306380 12426 catalog_manager.cc:5697] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.325834 12427 catalog_manager.cc:5697] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.328056 12427 catalog_manager.cc:5697] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 0 to 1, leader changed from <none> to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.389125 12607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df92d5dc192340a1b701503547be467d"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
mode: GRACEFUL
new_leader_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:59038
I20260709 13:06:30.389672 12607 raft_consensus.cc:606] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Received request to transfer leadership to TS fc2992e6f7d5442495a80488190a805b
I20260709 13:06:30.397815 12607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
mode: GRACEFUL
new_leader_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:59038
I20260709 13:06:30.398370 12607 raft_consensus.cc:606] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Received request to transfer leadership to TS fc2992e6f7d5442495a80488190a805b
I20260709 13:06:30.403939 12607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
mode: GRACEFUL
new_leader_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:59038
I20260709 13:06:30.404517 12607 raft_consensus.cc:606] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Received request to transfer leadership to TS fc2992e6f7d5442495a80488190a805b
I20260709 13:06:30.405356 12866 consensus_queue.cc:1048] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.413841 12860 raft_consensus.cc:993] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: : Instructing follower fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.414430 12867 raft_consensus.cc:1081] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Signalling peer fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.414225 12681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e"
dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
mode: GRACEFUL
new_leader_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:53140
I20260709 13:06:30.415081 12681 raft_consensus.cc:606] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Received request to transfer leadership to TS e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:30.417744 12528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df92d5dc192340a1b701503547be467d"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:51588
I20260709 13:06:30.418804 12528 raft_consensus.cc:493] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.419230 12528 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.421633 12866 consensus_queue.cc:1048] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.424278 12681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9"
dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
mode: GRACEFUL
new_leader_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:53140
I20260709 13:06:30.424847 12681 raft_consensus.cc:606] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Received request to transfer leadership to TS e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:30.429864 12528 raft_consensus.cc:515] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.433506 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.434303 12607 raft_consensus.cc:3055] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.434756 12607 raft_consensus.cc:740] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.435840 12607 consensus_queue.cc:260] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.436758 12528 leader_election.cc:290] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.437781 12607 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.443976 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df92d5dc192340a1b701503547be467d" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.444689 12681 raft_consensus.cc:3060] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.458077 12607 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.460219 12681 raft_consensus.cc:2468] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.462080 12496 leader_election.cc:304] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.463054 12873 raft_consensus.cc:2804] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.463578 12873 raft_consensus.cc:697] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:30.464630 12873 consensus_queue.cc:237] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.474709 12427 catalog_manager.cc:5697] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 1 to 2, leader changed from e35bdc3e9b3b4602955809715f74827d (127.0.107.194) to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.484499 12532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
mode: GRACEFUL
new_leader_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:60488
I20260709 13:06:30.485160 12532 raft_consensus.cc:606] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Received request to transfer leadership to TS e35bdc3e9b3b4602955809715f74827d
I20260709 13:06:30.569525 12873 consensus_queue.cc:1048] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.574229 12866 consensus_queue.cc:1048] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.582098 12875 consensus_queue.cc:1048] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.589685 12866 raft_consensus.cc:993] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: : Instructing follower fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.590178 12866 raft_consensus.cc:1081] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Signalling peer fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.593375 12532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:51588
I20260709 13:06:30.593964 12532 raft_consensus.cc:493] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.594336 12532 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.601833 12532 raft_consensus.cc:515] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.604826 12532 leader_election.cc:290] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.605054 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.605405 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49d19b2b8a34cc09219e671ea04846f" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.605758 12676 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.606932 12607 raft_consensus.cc:3055] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.607558 12860 consensus_queue.cc:1048] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.611147 12607 raft_consensus.cc:740] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.615602 12607 consensus_queue.cc:260] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.616933 12607 raft_consensus.cc:3060] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.616762 12676 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.618723 12496 leader_election.cc:304] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.619679 12875 raft_consensus.cc:2804] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.620394 12875 raft_consensus.cc:697] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:30.622185 12875 consensus_queue.cc:237] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.625751 12607 raft_consensus.cc:2468] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.629987 12426 catalog_manager.cc:5697] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 1 to 2, leader changed from e35bdc3e9b3b4602955809715f74827d (127.0.107.194) to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.640125 12892 consensus_queue.cc:1048] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.646759 12868 raft_consensus.cc:993] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: : Instructing follower e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.647320 12868 raft_consensus.cc:1081] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Signalling peer e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.649641 12606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:06:30.650126 12606 raft_consensus.cc:493] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.650442 12606 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.651525 12892 consensus_queue.cc:1048] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.658356 12606 raft_consensus.cc:515] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.659802 12607 raft_consensus.cc:1240] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Rejecting Update request from peer 2f0f4839a29548a0b4179dc3adcff600 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:30.661662 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.662042 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a765e69f266148bfac6ac53d836eaa1e" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.662635 12681 raft_consensus.cc:3055] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.662966 12681 raft_consensus.cc:740] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:30.661762 12606 leader_election.cc:290] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.663391 12868 consensus_queue.cc:1059] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.662334 12532 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.665747 12681 consensus_queue.cc:260] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.666826 12681 raft_consensus.cc:3060] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.669905 12532 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.671118 12572 leader_election.cc:304] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.671931 12860 raft_consensus.cc:2804] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.671972 12681 raft_consensus.cc:2468] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.672487 12860 raft_consensus.cc:697] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
W20260709 13:06:30.672677 12868 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:30.673416 12860 consensus_queue.cc:237] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.681497 12427 catalog_manager.cc:5697] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 1 to 2, leader changed from 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195) to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.694816 12875 consensus_queue.cc:1048] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.705345 12875 consensus_queue.cc:1048] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.716799 12863 raft_consensus.cc:993] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: : Instructing follower fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.717334 12863 raft_consensus.cc:1081] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Signalling peer fc2992e6f7d5442495a80488190a805b to start an election
I20260709 13:06:30.719194 12532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
 from {username='slave'} at 127.0.0.1:51588
I20260709 13:06:30.719798 12532 raft_consensus.cc:493] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.720194 12532 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.720774 12871 raft_consensus.cc:993] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: : Instructing follower e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.721361 12875 raft_consensus.cc:1081] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Signalling peer e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.723038 12606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:59026
I20260709 13:06:30.723575 12606 raft_consensus.cc:493] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.723928 12606 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.726022 12868 consensus_queue.cc:1048] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.728525 12532 raft_consensus.cc:515] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.731292 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:30.731228 12606 raft_consensus.cc:515] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.732180 12604 raft_consensus.cc:3055] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.732506 12604 raft_consensus.cc:740] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.732836 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee2e25673e44226ac4b0a041d9885e1" candidate_uuid: "fc2992e6f7d5442495a80488190a805b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.733394 12681 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.733716 12606 leader_election.cc:290] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.735042 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.732471 12532 leader_election.cc:290] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Requested vote from peers e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.735641 12676 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.735983 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c1c9711c3a844a39c9d47767a0914d9" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.736599 12528 raft_consensus.cc:3055] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.736913 12528 raft_consensus.cc:740] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:30.733400 12604 consensus_queue.cc:260] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.737696 12528 consensus_queue.cc:260] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.738436 12604 raft_consensus.cc:3060] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.738998 12528 raft_consensus.cc:3060] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.746062 12681 raft_consensus.cc:2468] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.753592 12528 raft_consensus.cc:2468] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.752851 12676 raft_consensus.cc:2468] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.756081 12830 consensus_queue.cc:1048] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.759259 12496 leader_election.cc:304] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.759471 12572 leader_election.cc:304] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.760178 12604 raft_consensus.cc:2468] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc2992e6f7d5442495a80488190a805b in term 2.
I20260709 13:06:30.760901 12863 raft_consensus.cc:2804] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.760224 12875 raft_consensus.cc:2804] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.761643 12875 raft_consensus.cc:697] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Becoming Leader. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:30.762573 12875 consensus_queue.cc:237] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.766348 12863 raft_consensus.cc:697] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.767238 12863 consensus_queue.cc:237] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.775247 12426 catalog_manager.cc:5697] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 1 to 2, leader changed from fc2992e6f7d5442495a80488190a805b (127.0.107.193) to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.775530 12427 catalog_manager.cc:5697] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b reported cstate change: term changed from 1 to 2, leader changed from e35bdc3e9b3b4602955809715f74827d (127.0.107.194) to fc2992e6f7d5442495a80488190a805b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fc2992e6f7d5442495a80488190a805b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.777817 12830 consensus_queue.cc:1048] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:30.792500 12869 consensus_queue.cc:1048] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:30.801196 12869 raft_consensus.cc:993] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: : Instructing follower e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.801681 12869 raft_consensus.cc:1081] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Signalling peer e35bdc3e9b3b4602955809715f74827d to start an election
I20260709 13:06:30.803311 12604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
 from {username='slave'} at 127.0.0.1:59016
I20260709 13:06:30.803845 12604 raft_consensus.cc:493] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.804287 12604 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.810797 12604 raft_consensus.cc:515] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.814055 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
I20260709 13:06:30.814702 12676 raft_consensus.cc:3055] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.815055 12676 raft_consensus.cc:740] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:30.815588 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6946f184e484e8ab9b462e8061eb0e9" candidate_uuid: "e35bdc3e9b3b4602955809715f74827d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:30.816272 12528 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.815876 12676 consensus_queue.cc:260] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:30.817101 12676 raft_consensus.cc:3060] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.817592 12604 leader_election.cc:290] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195:44279)
I20260709 13:06:30.824051 12528 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.824450 12676 raft_consensus.cc:2468] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e35bdc3e9b3b4602955809715f74827d in term 2.
I20260709 13:06:30.825446 12572 leader_election.cc:304] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e35bdc3e9b3b4602955809715f74827d, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:30.826314 12860 raft_consensus.cc:2804] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.826890 12860 raft_consensus.cc:697] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Becoming Leader. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:30.827723 12860 consensus_queue.cc:237] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
W20260709 13:06:30.832409 12702 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5fa0 after lost signal to thread 434
W20260709 13:06:30.833599 12702 debug-util.cc:398] Leaking SignalData structure 0x7b08000283c0 after lost signal to thread 12464
I20260709 13:06:30.834571 12427 catalog_manager.cc:5697] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d reported cstate change: term changed from 1 to 2, leader changed from 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195) to e35bdc3e9b3b4602955809715f74827d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e35bdc3e9b3b4602955809715f74827d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:30.835605 12702 debug-util.cc:398] Leaking SignalData structure 0x7b0800177400 after lost signal to thread 12631
W20260709 13:06:30.836771 12702 debug-util.cc:398] Leaking SignalData structure 0x7b0800268de0 after lost signal to thread 12705
I20260709 13:06:31.006762 12681 raft_consensus.cc:1275] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.008539 12875 consensus_queue.cc:1048] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.015283 12604 raft_consensus.cc:1275] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.017513 12607 raft_consensus.cc:1275] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.024199 12904 consensus_queue.cc:1048] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.024566 12873 consensus_queue.cc:1048] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.041767 12676 raft_consensus.cc:1275] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.049912 12875 consensus_queue.cc:1048] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.089257 12676 raft_consensus.cc:1275] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.090554 12866 consensus_queue.cc:1048] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.100850 12528 raft_consensus.cc:1275] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.103032 12860 consensus_queue.cc:1048] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:31.161018 12604 raft_consensus.cc:1275] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.162542 12875 consensus_queue.cc:1048] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.172057 12676 raft_consensus.cc:1275] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer fc2992e6f7d5442495a80488190a805b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.174144 12875 consensus_queue.cc:1048] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.247985 12676 raft_consensus.cc:1275] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.249739 12860 consensus_queue.cc:1048] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.259086 12528 raft_consensus.cc:1275] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.261121 12860 consensus_queue.cc:1048] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.327100 12528 raft_consensus.cc:1275] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.328554 12863 consensus_queue.cc:1048] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:31.339038 12676 raft_consensus.cc:1275] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Refusing update from remote peer e35bdc3e9b3b4602955809715f74827d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:31.342048 12863 consensus_queue.cc:1048] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.491947 12427 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54534:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:06:33.515178 12427 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54534:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:06:33.610445   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:33.740147 12938 log.cc:927] Time spent T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:33.865037 12962 tablet.cc:1724] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:33.902922 12970 tablet.cc:1724] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:33.918780 12973 tablet.cc:1724] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:33.981539 12971 tablet.cc:1724] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:34.016548 12966 log.cc:927] Time spent T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:06:33.915786 12972 tablet.cc:1724] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.014503 12977 tablet.cc:1724] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.085506 12984 tablet.cc:1724] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.066368 12978 tablet.cc:1724] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.089263 12528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071cf28a10a94df4a341829812b1111d"
dest_uuid: "fc2992e6f7d5442495a80488190a805b"
mode: GRACEFUL
new_leader_uuid: "2f0f4839a29548a0b4179dc3adcff600"
 from {username='slave'} at 127.0.0.1:60500
I20260709 13:06:34.089988 12528 raft_consensus.cc:606] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Received request to transfer leadership to TS 2f0f4839a29548a0b4179dc3adcff600
W20260709 13:06:34.098531 12974 log.cc:927] Time spent T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:34.103363 12427 catalog_manager.cc:5789] TS e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799) does not have the latest schema for tablet f6946f184e484e8ab9b462e8061eb0e9 (table soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]). Expected version 1 got 0
I20260709 13:06:34.104784 12427 catalog_manager.cc:5789] TS e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799) does not have the latest schema for tablet 7c1c9711c3a844a39c9d47767a0914d9 (table soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]). Expected version 1 got 0
I20260709 13:06:34.107224 12427 catalog_manager.cc:5789] TS e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799) does not have the latest schema for tablet a765e69f266148bfac6ac53d836eaa1e (table soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb]). Expected version 1 got 0
I20260709 13:06:34.114398 12973 tablet.cc:1724] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.116788 12985 tablet.cc:1724] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.033545 12975 tablet.cc:1724] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.105567 12962 tablet.cc:1724] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.122201 12981 tablet.cc:1724] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:34.131348 12980 log.cc:927] Time spent T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:34.137053 12986 tablet.cc:1724] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.172992 12981 tablet.cc:1724] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.176743 12978 tablet.cc:1724] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.185204 12977 tablet.cc:1724] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.189122 12981 tablet.cc:1724] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.187772 12962 tablet.cc:1724] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.194378 12978 tablet.cc:1724] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.196089 12970 tablet.cc:1724] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.197011 12985 tablet.cc:1724] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.201370 12975 tablet.cc:1724] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.190801 12971 tablet.cc:1724] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.205978 12984 tablet.cc:1724] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.224512 12972 tablet.cc:1724] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.238821 12919 raft_consensus.cc:993] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: : Instructing follower 2f0f4839a29548a0b4179dc3adcff600 to start an election
I20260709 13:06:34.239559 12917 raft_consensus.cc:1081] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Signalling peer 2f0f4839a29548a0b4179dc3adcff600 to start an election
I20260709 13:06:34.241799 12676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "071cf28a10a94df4a341829812b1111d"
dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
 from {username='slave'} at 127.0.0.1:53132
I20260709 13:06:34.242417 12676 raft_consensus.cc:493] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.242820 12676 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.251129 12676 raft_consensus.cc:515] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.251708 12972 tablet.cc:1724] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:34.255026 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:34.265653 12532 raft_consensus.cc:3055] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.266083 12532 raft_consensus.cc:740] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc2992e6f7d5442495a80488190a805b, State: Running, Role: LEADER
I20260709 13:06:34.266929 12532 consensus_queue.cc:260] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.268970 12606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6"
dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
mode: GRACEFUL
new_leader_uuid: "2f0f4839a29548a0b4179dc3adcff600"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:06:34.269642 12606 raft_consensus.cc:606] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Received request to transfer leadership to TS 2f0f4839a29548a0b4179dc3adcff600
I20260709 13:06:34.272163   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:34.272222 12532 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.272940   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.286074 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071cf28a10a94df4a341829812b1111d" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:34.286828 12606 raft_consensus.cc:3060] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.294730 12532 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 2.
I20260709 13:06:34.296066 12646 leader_election.cc:304] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, fc2992e6f7d5442495a80488190a805b; no voters: 
I20260709 13:06:34.297607 12869 raft_consensus.cc:2804] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.298194 12869 raft_consensus.cc:697] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:34.299166 12869 consensus_queue.cc:237] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.283254 12676 leader_election.cc:290] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:34.306174 12606 raft_consensus.cc:2468] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 2.
I20260709 13:06:34.319242 12427 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: soft_deleted_table [id=8acc60e003e04a3dad6f73a0db9efbfb] alter complete (version 1)
I20260709 13:06:34.331946 12429 catalog_manager.cc:5697] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 1 to 2, leader changed from fc2992e6f7d5442495a80488190a805b (127.0.107.193) to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.351854 12943 raft_consensus.cc:993] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: : Instructing follower 2f0f4839a29548a0b4179dc3adcff600 to start an election
I20260709 13:06:34.352485 12916 raft_consensus.cc:1081] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Signalling peer 2f0f4839a29548a0b4179dc3adcff600 to start an election
I20260709 13:06:34.354286 12676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6"
dest_uuid: "2f0f4839a29548a0b4179dc3adcff600"
 from {username='slave'} at 127.0.0.1:53120
I20260709 13:06:34.354965 12676 raft_consensus.cc:493] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.355384 12676 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.365159 12676 raft_consensus.cc:515] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.367661 12676 leader_election.cc:290] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 election: Requested vote from peers fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443), e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799)
I20260709 13:06:34.369028 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc2992e6f7d5442495a80488190a805b"
I20260709 13:06:34.369410 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e41f781bd4de3bb79fd8a7fba7eb6" candidate_uuid: "2f0f4839a29548a0b4179dc3adcff600" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e35bdc3e9b3b4602955809715f74827d"
I20260709 13:06:34.370227 12606 raft_consensus.cc:3055] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.370668 12606 raft_consensus.cc:740] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e35bdc3e9b3b4602955809715f74827d, State: Running, Role: LEADER
I20260709 13:06:34.369820 12532 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.371614 12606 consensus_queue.cc:260] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.372822 12606 raft_consensus.cc:3060] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.379695 12606 raft_consensus.cc:2468] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 2.
I20260709 13:06:34.379698 12532 raft_consensus.cc:2468] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f0f4839a29548a0b4179dc3adcff600 in term 2.
I20260709 13:06:34.380836 12646 leader_election.cc:304] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f0f4839a29548a0b4179dc3adcff600, e35bdc3e9b3b4602955809715f74827d; no voters: 
I20260709 13:06:34.381618 12869 raft_consensus.cc:2804] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.382184 12869 raft_consensus.cc:697] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 LEADER]: Becoming Leader. State: Replica: 2f0f4839a29548a0b4179dc3adcff600, State: Running, Role: LEADER
I20260709 13:06:34.383224 12869 consensus_queue.cc:237] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } }
I20260709 13:06:34.393780 12426 catalog_manager.cc:5697] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 reported cstate change: term changed from 1 to 2, leader changed from e35bdc3e9b3b4602955809715f74827d (127.0.107.194) to 2f0f4839a29548a0b4179dc3adcff600 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2f0f4839a29548a0b4179dc3adcff600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f0f4839a29548a0b4179dc3adcff600" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44279 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.750162 12606 raft_consensus.cc:1275] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer 2f0f4839a29548a0b4179dc3adcff600: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.752051 12869 consensus_queue.cc:1048] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.781044 12532 raft_consensus.cc:1275] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer 2f0f4839a29548a0b4179dc3adcff600: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.783519 12869 consensus_queue.cc:1048] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.830808 12532 raft_consensus.cc:1275] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Refusing update from remote peer 2f0f4839a29548a0b4179dc3adcff600: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.832363 12995 consensus_queue.cc:1048] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2992e6f7d5442495a80488190a805b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.838271 12604 raft_consensus.cc:1275] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Refusing update from remote peer 2f0f4839a29548a0b4179dc3adcff600: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.840849 12995 consensus_queue.cc:1048] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e35bdc3e9b3b4602955809715f74827d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:35.348184   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:06:35.378774 12646 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260709 13:06:35.406220 12572 consensus_peers.cc:597] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:35.407828 12646 consensus_peers.cc:597] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.412950   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:35.414106   431 tablet_replica.cc:333] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.415216   431 raft_consensus.cc:2243] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.416455   431 raft_consensus.cc:2272] T df92d5dc192340a1b701503547be467d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.418889   431 tablet_replica.cc:333] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.419557   431 raft_consensus.cc:2243] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.420114   431 raft_consensus.cc:2272] T 29397746c2d049e58042b46188921c03 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.422151   431 tablet_replica.cc:333] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.422796   431 raft_consensus.cc:2243] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.423664   431 raft_consensus.cc:2272] T 17533f47560743ff9edcbba53ab90408 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.426366   431 tablet_replica.cc:333] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.427012   431 raft_consensus.cc:2243] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.427531   431 raft_consensus.cc:2272] T 45e3f2d02450446bb05a3c69a47fcac4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.430208   431 tablet_replica.cc:333] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.430788   431 raft_consensus.cc:2243] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.431258   431 raft_consensus.cc:2272] T 5653fb04d7ae4650aa051e6c1be8fd8f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.433848   431 tablet_replica.cc:333] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.434387   431 raft_consensus.cc:2243] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.435504   431 raft_consensus.cc:2272] T b49d19b2b8a34cc09219e671ea04846f P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.438177   431 tablet_replica.cc:333] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
W20260709 13:06:35.438454 12572 consensus_peers.cc:597] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.439047   431 raft_consensus.cc:2243] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.439739   431 raft_consensus.cc:2272] T a765e69f266148bfac6ac53d836eaa1e P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.442276   431 tablet_replica.cc:333] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.443109   431 raft_consensus.cc:2243] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.443811   431 raft_consensus.cc:2272] T 6bb509987c1847edb0809ad1cd615cb4 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.446504   431 tablet_replica.cc:333] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.447347   431 raft_consensus.cc:2243] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.447932   431 raft_consensus.cc:2272] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.451814   431 tablet_replica.cc:333] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.452490   431 raft_consensus.cc:2243] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.453410   431 raft_consensus.cc:2272] T 3f2f110ac2aa4305b535e10990fd067c P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.456123   431 tablet_replica.cc:333] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.456702   431 raft_consensus.cc:2243] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.457331   431 raft_consensus.cc:2272] T 7c1c9711c3a844a39c9d47767a0914d9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.459990   431 tablet_replica.cc:333] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.461270   431 raft_consensus.cc:2243] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:06:35.461357 12646 consensus_peers.cc:597] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.462388   431 raft_consensus.cc:2272] T bee2e25673e44226ac4b0a041d9885e1 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.464644   431 tablet_replica.cc:333] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.465447   431 raft_consensus.cc:2243] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.466574   431 raft_consensus.cc:2272] T 84e57a1d090b4284ace9e52e52a0f6c1 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.469327   431 tablet_replica.cc:333] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.470005   431 raft_consensus.cc:2243] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.470435   431 raft_consensus.cc:2272] T 071cf28a10a94df4a341829812b1111d P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.473404   431 tablet_replica.cc:333] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.474027   431 raft_consensus.cc:2243] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.474956   431 raft_consensus.cc:2272] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.477514   431 tablet_replica.cc:333] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.478149   431 raft_consensus.cc:2243] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.478670   431 raft_consensus.cc:2272] T 2164f5547ff34a49b4a6c281ecd13a0e P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.481179   431 tablet_replica.cc:333] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.481748   431 raft_consensus.cc:2243] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.482234   431 raft_consensus.cc:2272] T f6946f184e484e8ab9b462e8061eb0e9 P fc2992e6f7d5442495a80488190a805b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.484246   431 tablet_replica.cc:333] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b: stopping tablet replica
I20260709 13:06:35.484861   431 raft_consensus.cc:2243] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.485366   431 raft_consensus.cc:2272] T 85135b3a7cec49bf847d956d42f8b452 P fc2992e6f7d5442495a80488190a805b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.534209   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:06:35.577629   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:06:35.621888   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:35.622852   431 tablet_replica.cc:333] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.623728   431 raft_consensus.cc:2243] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.624385   431 raft_consensus.cc:2272] T 17533f47560743ff9edcbba53ab90408 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.627281   431 tablet_replica.cc:333] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.628160   431 raft_consensus.cc:2243] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.629235   431 raft_consensus.cc:2272] T 29397746c2d049e58042b46188921c03 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.631996   431 tablet_replica.cc:333] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.632884   431 raft_consensus.cc:2243] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.633523   431 raft_consensus.cc:2272] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.636696   431 tablet_replica.cc:333] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.637519   431 raft_consensus.cc:2243] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.638577   431 raft_consensus.cc:2272] T f6946f184e484e8ab9b462e8061eb0e9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.641376   431 tablet_replica.cc:333] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.642190   431 raft_consensus.cc:2243] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.642750   431 raft_consensus.cc:2272] T 85135b3a7cec49bf847d956d42f8b452 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.645830   431 tablet_replica.cc:333] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.646610   431 raft_consensus.cc:2243] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.647429   431 raft_consensus.cc:2272] T 7c1c9711c3a844a39c9d47767a0914d9 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:35.648180 12572 consensus_peers.cc:597] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.649919   431 tablet_replica.cc:333] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.650923   431 raft_consensus.cc:2243] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.651470   431 raft_consensus.cc:2272] T bee2e25673e44226ac4b0a041d9885e1 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.654053   431 tablet_replica.cc:333] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.654892   431 raft_consensus.cc:2243] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.655437   431 raft_consensus.cc:2272] T 84e57a1d090b4284ace9e52e52a0f6c1 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.658537   431 tablet_replica.cc:333] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.659474   431 raft_consensus.cc:2243] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.660121   431 raft_consensus.cc:2272] T 071cf28a10a94df4a341829812b1111d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.663491   431 tablet_replica.cc:333] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.664394   431 raft_consensus.cc:2243] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.665001   431 raft_consensus.cc:2272] T df92d5dc192340a1b701503547be467d P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.667707   431 tablet_replica.cc:333] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.668519   431 raft_consensus.cc:2243] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.669108   431 raft_consensus.cc:2272] T b49d19b2b8a34cc09219e671ea04846f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.671718   431 tablet_replica.cc:333] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.672613   431 raft_consensus.cc:2243] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.673722   431 raft_consensus.cc:2272] T 5653fb04d7ae4650aa051e6c1be8fd8f P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:35.676757 12646 consensus_peers.cc:597] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.677047   431 tablet_replica.cc:333] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
W20260709 13:06:35.677438 12646 consensus_peers.cc:597] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 -> Peer fc2992e6f7d5442495a80488190a805b (127.0.107.193:41443): Couldn't send request to peer fc2992e6f7d5442495a80488190a805b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.678025   431 raft_consensus.cc:2243] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.679205   431 raft_consensus.cc:2272] T 45e3f2d02450446bb05a3c69a47fcac4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.682428   431 tablet_replica.cc:333] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.683262   431 raft_consensus.cc:2243] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.683866   431 raft_consensus.cc:2272] T 3f2f110ac2aa4305b535e10990fd067c P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.687163   431 tablet_replica.cc:333] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.688016   431 raft_consensus.cc:2243] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.688659   431 raft_consensus.cc:2272] T 6bb509987c1847edb0809ad1cd615cb4 P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.691293   431 tablet_replica.cc:333] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.692073   431 raft_consensus.cc:2243] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.693145   431 raft_consensus.cc:2272] T a765e69f266148bfac6ac53d836eaa1e P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.695878   431 tablet_replica.cc:333] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.696635   431 raft_consensus.cc:2243] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.697163   431 raft_consensus.cc:2272] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P e35bdc3e9b3b4602955809715f74827d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.700737   431 tablet_replica.cc:333] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d: stopping tablet replica
I20260709 13:06:35.701428   431 raft_consensus.cc:2243] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.702498   431 raft_consensus.cc:2272] T 2164f5547ff34a49b4a6c281ecd13a0e P e35bdc3e9b3b4602955809715f74827d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:35.735522 12646 consensus_peers.cc:597] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 -> Peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Couldn't send request to peer e35bdc3e9b3b4602955809715f74827d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.753530   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:06:35.765895 12646 consensus_peers.cc:597] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 -> Peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Couldn't send request to peer e35bdc3e9b3b4602955809715f74827d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.789245   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:06:35.826222   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:35.827214   431 tablet_replica.cc:333] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.827935   431 raft_consensus.cc:2243] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.828519   431 raft_consensus.cc:2272] T 29397746c2d049e58042b46188921c03 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.830518   431 tablet_replica.cc:333] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.831264   431 raft_consensus.cc:2243] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.831858   431 raft_consensus.cc:2272] T df92d5dc192340a1b701503547be467d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.834088   431 tablet_replica.cc:333] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.834686   431 raft_consensus.cc:2243] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.835193   431 raft_consensus.cc:2272] T 7c1c9711c3a844a39c9d47767a0914d9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.837136   431 tablet_replica.cc:333] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.837723   431 raft_consensus.cc:2243] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.838171   431 raft_consensus.cc:2272] T bee2e25673e44226ac4b0a041d9885e1 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.840096   431 tablet_replica.cc:333] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.840639   431 raft_consensus.cc:2243] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.841089   431 raft_consensus.cc:2272] T 17533f47560743ff9edcbba53ab90408 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.842914   431 tablet_replica.cc:333] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.843432   431 raft_consensus.cc:2243] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.843863   431 raft_consensus.cc:2272] T 5653fb04d7ae4650aa051e6c1be8fd8f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.846324   431 tablet_replica.cc:333] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.847193   431 raft_consensus.cc:2243] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.847683   431 raft_consensus.cc:2272] T 45e3f2d02450446bb05a3c69a47fcac4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.849882   431 tablet_replica.cc:333] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.850445   431 raft_consensus.cc:2243] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.850917   431 raft_consensus.cc:2272] T b49d19b2b8a34cc09219e671ea04846f P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.853149   431 tablet_replica.cc:333] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.853767   431 raft_consensus.cc:2243] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.854322   431 raft_consensus.cc:2272] T 2164f5547ff34a49b4a6c281ecd13a0e P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.857004   431 tablet_replica.cc:333] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.857810   431 raft_consensus.cc:2243] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:35.857987 12646 consensus_peers.cc:597] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 -> Peer e35bdc3e9b3b4602955809715f74827d (127.0.107.194:34799): Couldn't send request to peer e35bdc3e9b3b4602955809715f74827d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.858302   431 raft_consensus.cc:2272] T 84e57a1d090b4284ace9e52e52a0f6c1 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.860841   431 tablet_replica.cc:333] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.861428   431 raft_consensus.cc:2243] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.862304   431 raft_consensus.cc:2272] T 071cf28a10a94df4a341829812b1111d P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.864420   431 tablet_replica.cc:333] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.864975   431 raft_consensus.cc:2243] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.865427   431 raft_consensus.cc:2272] T 46aa9a8dc6ae49ceb8ae283dd86a1c85 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.867753   431 tablet_replica.cc:333] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.868363   431 raft_consensus.cc:2243] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.868814   431 raft_consensus.cc:2272] T f6946f184e484e8ab9b462e8061eb0e9 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.870744   431 tablet_replica.cc:333] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.871310   431 raft_consensus.cc:2243] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.872213   431 raft_consensus.cc:2272] T 85135b3a7cec49bf847d956d42f8b452 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.874497   431 tablet_replica.cc:333] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.875049   431 raft_consensus.cc:2243] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.875818   431 raft_consensus.cc:2272] T 6bb509987c1847edb0809ad1cd615cb4 P 2f0f4839a29548a0b4179dc3adcff600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.877959   431 tablet_replica.cc:333] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.878748   431 raft_consensus.cc:2243] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.879354   431 raft_consensus.cc:2272] T a765e69f266148bfac6ac53d836eaa1e P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.881408   431 tablet_replica.cc:333] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.881933   431 raft_consensus.cc:2243] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:35.882721   431 raft_consensus.cc:2272] T ff8e41f781bd4de3bb79fd8a7fba7eb6 P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.884829   431 tablet_replica.cc:333] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600: stopping tablet replica
I20260709 13:06:35.885334   431 raft_consensus.cc:2243] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.885780   431 raft_consensus.cc:2272] T 3f2f110ac2aa4305b535e10990fd067c P 2f0f4839a29548a0b4179dc3adcff600 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.223263   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:06:36.257171   431 master.cc:562] Master@127.0.107.254:39631 shutting down...
I20260709 13:06:36.280906   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:36.281525   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.281905   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3c393215bc24911a91b5b297529805e: stopping tablet replica
I20260709 13:06:36.302672   431 master.cc:584] Master@127.0.107.254:39631 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13020 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (29500 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (352793 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:06:36.359144   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 442 messages since previous log ~578 seconds ago
I20260709 13:06:36.359370   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 442 messages since previous log ~578 seconds ago
I20260709 13:06:36.359510   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 442 messages since previous log ~578 seconds ago
I20260709 13:06:36.359660   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:06:36.359812   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:06:36.359975   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~176 seconds ago
I20260709 13:06:36.360226   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 3 messages since previous log ~200 seconds ago
I20260709 13:06:36.360442   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 3 messages since previous log ~200 seconds ago
I20260709 13:06:36.360642   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:06:36.360893   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~11 seconds ago
